-- Logs begin at Mon 2022-07-04 05:06:28 UTC, end at Mon 2022-07-04 06:12:54 UTC. -- Jul 04 05:41:57.267589 dv-cinder-797333-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 04 05:41:57.276298 dv-cinder-797333-5-smb devstack@keystone.service[80199]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 04 05:41:57.278440 dv-cinder-797333-5-smb devstack@keystone.service[80199]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 4 05:41:57 2022] *** Jul 04 05:41:57.278440 dv-cinder-797333-5-smb devstack@keystone.service[80199]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 04 05:41:57.278440 dv-cinder-797333-5-smb devstack@keystone.service[80199]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 04 05:41:57.278440 dv-cinder-797333-5-smb devstack@keystone.service[80199]: nodename: dv-cinder-797333-5-smb Jul 04 05:41:57.278440 dv-cinder-797333-5-smb devstack@keystone.service[80199]: machine: x86_64 Jul 04 05:41:57.278440 dv-cinder-797333-5-smb devstack@keystone.service[80199]: clock source: unix Jul 04 05:41:57.278440 dv-cinder-797333-5-smb devstack@keystone.service[80199]: pcre jit disabled Jul 04 05:41:57.278440 dv-cinder-797333-5-smb devstack@keystone.service[80199]: detected number of CPU cores: 4 Jul 04 05:41:57.278440 dv-cinder-797333-5-smb devstack@keystone.service[80199]: current working directory: / Jul 04 05:41:57.278440 dv-cinder-797333-5-smb devstack@keystone.service[80199]: detected binary path: /usr/bin/uwsgi-core Jul 04 05:41:57.278440 dv-cinder-797333-5-smb devstack@keystone.service[80199]: your processes number limit is 47680 Jul 04 05:41:57.279019 dv-cinder-797333-5-smb devstack@keystone.service[80199]: your memory page size is 4096 bytes Jul 04 05:41:57.279019 dv-cinder-797333-5-smb devstack@keystone.service[80199]: detected max file descriptor number: 2048 Jul 04 05:41:57.279019 dv-cinder-797333-5-smb devstack@keystone.service[80199]: lock engine: pthread robust mutexes Jul 04 05:41:57.279019 dv-cinder-797333-5-smb devstack@keystone.service[80199]: thunder lock: enabled Jul 04 05:41:57.279019 dv-cinder-797333-5-smb devstack@keystone.service[80199]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 04 05:41:57.279019 dv-cinder-797333-5-smb devstack@keystone.service[80199]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 04 05:41:57.321748 dv-cinder-797333-5-smb devstack@keystone.service[80199]: Python main interpreter initialized at 0x55e3e47669c0 Jul 04 05:41:57.321748 dv-cinder-797333-5-smb devstack@keystone.service[80199]: python threads support enabled Jul 04 05:41:57.321748 dv-cinder-797333-5-smb devstack@keystone.service[80199]: your server socket listen backlog is limited to 100 connections Jul 04 05:41:57.321748 dv-cinder-797333-5-smb devstack@keystone.service[80199]: your mercy for graceful operations on workers is 90 seconds Jul 04 05:41:57.322103 dv-cinder-797333-5-smb devstack@keystone.service[80199]: mapped 403077 bytes (393 KB) for 2 cores Jul 04 05:41:57.322175 dv-cinder-797333-5-smb devstack@keystone.service[80199]: *** Operational MODE: preforking *** Jul 04 05:41:57.322430 dv-cinder-797333-5-smb devstack@keystone.service[80199]: *** uWSGI is running in multiple interpreter mode *** Jul 04 05:41:57.322430 dv-cinder-797333-5-smb devstack@keystone.service[80199]: spawned uWSGI master process (pid: 80199) Jul 04 05:41:57.322637 dv-cinder-797333-5-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 04 05:41:57.324486 dv-cinder-797333-5-smb devstack@keystone.service[80199]: spawned uWSGI worker 1 (pid: 80212, cores: 1) Jul 04 05:41:57.324486 dv-cinder-797333-5-smb devstack@keystone.service[80199]: spawned uWSGI worker 2 (pid: 80213, cores: 1) Jul 04 05:41:57.324486 dv-cinder-797333-5-smb devstack@keystone.service[80199]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 04 05:42:02.658807 dv-cinder-797333-5-smb devstack@keystone.service[80213]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 05:42:02.658807 dv-cinder-797333-5-smb devstack@keystone.service[80213]: from cryptography.utils import int_from_bytes Jul 04 05:42:02.659654 dv-cinder-797333-5-smb devstack@keystone.service[80213]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 05:42:02.659654 dv-cinder-797333-5-smb devstack@keystone.service[80213]: from cryptography.utils import int_from_bytes Jul 04 05:42:02.660240 dv-cinder-797333-5-smb devstack@keystone.service[80212]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 05:42:02.660240 dv-cinder-797333-5-smb devstack@keystone.service[80212]: from cryptography.utils import int_from_bytes Jul 04 05:42:02.660750 dv-cinder-797333-5-smb devstack@keystone.service[80212]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 05:42:02.660750 dv-cinder-797333-5-smb devstack@keystone.service[80212]: from cryptography.utils import int_from_bytes Jul 04 05:42:02.707866 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 04 05:42:02.708053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 04 05:42:02.708254 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] command line args: [] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 04 05:42:02.708481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 04 05:42:02.708616 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 04 05:42:02.708692 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ================================================================================ {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 04 05:42:02.708764 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 04 05:42:02.708831 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] command line args: [] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 04 05:42:02.708894 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] admin_token = **** {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.709129 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 04 05:42:02.709264 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] config_dir = [] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.709339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ================================================================================ {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 04 05:42:02.709411 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.709476 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] config_source = [] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.709533 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] admin_token = **** {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.709619 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] debug = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.709781 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] config_dir = [] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.709866 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.710052 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.710121 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] config_source = [] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.710183 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.710240 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] debug = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.710305 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.710451 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.710581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.710696 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.710792 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.710906 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.711007 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] list_limit = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.711102 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.711233 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] log_config_append = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.711359 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.711463 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.711569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] log_dir = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.711670 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] list_limit = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.711779 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] log_file = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.711881 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] log_config_append = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.711881 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.712056 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.712172 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] log_dir = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.712295 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.712415 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] log_file = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.712490 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.712549 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.712659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.712784 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.712898 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.712974 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.713084 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.713204 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.713330 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.713406 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.713473 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.713545 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.713658 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.713746 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.713869 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.713944 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.714050 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.714166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.714247 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.714360 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.714446 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.714567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.714648 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.714768 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.714930 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.715055 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.715146 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.715449 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.715575 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.715664 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] publish_errors = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.715851 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.715975 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.716065 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.716140 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] publish_errors = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.716222 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.716345 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.716422 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.716539 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.716662 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.716768 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.716921 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] standard_threads = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.717059 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.717139 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.717219 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.717368 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.717563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] standard_threads = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.717645 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.717725 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.717801 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] use_journal = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.717869 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.717939 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] use_json = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.718019 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.718090 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] use_stderr = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.718159 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] use_journal = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.718226 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] use_syslog = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.718307 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] use_json = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.718386 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.718457 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] use_stderr = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.718618 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.718743 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] use_syslog = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.718832 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 05:42:02.718904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.719078 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.719227 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.719335 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.719420 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.719607 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.719739 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.719832 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.719905 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.720068 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.720194 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.720282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.720355 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.720529 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.720654 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.720742 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.720815 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.720993 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.721118 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.721215 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.721289 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.721458 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.721596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.721675 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.721755 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.721898 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.721993 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.722135 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.722218 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.722362 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.722444 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.722599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.722672 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.722819 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.722907 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.723067 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.723155 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.723324 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.723407 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.723570 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.723650 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.723801 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.723911 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.724056 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.724167 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.724407 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.724495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.724634 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.724715 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.724861 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.724944 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.725089 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.725170 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.725321 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.725403 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.725545 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.725625 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.725778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.725860 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.725996 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.726079 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.726224 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.726300 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.726452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.726533 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.726681 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.726768 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.726916 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.726991 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.727157 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.727258 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.727406 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.727492 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.727644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.727721 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.727869 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.727945 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.728098 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.728254 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.728334 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.728404 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.728541 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.728616 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.728767 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.728854 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.728994 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.729071 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.729220 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.729303 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.729451 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.729541 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.729687 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.729770 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.729916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.729993 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.730147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.730230 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.730374 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.730449 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.730607 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.730684 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.730838 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.730921 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.731074 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.731152 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.731323 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.731400 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.731557 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.731651 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.731792 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.731898 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.732026 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.732128 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.732254 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.732368 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.732487 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.732589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.732716 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.732831 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.732948 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.733039 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.733176 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.733264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.733407 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.733484 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.733635 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.733729 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.733869 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.733955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.734105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.734189 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.734331 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.734412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.734571 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.734697 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.734872 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.734961 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.735104 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.735204 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.735373 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.735473 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.735615 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.735694 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.735848 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.735929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.736080 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.736166 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.736314 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.736396 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.736547 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.736626 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.736783 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.736869 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.737022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.737102 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.737253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.737329 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.737488 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.737565 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.737720 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.737796 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.737950 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.738027 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.738179 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.738257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.738410 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.738487 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.738643 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.738725 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.738882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.738963 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.739115 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.739214 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.739374 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.739453 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.739601 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.739681 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.739825 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.739903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.740056 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.740142 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.740281 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.740369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.740507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.740586 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.740732 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.740916 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.740999 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.741078 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.741160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.741233 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.741391 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.741477 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.741619 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.741697 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.741858 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.741938 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.742091 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.742177 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.742335 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.742414 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.742575 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.742661 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.742813 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.742890 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.743051 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] auth.external = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.743128 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.743304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.743386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.743535 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] auth.external = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.743612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.743764 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.743877 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.744030 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] auth.password = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.744110 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.744257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] auth.token = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.744338 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.744487 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] auth.password = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.744570 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.744715 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] auth.token = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.744802 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.744950 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.745034 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.745178 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.745255 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.745417 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.745504 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.745646 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.745725 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.745872 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.745950 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.746104 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] credential.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.746195 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.746334 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.746413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.746566 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] credential.caching = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.746644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.746806 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.746892 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.747037 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.747116 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.747299 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.747379 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.747529 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.747618 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.747767 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.747851 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.747999 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.748082 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.748241 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.748331 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.748489 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.748568 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.748720 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.748804 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.748968 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.749055 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.749242 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.749322 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.749481 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.749562 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.749733 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.749823 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.749965 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] federation.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.750080 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.750186 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.750603 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.750762 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.750851 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] federation.caching = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.751005 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.751086 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.751257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.751342 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.751500 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.751593 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.751734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.751813 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.751982 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.752066 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.752212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.752299 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.752463 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.752541 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.752694 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.752773 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.752937 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.753027 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.753167 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.753246 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.753410 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.753488 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.753640 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] identity.caching = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.753793 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.753870 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.753940 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.754098 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.754183 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.754329 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.754408 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.754554 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.754632 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.754788 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.754867 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.755014 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.755093 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.755270 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.755351 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.755518 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.755596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.755748 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.755829 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.755975 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.756053 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.756219 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.756296 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.756456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.756539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.756679 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.756758 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.756923 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.757002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.757164 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.757244 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.757414 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.757499 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.757653 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.757731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.757889 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.757970 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.758117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.758195 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.758351 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.758429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.758578 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.758656 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.758808 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.758892 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.759033 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.759111 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.759289 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.759373 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.759528 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.759606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.759753 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.759887 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.759980 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.760055 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.760213 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.760292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.760442 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.760523 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.760683 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.760763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.760914 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.760995 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.761138 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.761216 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.761372 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.761452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.761595 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.761672 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.761827 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.761905 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.762052 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.762133 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.762285 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.762363 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.762516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.762593 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.762750 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.762830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.762980 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.763058 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.763232 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.763315 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.763471 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.763551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.763698 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.763776 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.763926 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.764002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.764153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.764234 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.764388 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.764466 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.764619 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.764697 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.764848 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.764927 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.765071 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.765148 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.765298 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.765376 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.765524 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.765604 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.765760 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.765839 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.766022 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.766166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.766282 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.766361 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.766521 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.766598 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.766750 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.766841 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.766976 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.767056 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.767230 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.767313 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.767459 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.767548 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.767689 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.767767 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.767923 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.768001 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.768155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.768241 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.768383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.768462 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.768622 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.768700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.768860 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.768946 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.769098 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.769176 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.769325 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.769403 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.769562 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.769646 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.769787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.769872 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.770018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.770096 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.770250 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.770336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.770482 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.770559 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.770715 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.770793 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.770948 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.771034 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.771264 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.771347 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.771449 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.771526 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.771679 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.771768 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.771921 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.772000 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.772146 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.772224 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.772385 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.772471 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.772616 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.772693 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.772849 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.772927 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.773082 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.773168 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.773309 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.773387 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.773540 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.773619 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.773767 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.773853 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] resource.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.774010 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.774087 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.774246 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] resource.caching = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.774325 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.774476 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.774562 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.774720 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.774797 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.774952 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.775030 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.775201 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.775293 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.775445 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.775523 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.775676 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.775753 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.775910 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.776065 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.776140 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.776210 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] role.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.776362 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.776440 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] role.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.776584 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.776670 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] role.caching = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.776825 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] role.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.776902 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.777051 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.777128 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.777295 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.777381 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.777536 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.777613 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.777776 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.777854 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.778016 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.778100 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.778254 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.778331 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.778491 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.778568 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.778716 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.778795 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.778960 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.779040 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.779199 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.779279 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.779446 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.779527 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.779685 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.779762 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.779926 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.780075 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.780162 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.780310 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.780547 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.780625 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.780785 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.780863 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.781032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.781112 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.781275 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.781353 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.781506 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.781584 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.781779 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.781857 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.782011 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.782089 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.782259 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.782336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.782490 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.782570 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.782721 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.782799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.782948 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.783024 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.783191 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.783274 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.783439 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.783519 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.783684 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.783770 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.783919 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.783997 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.784152 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.784230 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.784378 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.784463 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.784607 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.784746 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] token.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.784827 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.784887 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.785056 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] token.caching = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.785143 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.785288 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.785367 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.785535 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.785613 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.785766 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.785852 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.785996 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.786074 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.786234 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.786313 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.786464 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.786550 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.786705 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.786782 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.786937 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.787015 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.787172 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.787297 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.787425 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.787503 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.787661 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.787739 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.787891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.787977 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.788116 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.788233 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.788355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.788436 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.788578 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.788663 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.788818 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.788896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.connection = **** {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.789102 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.789190 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.789345 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.789423 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] database.connection = **** {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.789578 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.789665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.789813 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.789893 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.790044 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.790123 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.790277 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.790354 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.790508 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.790588 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.790740 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.790826 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.790973 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.791052 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.791220 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.791303 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.791465 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.791544 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.791696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.791774 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.791933 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.792013 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.792163 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.792241 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.792400 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.792477 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.792623 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.792703 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.792858 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.792936 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.793081 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.793157 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.793238 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 04 05:42:02.793310 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.793533 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 05:42:02.793699 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 04 05:42:02.823531 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:02.823797 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:02.823964 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:02.824053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:02.824131 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:02.824297 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:02.832428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:02.832686 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:02.860441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:02.860685 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:02.860812 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:02.860913 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.002719 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.004093 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.050791 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.050924 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.051557 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.051796 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.113587 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.113761 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.113835 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.114017 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.114159 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.114231 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.114308 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.114417 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.114508 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.114646 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.114787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.114871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.139461 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.139606 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.139676 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.139875 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.140003 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.140073 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.140134 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.140297 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.140438 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.140510 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.140586 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.140700 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.140807 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.140959 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.151734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.152005 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.164452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.164656 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.164755 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.164864 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.164944 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.165083 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.165219 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.165302 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.165396 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.165474 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.165537 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.165714 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80213) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.165844 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.165927 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80212) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 05:42:03.182897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.183081 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 04 05:42:03.183363 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.183495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.183564 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 04 05:42:03.183646 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 04 05:42:03.183868 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.183994 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.184064 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 04 05:42:03.184138 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.184338 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.184465 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.184568 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.184658 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.184839 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.185083 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.195408 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.195683 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.195949 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.196075 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.196225 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.196373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.196522 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.196798 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.204494 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.205128 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.207790 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.208064 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.208344 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.208471 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.208624 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.208754 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.208872 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.208963 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.209156 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.209288 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.209389 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.209494 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.209683 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.209858 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.209946 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.210061 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.210174 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.210264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.210445 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.210572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.210716 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.210973 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.236843 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.237547 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.238414 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.238699 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.239157 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.239453 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.243954 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.244234 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.244619 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.244745 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.244927 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.245350 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.252258 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.252537 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.253034 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.253315 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.256998 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.257253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.257556 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.257784 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.257914 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.258050 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.258145 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.258324 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.258418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.258614 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.258742 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.258839 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.258918 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.259130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.259428 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.259663 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.277377 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.277654 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.278214 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.278498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.282301 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.283116 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.286004 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.286295 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.286750 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.287036 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.291427 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.292165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.295005 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.295777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.298677 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.298973 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.299271 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.299399 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.299580 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.299708 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.299841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.299937 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.300144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.300273 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.300519 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.300859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.319440 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.319718 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.319929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.320031 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.320208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.320356 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.320428 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.320717 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.328109 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.328641 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.329837 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.330106 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.330319 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.330575 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.333303 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.333580 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.333848 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.333976 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.334127 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.334252 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.334410 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.334519 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.334646 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.334949 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.347708 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.347995 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.348232 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.348359 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.348478 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.348570 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.348755 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.348850 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.349035 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.349343 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.350276 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.350566 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.350831 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.351124 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.368534 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.369097 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.371835 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.372400 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.375137 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.376145 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.377334 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.377880 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.378957 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.379239 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.379547 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.379674 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.379852 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.380163 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.386842 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.387432 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.388472 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.389045 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.391713 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.391995 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.392290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.392418 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.392558 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.392641 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.392954 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.393226 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.401724 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.402011 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.402286 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.402412 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.402549 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.402851 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.410189 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80213) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.410462 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.410743 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.410883 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80212) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 05:42:03.410965 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.411031 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.411286 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.411416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.411613 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.411759 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.411841 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.411905 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.412191 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.412319 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.412416 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.412492 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.412713 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.412858 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.412997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.413077 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.413223 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.413353 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.413437 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.413527 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.413741 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80213) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.413871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.413979 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.414274 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80212) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 05:42:03.451644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e3e47669c0 pid: 80213 (default app) Jul 04 05:42:03.451972 dv-cinder-797333-5-smb devstack@keystone.service[80212]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e3e47669c0 pid: 80212 (default app) Jul 04 05:42:03.455110 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae868db-104c-4c36-b76b-c469dda87c3d None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:03.455425 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae868db-104c-4c36-b76b-c469dda87c3d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:03.455703 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae868db-104c-4c36-b76b-c469dda87c3d None None] PATH_INFO: `/v3` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:03.459930 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Mon Jul 4 05:42:03 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:11.199080 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fb2fd-aac6-4bd8-a127-f084ae162668 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:11.200020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fb2fd-aac6-4bd8-a127-f084ae162668 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:11.200020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fb2fd-aac6-4bd8-a127-f084ae162668 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:11.205747 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:11 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:11.211794 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82369bc-e300-473e-aa98-234df9b2b8ee None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:11.212253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82369bc-e300-473e-aa98-234df9b2b8ee None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:11.212345 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82369bc-e300-473e-aa98-234df9b2b8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:11.281422 dv-cinder-797333-5-smb devstack@keystone.service[80213]: INFO dbcounter [None req-c82369bc-e300-473e-aa98-234df9b2b8ee None None] Registered counter for database keystone Jul 04 05:42:11.305781 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG oslo_db.sqlalchemy.engines [None req-c82369bc-e300-473e-aa98-234df9b2b8ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80213) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 05:42:11.315843 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writer thread running {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 05:42:11.493999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG passlib.handlers.bcrypt [None req-c82369bc-e300-473e-aa98-234df9b2b8ee None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80213) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 04 05:42:11.494368 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG passlib.handlers.bcrypt [None req-c82369bc-e300-473e-aa98-234df9b2b8ee None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80213) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 04 05:42:11.550826 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-c82369bc-e300-473e-aa98-234df9b2b8ee None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:11.552480 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c82369bc-e300-473e-aa98-234df9b2b8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:11.685653 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 04 05:42:11.907008 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091fb2fd-aac6-4bd8-a127-f084ae162668 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:11.977310 dv-cinder-797333-5-smb devstack@keystone.service[80212]: INFO dbcounter [None req-091fb2fd-aac6-4bd8-a127-f084ae162668 None None] Registered counter for database keystone Jul 04 05:42:11.998764 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG oslo_db.sqlalchemy.engines [None req-091fb2fd-aac6-4bd8-a127-f084ae162668 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80212) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 05:42:12.011463 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writer thread running {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 05:42:12.129952 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091fb2fd-aac6-4bd8-a127-f084ae162668 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:12.135456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa8c7d-d2fb-4623-998e-6fc173ebc613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:12.136116 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa8c7d-d2fb-4623-998e-6fc173ebc613 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:12.136407 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa8c7d-d2fb-4623-998e-6fc173ebc613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:12.136682 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa8c7d-d2fb-4623-998e-6fc173ebc613 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:12.145944 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa8c7d-d2fb-4623-998e-6fc173ebc613 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:12.197090 dv-cinder-797333-5-smb devstack@keystone.service[80212]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a8fa8c7d-d2fb-4623-998e-6fc173ebc613 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 04 05:42:12.197359 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa8c7d-d2fb-4623-998e-6fc173ebc613 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:12.207784 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Mon Jul 4 05:42:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 04 05:42:12.214964 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82369bc-e300-473e-aa98-234df9b2b8ee None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:12.232038 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82369bc-e300-473e-aa98-234df9b2b8ee None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:12.238446 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e40cc2-51a7-49de-9505-ee1dadbd4ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:12.239598 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e40cc2-51a7-49de-9505-ee1dadbd4ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:12.239875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e40cc2-51a7-49de-9505-ee1dadbd4ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:12.240150 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e40cc2-51a7-49de-9505-ee1dadbd4ae1 admin admin] PATH_INFO: `/v3/projects/b420ef42d5dc484fb1563cbae9f104d5` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:12.244381 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e40cc2-51a7-49de-9505-ee1dadbd4ae1 admin admin] RBAC: Authorizing `identity:get_project(project_id=b420ef42d5dc484fb1563cbae9f104d5)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:12.294472 dv-cinder-797333-5-smb devstack@keystone.service[80213]: WARNING keystone.common.rbac_enforcer.enforcer [None req-24e40cc2-51a7-49de-9505-ee1dadbd4ae1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 04 05:42:12.294806 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e40cc2-51a7-49de-9505-ee1dadbd4ae1 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:12.299485 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Mon Jul 4 05:42:12 2022] GET /identity/v3/projects/b420ef42d5dc484fb1563cbae9f104d5 => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:14.336879 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa03b91-06c4-4ba5-8038-d56b0153c17b None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:14.337421 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa03b91-06c4-4ba5-8038-d56b0153c17b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:14.337421 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa03b91-06c4-4ba5-8038-d56b0153c17b None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:14.341663 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:14.348447 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557f1b7-a5eb-401d-87e8-08edc9c1bdd4 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:14.349198 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557f1b7-a5eb-401d-87e8-08edc9c1bdd4 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:14.349337 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557f1b7-a5eb-401d-87e8-08edc9c1bdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:14.379556 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-7557f1b7-a5eb-401d-87e8-08edc9c1bdd4 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:14.381110 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7557f1b7-a5eb-401d-87e8-08edc9c1bdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:14.390734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 04 05:42:14.418644 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa03b91-06c4-4ba5-8038-d56b0153c17b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:14.439696 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa03b91-06c4-4ba5-8038-d56b0153c17b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:14.445831 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bb36d-5654-4749-9382-99dc9877cf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:14.446473 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bb36d-5654-4749-9382-99dc9877cf2b admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:14.446765 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bb36d-5654-4749-9382-99dc9877cf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:14.447034 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bb36d-5654-4749-9382-99dc9877cf2b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:14.455921 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43bb36d-5654-4749-9382-99dc9877cf2b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:14.457747 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43bb36d-5654-4749-9382-99dc9877cf2b admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:14.467215 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Mon Jul 4 05:42:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 05:42:14.473683 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557f1b7-a5eb-401d-87e8-08edc9c1bdd4 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:14.488574 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557f1b7-a5eb-401d-87e8-08edc9c1bdd4 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:14.497446 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970daaa-1327-4a72-84da-9435017d585a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:14.498697 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970daaa-1327-4a72-84da-9435017d585a admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:14.498986 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970daaa-1327-4a72-84da-9435017d585a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:14.499292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970daaa-1327-4a72-84da-9435017d585a admin admin] PATH_INFO: `/v3/users/d0887b5131454893aad43e5ea46999bb` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:14.501346 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970daaa-1327-4a72-84da-9435017d585a admin admin] RBAC: Authorizing `identity:get_user(user_id=d0887b5131454893aad43e5ea46999bb)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:14.503209 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970daaa-1327-4a72-84da-9435017d585a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:14.504811 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Mon Jul 4 05:42:14 2022] GET /identity/v3/users/d0887b5131454893aad43e5ea46999bb => generated 247 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:16.580005 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06624274-5fc8-4941-b74a-5807fe4d0853 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:16.580529 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06624274-5fc8-4941-b74a-5807fe4d0853 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:16.580529 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06624274-5fc8-4941-b74a-5807fe4d0853 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:16.581926 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:16.587236 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3f013-a33b-42f4-bf48-188910283fe9 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:16.587671 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3f013-a33b-42f4-bf48-188910283fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:16.587798 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3f013-a33b-42f4-bf48-188910283fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:16.604884 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479ead7-8769-4982-bdf5-c25bba87f7a3 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:16.605059 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-16b3f013-a33b-42f4-bf48-188910283fe9 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:16.605179 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479ead7-8769-4982-bdf5-c25bba87f7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:16.605432 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479ead7-8769-4982-bdf5-c25bba87f7a3 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:16.606161 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-16b3f013-a33b-42f4-bf48-188910283fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:16.606788 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:42:16.611716 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab424f9-6893-42cb-978c-e6ab027464e5 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:16.612003 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab424f9-6893-42cb-978c-e6ab027464e5 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:16.612276 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab424f9-6893-42cb-978c-e6ab027464e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:16.651484 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG passlib.handlers.bcrypt [None req-4ab424f9-6893-42cb-978c-e6ab027464e5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80212) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 04 05:42:16.651887 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG passlib.handlers.bcrypt [None req-4ab424f9-6893-42cb-978c-e6ab027464e5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80212) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 04 05:42:16.689319 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:16.696839 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-4ab424f9-6893-42cb-978c-e6ab027464e5 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:16.698425 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-4ab424f9-6893-42cb-978c-e6ab027464e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:16.712489 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3f013-a33b-42f4-bf48-188910283fe9 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:16.737731 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:16.797383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 05:42:16.818769 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3f013-a33b-42f4-bf48-188910283fe9 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:16.819154 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab424f9-6893-42cb-978c-e6ab027464e5 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:16.851455 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90b128-6098-48c5-b6aa-561128139fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:16.852257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90b128-6098-48c5-b6aa-561128139fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:16.852546 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90b128-6098-48c5-b6aa-561128139fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:16.852812 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90b128-6098-48c5-b6aa-561128139fe3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:16.864284 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90b128-6098-48c5-b6aa-561128139fe3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:42:16.876061 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-9b90b128-6098-48c5-b6aa-561128139fe3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:42:16.876061 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:16.876061 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:16.876061 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:16.876061 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:16.876061 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:16.876061 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:16.876061 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:16.876061 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:16.876061 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:16.876061 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:16.876061 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:16.876061 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:42:16.876061 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:42:16.876061 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:42:16.876061 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:42:16.877045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:42:16.877045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:42:16.877045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:42:16.877045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:42:16.877045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:16.877045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:16.877045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:16.877045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:16.877045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:16.877045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:16.877045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:16.877045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:16.877045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:16.877045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:16.877045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:16.877045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:16.878065 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:16.878065 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:16.878065 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:16.878065 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:16.878065 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:42:16.878065 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:42:16.878065 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:42:16.878065 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:42:16.878065 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:42:16.878065 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:42:16.878065 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:42:16.878065 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:42:16.878065 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:42:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:42:16.883013 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90b128-6098-48c5-b6aa-561128139fe3 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:16.920403 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab424f9-6893-42cb-978c-e6ab027464e5 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:16.922786 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:16.957690 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941f0f2-46da-411a-ba1f-3d3c9abbd933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:16.958596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941f0f2-46da-411a-ba1f-3d3c9abbd933 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:16.958928 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941f0f2-46da-411a-ba1f-3d3c9abbd933 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:16.959216 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941f0f2-46da-411a-ba1f-3d3c9abbd933 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:16.963571 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:16.981033 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90b128-6098-48c5-b6aa-561128139fe3 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:17.014652 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828acff-679f-4e5d-9cb1-ddc342626314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:17.015404 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828acff-679f-4e5d-9cb1-ddc342626314 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:17.015680 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828acff-679f-4e5d-9cb1-ddc342626314 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:17.015954 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828acff-679f-4e5d-9cb1-ddc342626314 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:17.017161 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c828acff-679f-4e5d-9cb1-ddc342626314 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:17.017468 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c828acff-679f-4e5d-9cb1-ddc342626314 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:17.018889 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c828acff-679f-4e5d-9cb1-ddc342626314 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:17.027597 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941f0f2-46da-411a-ba1f-3d3c9abbd933 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:17.029125 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941f0f2-46da-411a-ba1f-3d3c9abbd933 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:17.030519 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:42:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:42:17.036162 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828acff-679f-4e5d-9cb1-ddc342626314 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:17.134844 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 8/16] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:42:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 05:42:17.135065 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828acff-679f-4e5d-9cb1-ddc342626314 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:17.140672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941f0f2-46da-411a-ba1f-3d3c9abbd933 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:17.143409 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:17.169338 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dafc71-3ad2-4f13-8fc9-7ec4047d078f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:17.170242 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dafc71-3ad2-4f13-8fc9-7ec4047d078f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:17.170544 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dafc71-3ad2-4f13-8fc9-7ec4047d078f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:17.170826 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dafc71-3ad2-4f13-8fc9-7ec4047d078f None admin] PATH_INFO: `/v3/users/d0887b5131454893aad43e5ea46999bb` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:17.172244 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dafc71-3ad2-4f13-8fc9-7ec4047d078f None admin] RBAC: Authorizing `identity:get_user(user_id=d0887b5131454893aad43e5ea46999bb)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:17.173732 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dafc71-3ad2-4f13-8fc9-7ec4047d078f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:17.175653 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:42:17 2022] GET /identity/v3/users/d0887b5131454893aad43e5ea46999bb => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:17.180861 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dafc71-3ad2-4f13-8fc9-7ec4047d078f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:17.194943 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:17.241758 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941f0f2-46da-411a-ba1f-3d3c9abbd933 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:17.276884 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe56a07-c025-4475-bd31-221b1ee4cacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:17.277674 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe56a07-c025-4475-bd31-221b1ee4cacd None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:17.277864 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dafc71-3ad2-4f13-8fc9-7ec4047d078f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:17.277985 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe56a07-c025-4475-bd31-221b1ee4cacd None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:17.278210 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe56a07-c025-4475-bd31-221b1ee4cacd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:17.296136 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe56a07-c025-4475-bd31-221b1ee4cacd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:17.297669 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe56a07-c025-4475-bd31-221b1ee4cacd None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:17.310583 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e147c9e-741d-41a4-8f44-a695c22b8713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:17.311502 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e147c9e-741d-41a4-8f44-a695c22b8713 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:17.311778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e147c9e-741d-41a4-8f44-a695c22b8713 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:17.312047 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e147c9e-741d-41a4-8f44-a695c22b8713 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:17.313254 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e147c9e-741d-41a4-8f44-a695c22b8713 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:17.314690 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e147c9e-741d-41a4-8f44-a695c22b8713 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:17.316458 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 10/18] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:42:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:17.317734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-bfe56a07-c025-4475-bd31-221b1ee4cacd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:42:17.317734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:17.317734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:17.317734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:17.317734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:17.317734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:17.317734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:17.317734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:17.317734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:17.317734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:17.317734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:17.317734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:17.317734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:42:17.317734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:42:17.317734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:42:17.318619 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:42:17.318619 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:17.318619 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:17.318619 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:17.318619 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:17.318619 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:17.318619 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:17.318619 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:17.318619 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:17.318619 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:17.318619 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:17.318619 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:17.318619 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:17.318619 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:17.318619 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:17.318619 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:17.318619 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:17.319459 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:42:17.319459 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:42:17.319459 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:42:17.319459 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:42:17.319459 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 9/19] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:42:17.322159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e147c9e-741d-41a4-8f44-a695c22b8713 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:17.324666 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe56a07-c025-4475-bd31-221b1ee4cacd None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:17.381694 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:17.401377 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:17.425979 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe56a07-c025-4475-bd31-221b1ee4cacd None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:17.429307 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e147c9e-741d-41a4-8f44-a695c22b8713 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:17.458426 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cade5-4fa7-4ac6-84fe-f1ef83989969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:17.459080 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cade5-4fa7-4ac6-84fe-f1ef83989969 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:17.459390 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cade5-4fa7-4ac6-84fe-f1ef83989969 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:17.459665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cade5-4fa7-4ac6-84fe-f1ef83989969 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:17.460390 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5cade5-4fa7-4ac6-84fe-f1ef83989969 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:17.460695 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5cade5-4fa7-4ac6-84fe-f1ef83989969 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:17.462084 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5cade5-4fa7-4ac6-84fe-f1ef83989969 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:17.464795 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e548a-a712-49b5-9a14-7412a0aa1cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:17.465462 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e548a-a712-49b5-9a14-7412a0aa1cfc None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:17.465748 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e548a-a712-49b5-9a14-7412a0aa1cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:17.466021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e548a-a712-49b5-9a14-7412a0aa1cfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:17.466854 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e548a-a712-49b5-9a14-7412a0aa1cfc None admin] RBAC: Adding query filter params (role.id=6c5b161dbf33447fa1d383915d3c9382, scope.domain.id=default, user.id=d0887b5131454893aad43e5ea46999bb) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:17.467161 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e548a-a712-49b5-9a14-7412a0aa1cfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:17.468674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e548a-a712-49b5-9a14-7412a0aa1cfc None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:17.475542 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 11/20] 10.222.0.16 () {56 vars in 1322 bytes} [Mon Jul 4 05:42:17 2022] GET /identity/v3/role_assignments?user.id=d0887b5131454893aad43e5ea46999bb&scope.domain.id=default&role.id=6c5b161dbf33447fa1d383915d3c9382 => generated 233 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:17.479339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 10/21] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:42:19.749130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e89951-04bd-4d6d-9379-d40a3baaff23 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:19.750135 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e89951-04bd-4d6d-9379-d40a3baaff23 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:19.750424 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e89951-04bd-4d6d-9379-d40a3baaff23 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:19.752235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 12/22] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:19.757601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e6cf2-e127-4dae-b2f0-3d099116d5b9 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:19.758475 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e6cf2-e127-4dae-b2f0-3d099116d5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:19.758931 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e6cf2-e127-4dae-b2f0-3d099116d5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:19.788623 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-335e6cf2-e127-4dae-b2f0-3d099116d5b9 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:19.790154 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-335e6cf2-e127-4dae-b2f0-3d099116d5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:19.863118 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 11/23] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:19.897906 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e89951-04bd-4d6d-9379-d40a3baaff23 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:20.006718 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfd691-989f-4079-a36a-4ae0a368bef4 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:20.007053 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfd691-989f-4079-a36a-4ae0a368bef4 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:20.007313 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfd691-989f-4079-a36a-4ae0a368bef4 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:20.008707 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 12/24] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:42:20.014698 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb5da1-1609-47e7-ac2c-0ba63b8c8e12 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:20.015351 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb5da1-1609-47e7-ac2c-0ba63b8c8e12 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:20.015823 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb5da1-1609-47e7-ac2c-0ba63b8c8e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:20.043106 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-5fdb5da1-1609-47e7-ac2c-0ba63b8c8e12 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:20.046800 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-5fdb5da1-1609-47e7-ac2c-0ba63b8c8e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:20.050961 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e89951-04bd-4d6d-9379-d40a3baaff23 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:20.093825 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c29aa-e5f9-4bd9-83b4-c60e2f68bcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:20.094646 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c29aa-e5f9-4bd9-83b4-c60e2f68bcca None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:20.094929 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c29aa-e5f9-4bd9-83b4-c60e2f68bcca None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:20.095219 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c29aa-e5f9-4bd9-83b4-c60e2f68bcca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:20.105195 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:20.116895 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c29aa-e5f9-4bd9-83b4-c60e2f68bcca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:42:20.129087 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-614c29aa-e5f9-4bd9-83b4-c60e2f68bcca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:42:20.129087 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:20.129087 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:20.129087 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:20.129087 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:20.129087 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:20.129087 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:20.129087 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:20.129087 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:20.129087 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:20.129087 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:20.129087 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:20.129087 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:42:20.129087 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:42:20.129087 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:42:20.129087 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:42:20.129956 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:42:20.129956 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:42:20.129956 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:42:20.129956 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:42:20.129956 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:20.129956 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:20.129956 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:20.129956 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:20.129956 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:20.129956 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:20.129956 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:20.129956 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:20.129956 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:20.129956 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:20.129956 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:20.129956 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:20.130727 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:20.130727 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:20.130727 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:20.130727 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:20.130727 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:42:20.130727 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:42:20.130727 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:42:20.130727 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:42:20.130727 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:42:20.130727 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:42:20.130727 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:42:20.130727 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:42:20.131319 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 13/25] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 05:42:20.131387 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 13/26] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:42:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:42:20.138160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb5da1-1609-47e7-ac2c-0ba63b8c8e12 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:20.195431 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c29aa-e5f9-4bd9-83b4-c60e2f68bcca None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:20.203373 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:20.256845 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb5da1-1609-47e7-ac2c-0ba63b8c8e12 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:20.291808 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754a619-0b7d-43a2-9638-ab1ba03bbdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:20.292808 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754a619-0b7d-43a2-9638-ab1ba03bbdbc None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:20.293418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754a619-0b7d-43a2-9638-ab1ba03bbdbc None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:20.293881 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754a619-0b7d-43a2-9638-ab1ba03bbdbc None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:20.294998 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c754a619-0b7d-43a2-9638-ab1ba03bbdbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:20.295493 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c754a619-0b7d-43a2-9638-ab1ba03bbdbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:20.297126 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c754a619-0b7d-43a2-9638-ab1ba03bbdbc None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:20.310622 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 14/27] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:42:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:42:20.312453 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209314a-130f-49c6-9412-d8a2fad54edb None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:20.312921 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209314a-130f-49c6-9412-d8a2fad54edb None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:20.313376 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209314a-130f-49c6-9412-d8a2fad54edb None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:20.315091 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 15/28] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:20.320136 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c73be-52bc-422e-b99d-2aa89ffc76a5 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:20.320625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c73be-52bc-422e-b99d-2aa89ffc76a5 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:20.321101 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c73be-52bc-422e-b99d-2aa89ffc76a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:20.338546 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-839c73be-52bc-422e-b99d-2aa89ffc76a5 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:20.340160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-839c73be-52bc-422e-b99d-2aa89ffc76a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:20.367729 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c29aa-e5f9-4bd9-83b4-c60e2f68bcca None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:20.375566 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:20.421434 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 16/29] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:20.421785 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7db16c-1f17-477f-9efb-bf59d458e4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:20.422668 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7db16c-1f17-477f-9efb-bf59d458e4bf None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:20.422959 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7db16c-1f17-477f-9efb-bf59d458e4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:20.423267 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7db16c-1f17-477f-9efb-bf59d458e4bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:20.423527 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c73be-52bc-422e-b99d-2aa89ffc76a5 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:20.434547 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7db16c-1f17-477f-9efb-bf59d458e4bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:20.436304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7db16c-1f17-477f-9efb-bf59d458e4bf None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:20.465093 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-6a7db16c-1f17-477f-9efb-bf59d458e4bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:42:20.465093 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:20.465093 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:20.465093 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:20.465093 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:20.465093 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:20.465093 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:20.465093 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:20.465093 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:20.465093 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:20.465093 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:20.465093 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:20.465093 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:42:20.465093 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:42:20.465093 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:42:20.465988 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:42:20.465988 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:20.465988 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:20.465988 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:20.465988 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:20.465988 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:20.465988 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:20.465988 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:20.465988 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:20.465988 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:20.465988 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:20.465988 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:20.465988 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:20.465988 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:20.465988 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:20.465988 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:20.465988 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:20.466764 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:42:20.466764 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:42:20.466764 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:42:20.466764 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:42:20.466764 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 14/30] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:42:20.467959 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c735f9-a14c-4d73-b9cb-c3017938f2d6 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:20.468317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c735f9-a14c-4d73-b9cb-c3017938f2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:20.468600 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c735f9-a14c-4d73-b9cb-c3017938f2d6 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:20.470318 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 15/31] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:20.471483 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c735f9-a14c-4d73-b9cb-c3017938f2d6 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:20.537994 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:20.539737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c73be-52bc-422e-b99d-2aa89ffc76a5 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:20.576190 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5871b-44bf-4c58-b169-36102ae1c06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:20.577303 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5871b-44bf-4c58-b169-36102ae1c06c None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:20.577621 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5871b-44bf-4c58-b169-36102ae1c06c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:20.577901 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5871b-44bf-4c58-b169-36102ae1c06c None admin] PATH_INFO: `/v3/users/d0887b5131454893aad43e5ea46999bb` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:20.579532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da5871b-44bf-4c58-b169-36102ae1c06c None admin] RBAC: Authorizing `identity:get_user(user_id=d0887b5131454893aad43e5ea46999bb)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:20.581106 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da5871b-44bf-4c58-b169-36102ae1c06c None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:20.582863 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 17/32] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:42:20 2022] GET /identity/v3/users/d0887b5131454893aad43e5ea46999bb => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:20.583648 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5871b-44bf-4c58-b169-36102ae1c06c None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:20.589723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c735f9-a14c-4d73-b9cb-c3017938f2d6 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:20.619789 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:20.628354 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd9aba-8763-47c9-b734-7f4a3b5e206b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:20.629504 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd9aba-8763-47c9-b734-7f4a3b5e206b None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:20.630005 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd9aba-8763-47c9-b734-7f4a3b5e206b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:20.630486 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd9aba-8763-47c9-b734-7f4a3b5e206b None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:20.631462 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd9aba-8763-47c9-b734-7f4a3b5e206b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:20.633313 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd9aba-8763-47c9-b734-7f4a3b5e206b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:20.690843 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5871b-44bf-4c58-b169-36102ae1c06c None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:20.730614 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9c184-6f06-4491-ae0c-02e66cc2c4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:20.731701 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9c184-6f06-4491-ae0c-02e66cc2c4bf None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:20.732209 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9c184-6f06-4491-ae0c-02e66cc2c4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:20.732751 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9c184-6f06-4491-ae0c-02e66cc2c4bf None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:20.733682 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9c184-6f06-4491-ae0c-02e66cc2c4bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:20.734274 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9c184-6f06-4491-ae0c-02e66cc2c4bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:20.735933 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9c184-6f06-4491-ae0c-02e66cc2c4bf None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:20.748636 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 18/33] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:20.750665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77694d-6665-4fba-9dc9-586548106ddd None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:20.751162 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77694d-6665-4fba-9dc9-586548106ddd None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:20.751679 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77694d-6665-4fba-9dc9-586548106ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:20.768635 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-5e77694d-6665-4fba-9dc9-586548106ddd None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:20.770542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-5e77694d-6665-4fba-9dc9-586548106ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:20.781392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 16/34] 10.222.0.16 () {60 vars in 1131 bytes} [Mon Jul 4 05:42:20 2022] POST /identity/v3/roles => generated 219 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:42:20.782378 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd9aba-8763-47c9-b734-7f4a3b5e206b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:20.853859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 19/35] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:20.855266 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77694d-6665-4fba-9dc9-586548106ddd None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:20.888274 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:20.974376 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77694d-6665-4fba-9dc9-586548106ddd None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:21.019430 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30e6f2-c979-4175-ae2f-1f91240c42dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:21.020634 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30e6f2-c979-4175-ae2f-1f91240c42dc None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:21.021389 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30e6f2-c979-4175-ae2f-1f91240c42dc None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:21.022026 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30e6f2-c979-4175-ae2f-1f91240c42dc None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:21.023029 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30e6f2-c979-4175-ae2f-1f91240c42dc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:21.024341 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd9aba-8763-47c9-b734-7f4a3b5e206b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:21.024924 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30e6f2-c979-4175-ae2f-1f91240c42dc None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:21.046914 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:21.075011 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a749d-ef2e-407f-9e19-d65e759028a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:21.078072 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a749d-ef2e-407f-9e19-d65e759028a7 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:21.078585 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a749d-ef2e-407f-9e19-d65e759028a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:21.079061 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a749d-ef2e-407f-9e19-d65e759028a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:21.086651 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a749d-ef2e-407f-9e19-d65e759028a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:21.086651 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a749d-ef2e-407f-9e19-d65e759028a7 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:21.086651 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 17/36] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:42:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:21.087144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a749d-ef2e-407f-9e19-d65e759028a7 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:21.184193 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 20/37] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 4 05:42:20 2022] POST /identity/v3/projects => generated 301 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:42:21.185144 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30e6f2-c979-4175-ae2f-1f91240c42dc None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:21.225378 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a749d-ef2e-407f-9e19-d65e759028a7 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:21.299509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d08e3-55c1-4aac-86b4-eee09cae48c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:21.300214 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d08e3-55c1-4aac-86b4-eee09cae48c0 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:21.300500 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d08e3-55c1-4aac-86b4-eee09cae48c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:21.300776 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d08e3-55c1-4aac-86b4-eee09cae48c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:21.301573 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6d08e3-55c1-4aac-86b4-eee09cae48c0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:21.303019 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6d08e3-55c1-4aac-86b4-eee09cae48c0 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:21.336821 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 18/38] 10.222.0.16 () {60 vars in 1131 bytes} [Mon Jul 4 05:42:21 2022] POST /identity/v3/roles => generated 225 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:42:21.345853 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:21.375771 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e2e49-251d-4e4e-99b0-072f11b16efd None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:21.376115 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e2e49-251d-4e4e-99b0-072f11b16efd None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:21.376331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e2e49-251d-4e4e-99b0-072f11b16efd None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:21.377953 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 19/39] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:21.383766 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b5d85-5136-4155-a072-c744bf0a4ea0 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:21.384075 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b5d85-5136-4155-a072-c744bf0a4ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:21.384328 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b5d85-5136-4155-a072-c744bf0a4ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:21.388838 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30e6f2-c979-4175-ae2f-1f91240c42dc None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:21.407875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-2b4b5d85-5136-4155-a072-c744bf0a4ea0 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:21.409635 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2b4b5d85-5136-4155-a072-c744bf0a4ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:21.429698 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832b368-2d80-4ddd-adf2-c3b1528ad9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:21.430927 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832b368-2d80-4ddd-adf2-c3b1528ad9f8 None admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:21.431453 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832b368-2d80-4ddd-adf2-c3b1528ad9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:21.431941 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832b368-2d80-4ddd-adf2-c3b1528ad9f8 None admin] PATH_INFO: `/v3/domains/default/users/d0887b5131454893aad43e5ea46999bb/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:21.434425 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3832b368-2d80-4ddd-adf2-c3b1528ad9f8 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d0887b5131454893aad43e5ea46999bb, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:21.436281 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3832b368-2d80-4ddd-adf2-c3b1528ad9f8 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:21.460644 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 21/40] 10.222.0.16 () {58 vars in 1361 bytes} [Mon Jul 4 05:42:21 2022] PUT /identity/v3/domains/default/users/d0887b5131454893aad43e5ea46999bb/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:42:21.476415 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:21.517452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 20/41] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:21.524352 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1eda8b-de52-47f6-9afb-74c406b4f302 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:21.524783 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1eda8b-de52-47f6-9afb-74c406b4f302 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:21.525063 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1eda8b-de52-47f6-9afb-74c406b4f302 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:21.526660 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 22/42] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:21.532229 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3f089-7882-4b8b-82d5-369886227fb5 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:21.532536 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3f089-7882-4b8b-82d5-369886227fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:21.532791 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3f089-7882-4b8b-82d5-369886227fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:21.547036 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1eda8b-de52-47f6-9afb-74c406b4f302 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:21.556951 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-cfc3f089-7882-4b8b-82d5-369886227fb5 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:21.558401 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-cfc3f089-7882-4b8b-82d5-369886227fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:21.657490 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 21/43] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:21.680187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1eda8b-de52-47f6-9afb-74c406b4f302 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:21.682003 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3f089-7882-4b8b-82d5-369886227fb5 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:21.717083 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a9720-3a56-484b-8c5c-6d2ab6d01c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:21.717680 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a9720-3a56-484b-8c5c-6d2ab6d01c1c None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:21.717967 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a9720-3a56-484b-8c5c-6d2ab6d01c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:21.718286 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a9720-3a56-484b-8c5c-6d2ab6d01c1c None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:21.719041 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a9720-3a56-484b-8c5c-6d2ab6d01c1c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:21.720477 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a9720-3a56-484b-8c5c-6d2ab6d01c1c None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:21.730143 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:21.737902 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1131 bytes} [Mon Jul 4 05:42:21 2022] POST /identity/v3/roles => generated 223 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:42:21.791741 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3f089-7882-4b8b-82d5-369886227fb5 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:21.795636 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:21.939670 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d3729-d910-4a88-b0f5-5e40e2296c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:21.940465 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d3729-d910-4a88-b0f5-5e40e2296c95 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:21.940746 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d3729-d910-4a88-b0f5-5e40e2296c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:21.941017 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d3729-d910-4a88-b0f5-5e40e2296c95 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:21.942212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d3729-d910-4a88-b0f5-5e40e2296c95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:21.943722 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d3729-d910-4a88-b0f5-5e40e2296c95 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:21.945375 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 22/45] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:42:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:42:21.951340 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a9720-3a56-484b-8c5c-6d2ab6d01c1c None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:22.160393 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a9720-3a56-484b-8c5c-6d2ab6d01c1c None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:22.195674 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bd032-d660-4ee8-87a1-841c01ac806c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:22.196350 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bd032-d660-4ee8-87a1-841c01ac806c None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:22.196642 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bd032-d660-4ee8-87a1-841c01ac806c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:22.196925 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bd032-d660-4ee8-87a1-841c01ac806c None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:22.197666 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bd032-d660-4ee8-87a1-841c01ac806c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:22.199165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bd032-d660-4ee8-87a1-841c01ac806c None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:22.226543 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 4 05:42:21 2022] POST /identity/v3/projects => generated 312 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 05:42:23.533557 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac50522-7679-430b-aab9-f7f4cd62de1a None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:23.534430 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac50522-7679-430b-aab9-f7f4cd62de1a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:23.534722 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac50522-7679-430b-aab9-f7f4cd62de1a None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:23.536317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 23/47] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:23.541516 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3707396-bd83-4402-8e63-d159607e4f6d None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:23.541912 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3707396-bd83-4402-8e63-d159607e4f6d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:23.542085 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3707396-bd83-4402-8e63-d159607e4f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:23.560101 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d3707396-bd83-4402-8e63-d159607e4f6d None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:23.561631 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d3707396-bd83-4402-8e63-d159607e4f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:23.610201 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:23.632950 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 25/48] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:23.656857 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac50522-7679-430b-aab9-f7f4cd62de1a None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:23.762859 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac50522-7679-430b-aab9-f7f4cd62de1a None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:23.796067 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c732b5-80d1-4b09-bae5-488741f233b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:23.796815 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c732b5-80d1-4b09-bae5-488741f233b6 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:23.797104 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c732b5-80d1-4b09-bae5-488741f233b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:23.797382 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c732b5-80d1-4b09-bae5-488741f233b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:23.807433 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c732b5-80d1-4b09-bae5-488741f233b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:42:23.815176 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-d2c732b5-80d1-4b09-bae5-488741f233b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:42:23.815176 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:23.815176 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:23.815176 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:23.815176 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:23.815176 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:23.815176 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:23.815176 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:23.815176 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:23.815176 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:23.815176 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:23.815176 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:23.815176 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:42:23.815176 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:42:23.815176 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:42:23.815176 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:42:23.816181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:42:23.816181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:42:23.816181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:42:23.816181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:42:23.816181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:23.816181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:23.816181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:23.816181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:23.816181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:23.816181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:23.816181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:23.816181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:23.816181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:23.816181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:23.816181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:23.816181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:23.817160 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:23.817160 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:23.817160 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:23.817160 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:23.817160 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:42:23.817160 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:42:23.817160 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:42:23.817160 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:42:23.817160 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:42:23.817160 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:42:23.817160 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:42:23.817160 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:42:23.817160 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 24/49] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:42:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:42:23.824024 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3707396-bd83-4402-8e63-d159607e4f6d None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:23.927991 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3707396-bd83-4402-8e63-d159607e4f6d None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:23.962537 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f4f70-8907-4417-b9d2-412865fa5df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:23.963211 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f4f70-8907-4417-b9d2-412865fa5df0 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:23.963508 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f4f70-8907-4417-b9d2-412865fa5df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:23.963783 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f4f70-8907-4417-b9d2-412865fa5df0 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:23.964527 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f4f70-8907-4417-b9d2-412865fa5df0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:23.964832 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f4f70-8907-4417-b9d2-412865fa5df0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:23.966229 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f4f70-8907-4417-b9d2-412865fa5df0 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:23.974624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 26/50] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:42:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:23.980205 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c732b5-80d1-4b09-bae5-488741f233b6 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:24.015343 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:24.084792 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c732b5-80d1-4b09-bae5-488741f233b6 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:24.119365 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6942500-2b3a-4c53-a4c4-d80897afbc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:24.120239 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6942500-2b3a-4c53-a4c4-d80897afbc41 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:24.120524 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6942500-2b3a-4c53-a4c4-d80897afbc41 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:24.120798 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6942500-2b3a-4c53-a4c4-d80897afbc41 None admin] PATH_INFO: `/v3/users/d0887b5131454893aad43e5ea46999bb` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:24.122036 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6942500-2b3a-4c53-a4c4-d80897afbc41 None admin] RBAC: Authorizing `identity:get_user(user_id=d0887b5131454893aad43e5ea46999bb)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:24.123540 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6942500-2b3a-4c53-a4c4-d80897afbc41 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:24.125603 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 25/51] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:42:23 2022] GET /identity/v3/users/d0887b5131454893aad43e5ea46999bb => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:24.131290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f4f70-8907-4417-b9d2-412865fa5df0 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:24.177691 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:24.235239 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b02c3-39de-4469-890e-8cc1d28fd5c0 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:24.235535 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b02c3-39de-4469-890e-8cc1d28fd5c0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:24.235704 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f4f70-8907-4417-b9d2-412865fa5df0 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:24.235804 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b02c3-39de-4469-890e-8cc1d28fd5c0 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:24.237218 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 26/52] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:42:24.242416 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817c26e-c9a0-4e15-af80-c37d1d1f0a58 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:24.242745 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817c26e-c9a0-4e15-af80-c37d1d1f0a58 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:24.243079 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817c26e-c9a0-4e15-af80-c37d1d1f0a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:24.261757 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-7817c26e-c9a0-4e15-af80-c37d1d1f0a58 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:24.262971 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7817c26e-c9a0-4e15-af80-c37d1d1f0a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:24.273836 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84cf69-c39d-402a-8911-7f4df9ea47cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:24.274653 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84cf69-c39d-402a-8911-7f4df9ea47cd None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:24.274940 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84cf69-c39d-402a-8911-7f4df9ea47cd None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:24.275239 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84cf69-c39d-402a-8911-7f4df9ea47cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:24.276514 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84cf69-c39d-402a-8911-7f4df9ea47cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:24.278022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84cf69-c39d-402a-8911-7f4df9ea47cd None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:24.279705 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 27/53] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:42:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:24.285733 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84cf69-c39d-402a-8911-7f4df9ea47cd None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:24.331021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 27/54] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 05:42:24.354204 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817c26e-c9a0-4e15-af80-c37d1d1f0a58 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:24.383399 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:24.383977 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84cf69-c39d-402a-8911-7f4df9ea47cd None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:24.395571 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:24.423954 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43416d62-2a25-4d58-b9af-548463148aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:24.424620 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43416d62-2a25-4d58-b9af-548463148aba None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:24.424903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43416d62-2a25-4d58-b9af-548463148aba None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:24.425178 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43416d62-2a25-4d58-b9af-548463148aba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:24.426024 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43416d62-2a25-4d58-b9af-548463148aba None admin] RBAC: Adding query filter params (role.id=6c5b161dbf33447fa1d383915d3c9382, scope.domain.id=default, user.id=d0887b5131454893aad43e5ea46999bb) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:24.426351 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43416d62-2a25-4d58-b9af-548463148aba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:24.427852 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43416d62-2a25-4d58-b9af-548463148aba None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:24.435905 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 28/55] 10.222.0.16 () {56 vars in 1322 bytes} [Mon Jul 4 05:42:24 2022] GET /identity/v3/role_assignments?user.id=d0887b5131454893aad43e5ea46999bb&scope.domain.id=default&role.id=6c5b161dbf33447fa1d383915d3c9382 => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:42:24.457557 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817c26e-c9a0-4e15-af80-c37d1d1f0a58 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:24.502253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c64f4-c7ab-4422-887e-66f09bd8dfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:24.503070 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c64f4-c7ab-4422-887e-66f09bd8dfeb None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:24.503385 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c64f4-c7ab-4422-887e-66f09bd8dfeb None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:24.503658 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c64f4-c7ab-4422-887e-66f09bd8dfeb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:24.505042 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c64f4-c7ab-4422-887e-66f09bd8dfeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:24.506559 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c64f4-c7ab-4422-887e-66f09bd8dfeb None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:24.508311 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 28/56] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:42:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:24.514278 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43416d62-2a25-4d58-b9af-548463148aba None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:24.628245 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43416d62-2a25-4d58-b9af-548463148aba None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:24.661227 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a22eb-dca9-49aa-b0a7-f05a8abbc8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:24.661899 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a22eb-dca9-49aa-b0a7-f05a8abbc8fe None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:24.662188 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a22eb-dca9-49aa-b0a7-f05a8abbc8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:24.662468 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a22eb-dca9-49aa-b0a7-f05a8abbc8fe None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:24.663256 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a22eb-dca9-49aa-b0a7-f05a8abbc8fe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:24.664704 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a22eb-dca9-49aa-b0a7-f05a8abbc8fe None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:24.689926 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 29/57] 10.222.0.16 () {60 vars in 1140 bytes} [Mon Jul 4 05:42:24 2022] POST /identity/v3/projects => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:42:26.686241 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb9eed-cfb1-4c3a-84ab-d07cf8b7746f None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:26.687086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb9eed-cfb1-4c3a-84ab-d07cf8b7746f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:26.687086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb9eed-cfb1-4c3a-84ab-d07cf8b7746f None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:26.689450 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 29/58] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:26.697921 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3734c68-09e9-4225-9ee5-a54660b8169c None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:26.698324 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3734c68-09e9-4225-9ee5-a54660b8169c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:26.698564 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3734c68-09e9-4225-9ee5-a54660b8169c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:26.717784 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d3734c68-09e9-4225-9ee5-a54660b8169c None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:26.719056 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d3734c68-09e9-4225-9ee5-a54660b8169c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:26.744383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:26.799996 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 30/59] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:26.836829 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb9eed-cfb1-4c3a-84ab-d07cf8b7746f None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:26.940870 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:26.946061 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb9eed-cfb1-4c3a-84ab-d07cf8b7746f None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:26.985947 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbe43c-7ab3-456d-afb3-3d0d83a966a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:26.986735 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbe43c-7ab3-456d-afb3-3d0d83a966a8 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:26.987014 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbe43c-7ab3-456d-afb3-3d0d83a966a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:26.987319 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbe43c-7ab3-456d-afb3-3d0d83a966a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:26.989167 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafbe43c-7ab3-456d-afb3-3d0d83a966a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:26.991483 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafbe43c-7ab3-456d-afb3-3d0d83a966a8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:26.993975 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 30/60] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:42:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:27.002257 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3734c68-09e9-4225-9ee5-a54660b8169c None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:27.102029 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3734c68-09e9-4225-9ee5-a54660b8169c None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:27.137075 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e179c0-c545-4f7c-a218-ca488ea5561d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:27.137735 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e179c0-c545-4f7c-a218-ca488ea5561d None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:27.138020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e179c0-c545-4f7c-a218-ca488ea5561d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:27.138299 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e179c0-c545-4f7c-a218-ca488ea5561d None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:27.139026 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e179c0-c545-4f7c-a218-ca488ea5561d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:27.140553 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e179c0-c545-4f7c-a218-ca488ea5561d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:27.168008 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 31/61] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 4 05:42:27 2022] POST /identity/v3/users => generated 275 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 05:42:30.316198 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618b362-26cb-418a-a58b-37c5a4a71f49 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:30.316721 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618b362-26cb-418a-a58b-37c5a4a71f49 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:30.316829 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618b362-26cb-418a-a58b-37c5a4a71f49 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:30.318292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 31/62] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:30.336998 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fb50d-bdfa-440d-9db0-54722420af08 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:30.337953 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fb50d-bdfa-440d-9db0-54722420af08 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:30.338424 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fb50d-bdfa-440d-9db0-54722420af08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:30.361698 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-299fb50d-bdfa-440d-9db0-54722420af08 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:30.363240 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-299fb50d-bdfa-440d-9db0-54722420af08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:30.377829 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:30.446634 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 32/63] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:30.470033 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618b362-26cb-418a-a58b-37c5a4a71f49 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:30.488676 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa434935-81dd-42e9-913d-36f39d0c635e None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:30.489347 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa434935-81dd-42e9-913d-36f39d0c635e None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:30.489825 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa434935-81dd-42e9-913d-36f39d0c635e None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:30.491502 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 33/64] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:42:30.496942 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b42922-b91f-4b7a-a931-7fa3509d76a8 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:30.497506 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b42922-b91f-4b7a-a931-7fa3509d76a8 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:30.498020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b42922-b91f-4b7a-a931-7fa3509d76a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:30.516548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-a9b42922-b91f-4b7a-a931-7fa3509d76a8 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:30.518080 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-a9b42922-b91f-4b7a-a931-7fa3509d76a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:30.592289 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618b362-26cb-418a-a58b-37c5a4a71f49 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:30.594887 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 34/65] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 05:42:30.596343 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e11cf6-abb7-40e9-b890-93e6fee8a985 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:30.596701 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e11cf6-abb7-40e9-b890-93e6fee8a985 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:30.597048 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e11cf6-abb7-40e9-b890-93e6fee8a985 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:30.598401 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 35/66] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:30.606164 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594e067-cabd-4eb7-b899-7d0904dbe203 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:30.606164 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594e067-cabd-4eb7-b899-7d0904dbe203 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:30.606164 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594e067-cabd-4eb7-b899-7d0904dbe203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:30.631045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ccea4-707c-4e32-bc93-f7f2bfb767c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:30.631885 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ccea4-707c-4e32-bc93-f7f2bfb767c2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:30.632175 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ccea4-707c-4e32-bc93-f7f2bfb767c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:30.632454 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ccea4-707c-4e32-bc93-f7f2bfb767c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:30.633755 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-6594e067-cabd-4eb7-b899-7d0904dbe203 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:30.635245 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-6594e067-cabd-4eb7-b899-7d0904dbe203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:30.643612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ccea4-707c-4e32-bc93-f7f2bfb767c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:42:30.652181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-f27ccea4-707c-4e32-bc93-f7f2bfb767c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:42:30.652181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:30.652181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:30.652181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:30.652181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:30.652181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:30.652181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:30.652181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:30.652181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:30.652181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:30.652181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:30.652181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:30.652181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:42:30.652181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:42:30.652181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:42:30.652181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:42:30.653120 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:42:30.653120 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:42:30.653120 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:42:30.653120 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:42:30.653120 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:30.653120 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:30.653120 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:30.653120 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:30.653120 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:30.653120 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:30.653120 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:30.653120 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:30.653120 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:30.653120 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:30.653120 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:30.653120 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:30.653882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:30.653882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:30.653882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:30.653882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:30.653882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:42:30.653882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:42:30.653882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:42:30.653882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:42:30.653882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:42:30.653882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:42:30.653882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:42:30.653882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:42:30.653882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 32/67] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:42:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:42:30.654709 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ccea4-707c-4e32-bc93-f7f2bfb767c2 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:30.684232 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:30.723519 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 36/68] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:30.724679 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594e067-cabd-4eb7-b899-7d0904dbe203 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:30.727339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:30.774861 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ccea4-707c-4e32-bc93-f7f2bfb767c2 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:30.813451 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1fec6-3559-48bc-a697-3b16cc017499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:30.814266 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1fec6-3559-48bc-a697-3b16cc017499 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:30.814560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1fec6-3559-48bc-a697-3b16cc017499 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:30.814838 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1fec6-3559-48bc-a697-3b16cc017499 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:30.826061 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1fec6-3559-48bc-a697-3b16cc017499 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:42:30.834412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-c4a1fec6-3559-48bc-a697-3b16cc017499 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:42:30.834412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:30.834412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:30.834412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:30.834412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:30.834412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:30.834412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:30.834412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:30.834412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:30.834412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:30.834412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:30.834412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:30.834412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:42:30.834412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:42:30.834412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:42:30.834412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:42:30.835507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:42:30.835507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:42:30.835507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:42:30.835507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:42:30.835507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:30.835507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:30.835507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:30.835507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:30.835507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:30.835507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:30.835507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:30.835507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:30.835507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:30.835507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:30.835507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:30.835507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:30.836269 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:30.836269 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:30.836269 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:30.836269 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:30.836269 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:42:30.836269 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:42:30.836269 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:42:30.836269 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:42:30.836269 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:42:30.836269 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:42:30.836269 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:42:30.836269 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:42:30.836269 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 33/69] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:42:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:42:30.836889 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1fec6-3559-48bc-a697-3b16cc017499 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:30.856206 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594e067-cabd-4eb7-b899-7d0904dbe203 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:30.892515 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068b03d-bc6d-4675-acf4-eba5fbb81742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:30.893636 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068b03d-bc6d-4675-acf4-eba5fbb81742 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:30.894236 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068b03d-bc6d-4675-acf4-eba5fbb81742 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:30.894568 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068b03d-bc6d-4675-acf4-eba5fbb81742 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:30.895490 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068b03d-bc6d-4675-acf4-eba5fbb81742 None admin] RBAC: Adding query filter params (name=member) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:30.895936 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068b03d-bc6d-4675-acf4-eba5fbb81742 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:30.897712 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068b03d-bc6d-4675-acf4-eba5fbb81742 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:30.907725 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 37/70] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 4 05:42:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:30.908969 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2a8fb-ae2b-408c-970e-aa60461eda84 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:30.909259 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2a8fb-ae2b-408c-970e-aa60461eda84 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:30.909541 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2a8fb-ae2b-408c-970e-aa60461eda84 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:30.910787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 38/71] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:30.911493 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2a8fb-ae2b-408c-970e-aa60461eda84 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:30.924356 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:30.940270 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1fec6-3559-48bc-a697-3b16cc017499 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:30.972281 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84728f-1c42-47c3-b6e2-364e2d68d8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:30.973092 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84728f-1c42-47c3-b6e2-364e2d68d8e4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:30.973379 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84728f-1c42-47c3-b6e2-364e2d68d8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:30.973659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84728f-1c42-47c3-b6e2-364e2d68d8e4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:30.974344 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:30.983950 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84728f-1c42-47c3-b6e2-364e2d68d8e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:42:30.992075 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-0e84728f-1c42-47c3-b6e2-364e2d68d8e4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 05:42:30.992075 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:30.992075 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:30.992075 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:30.992075 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:30.992075 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:30.992075 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:30.992075 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:30.992075 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:30.992075 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:30.992075 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:30.992075 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:30.992075 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:42:30.992075 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:42:30.992075 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:42:30.992075 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:42:30.992924 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:42:30.992924 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:42:30.992924 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:42:30.992924 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:42:30.992924 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:30.992924 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:30.992924 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:30.992924 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:30.992924 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:30.992924 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:30.992924 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:30.992924 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:30.992924 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:30.992924 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:30.992924 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:30.992924 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:30.993691 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:30.993691 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:30.993691 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:30.993691 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:30.993691 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:42:30.993691 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:42:30.993691 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:42:30.993691 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:42:30.993691 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:42:30.993691 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:42:30.993691 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 05:42:30.993691 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:42:30.993691 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 34/72] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 4 05:42:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:42:30.994347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84728f-1c42-47c3-b6e2-364e2d68d8e4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:31.015748 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2a8fb-ae2b-408c-970e-aa60461eda84 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:31.048807 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b84931-cbd4-44bb-b26a-9416a481544b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:31.049472 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b84931-cbd4-44bb-b26a-9416a481544b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:31.049757 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b84931-cbd4-44bb-b26a-9416a481544b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:31.050032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b84931-cbd4-44bb-b26a-9416a481544b None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:31.050791 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b84931-cbd4-44bb-b26a-9416a481544b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:31.051100 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b84931-cbd4-44bb-b26a-9416a481544b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:31.052537 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b84931-cbd4-44bb-b26a-9416a481544b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:31.060359 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 39/73] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:42:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:31.061585 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905eacd-c074-4f31-8ea0-dc99301522e6 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:31.061874 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905eacd-c074-4f31-8ea0-dc99301522e6 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:31.062153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905eacd-c074-4f31-8ea0-dc99301522e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:31.077869 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-b905eacd-c074-4f31-8ea0-dc99301522e6 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:31.079040 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b905eacd-c074-4f31-8ea0-dc99301522e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:31.098125 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84728f-1c42-47c3-b6e2-364e2d68d8e4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:31.130177 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6df6f-6cb8-4adc-b43b-68d47e144541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:31.130996 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6df6f-6cb8-4adc-b43b-68d47e144541 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:31.131316 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6df6f-6cb8-4adc-b43b-68d47e144541 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:31.131597 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6df6f-6cb8-4adc-b43b-68d47e144541 None admin] PATH_INFO: `/v3/users/915c0bffe1874fe6a9640f49dbeefe61` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:31.144869 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b6df6f-6cb8-4adc-b43b-68d47e144541 None admin] RBAC: Authorizing `identity:get_user(user_id=915c0bffe1874fe6a9640f49dbeefe61)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:31.145090 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 40/74] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:31.146375 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22735e9d-8722-4948-b273-317fde6b277e None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:31.146630 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b6df6f-6cb8-4adc-b43b-68d47e144541 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:31.146725 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22735e9d-8722-4948-b273-317fde6b277e None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:31.146927 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22735e9d-8722-4948-b273-317fde6b277e None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:31.148413 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 41/75] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:31.148510 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 35/76] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:42:30 2022] GET /identity/v3/users/915c0bffe1874fe6a9640f49dbeefe61 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:31.149089 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6df6f-6cb8-4adc-b43b-68d47e144541 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:31.152827 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22735e9d-8722-4948-b273-317fde6b277e None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:31.153500 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:31.216539 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:31.250053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6df6f-6cb8-4adc-b43b-68d47e144541 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:31.262641 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22735e9d-8722-4948-b273-317fde6b277e None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:31.285423 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918776c-4b1d-49bb-a3f9-40614d57cf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:31.286306 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918776c-4b1d-49bb-a3f9-40614d57cf1e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:31.286600 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918776c-4b1d-49bb-a3f9-40614d57cf1e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:31.286875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918776c-4b1d-49bb-a3f9-40614d57cf1e None admin] PATH_INFO: `/v3/users/d0887b5131454893aad43e5ea46999bb` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:31.288129 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918776c-4b1d-49bb-a3f9-40614d57cf1e None admin] RBAC: Authorizing `identity:get_user(user_id=d0887b5131454893aad43e5ea46999bb)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:31.289615 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918776c-4b1d-49bb-a3f9-40614d57cf1e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:31.295652 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 36/77] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:42:31 2022] GET /identity/v3/users/d0887b5131454893aad43e5ea46999bb => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:31.295652 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1d728-a6a0-4518-ba34-c7c195e3e4a6 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:31.295652 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1d728-a6a0-4518-ba34-c7c195e3e4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:31.295652 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1d728-a6a0-4518-ba34-c7c195e3e4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:31.296019 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c7a5e-c8ec-408b-9f54-0863c343e50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:31.296653 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c7a5e-c8ec-408b-9f54-0863c343e50a None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:31.296935 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c7a5e-c8ec-408b-9f54-0863c343e50a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:31.297209 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c7a5e-c8ec-408b-9f54-0863c343e50a None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:31.297959 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c7a5e-c8ec-408b-9f54-0863c343e50a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:31.298265 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c7a5e-c8ec-408b-9f54-0863c343e50a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:31.299684 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c7a5e-c8ec-408b-9f54-0863c343e50a None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:31.307731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 42/78] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:42:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:31.308508 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c7a5e-c8ec-408b-9f54-0863c343e50a None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:31.309575 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-e3c1d728-a6a0-4518-ba34-c7c195e3e4a6 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:31.310766 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e3c1d728-a6a0-4518-ba34-c7c195e3e4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:31.379909 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 37/79] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:31.380895 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1d728-a6a0-4518-ba34-c7c195e3e4a6 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:31.383253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:31.430128 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c7a5e-c8ec-408b-9f54-0863c343e50a None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:31.448318 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:31.466069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec77ce-e5c8-4bd3-a04d-960cf6559890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:31.466729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec77ce-e5c8-4bd3-a04d-960cf6559890 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:31.467007 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec77ce-e5c8-4bd3-a04d-960cf6559890 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:31.467315 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec77ce-e5c8-4bd3-a04d-960cf6559890 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:31.481262 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1d728-a6a0-4518-ba34-c7c195e3e4a6 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:31.513901 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55998c4f-7716-48ac-9eda-00cb1f2d985e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:31.514786 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55998c4f-7716-48ac-9eda-00cb1f2d985e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:31.515071 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55998c4f-7716-48ac-9eda-00cb1f2d985e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:31.515390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55998c4f-7716-48ac-9eda-00cb1f2d985e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:31.525693 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55998c4f-7716-48ac-9eda-00cb1f2d985e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:42:31.533386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec77ce-e5c8-4bd3-a04d-960cf6559890 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:31.533504 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-55998c4f-7716-48ac-9eda-00cb1f2d985e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:42:31.533504 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:31.533504 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:31.533504 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:31.533504 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:31.533504 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:31.533504 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:31.533504 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:31.533504 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:31.533504 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:31.533504 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:31.533504 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:31.533504 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:42:31.533504 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:42:31.533504 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:42:31.533504 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:42:31.534292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:42:31.534292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:42:31.534292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:42:31.534292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:42:31.534292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:31.534292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:31.534292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:31.534292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:31.534292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:31.534292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:31.534292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:31.534292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:31.534292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:31.534292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:31.534292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:31.534292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:31.535046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:31.535046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:31.535046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:31.535046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:31.535046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:42:31.535046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:42:31.535046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:42:31.535046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:42:31.535046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:42:31.535046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:42:31.535046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:42:31.535046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:42:31.535046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 38/80] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:42:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:42:31.535719 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55998c4f-7716-48ac-9eda-00cb1f2d985e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:31.539606 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec77ce-e5c8-4bd3-a04d-960cf6559890 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:31.596384 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:31.635923 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55998c4f-7716-48ac-9eda-00cb1f2d985e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:31.638063 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 43/81] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:42:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 05:42:31.638898 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec77ce-e5c8-4bd3-a04d-960cf6559890 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:31.657478 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:31.669925 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e1bfa-63c7-4ea9-91b1-9417e5916f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:31.670581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e1bfa-63c7-4ea9-91b1-9417e5916f12 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:31.670890 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e1bfa-63c7-4ea9-91b1-9417e5916f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:31.671171 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e1bfa-63c7-4ea9-91b1-9417e5916f12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:31.740560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e1bfa-63c7-4ea9-91b1-9417e5916f12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:31.740824 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec77ce-e5c8-4bd3-a04d-960cf6559890 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:31.742247 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e1bfa-63c7-4ea9-91b1-9417e5916f12 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:31.775928 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7911fb-a99a-4049-b89b-7e46c0d74616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:31.776803 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7911fb-a99a-4049-b89b-7e46c0d74616 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:31.777084 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7911fb-a99a-4049-b89b-7e46c0d74616 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:31.777358 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7911fb-a99a-4049-b89b-7e46c0d74616 None admin] PATH_INFO: `/v3/users/915c0bffe1874fe6a9640f49dbeefe61` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:31.778566 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7911fb-a99a-4049-b89b-7e46c0d74616 None admin] RBAC: Authorizing `identity:get_user(user_id=915c0bffe1874fe6a9640f49dbeefe61)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:31.780103 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7911fb-a99a-4049-b89b-7e46c0d74616 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:31.781851 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 44/82] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:42:31 2022] GET /identity/v3/users/915c0bffe1874fe6a9640f49dbeefe61 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:31.782635 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7911fb-a99a-4049-b89b-7e46c0d74616 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:31.807309 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:31.846073 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 39/83] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:42:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 05:42:31.846890 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e1bfa-63c7-4ea9-91b1-9417e5916f12 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:31.866548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:31.881231 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7911fb-a99a-4049-b89b-7e46c0d74616 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:31.916096 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272e31d-c7bc-4596-828c-cf576751b738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:31.916823 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272e31d-c7bc-4596-828c-cf576751b738 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:31.917129 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272e31d-c7bc-4596-828c-cf576751b738 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:31.917410 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272e31d-c7bc-4596-828c-cf576751b738 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:31.918645 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f272e31d-c7bc-4596-828c-cf576751b738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:31.920152 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f272e31d-c7bc-4596-828c-cf576751b738 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:31.921885 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 45/84] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:42:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:31.922674 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272e31d-c7bc-4596-828c-cf576751b738 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:31.947193 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e1bfa-63c7-4ea9-91b1-9417e5916f12 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:31.981522 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85d7f8-d97b-4419-803b-cce1907fd3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:31.982184 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85d7f8-d97b-4419-803b-cce1907fd3bb None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:31.982463 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85d7f8-d97b-4419-803b-cce1907fd3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:31.982735 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85d7f8-d97b-4419-803b-cce1907fd3bb None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:31.983593 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85d7f8-d97b-4419-803b-cce1907fd3bb None admin] RBAC: Adding query filter params (name=member) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:31.983910 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85d7f8-d97b-4419-803b-cce1907fd3bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:31.985378 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85d7f8-d97b-4419-803b-cce1907fd3bb None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:31.998433 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 40/85] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 4 05:42:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:31.998433 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85d7f8-d97b-4419-803b-cce1907fd3bb None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:32.022204 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:32.024659 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272e31d-c7bc-4596-828c-cf576751b738 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:32.059079 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1795f7-30f9-4b9b-84c2-2b977da058b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:32.059990 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1795f7-30f9-4b9b-84c2-2b977da058b2 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:32.060275 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1795f7-30f9-4b9b-84c2-2b977da058b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:32.060546 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1795f7-30f9-4b9b-84c2-2b977da058b2 None admin] PATH_INFO: `/v3/projects/3811ac7a7eab4e3e9040f45371523192` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:32.061767 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1795f7-30f9-4b9b-84c2-2b977da058b2 None admin] RBAC: Authorizing `identity:get_project(project_id=3811ac7a7eab4e3e9040f45371523192)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:32.063275 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1795f7-30f9-4b9b-84c2-2b977da058b2 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:32.065153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 46/86] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:42:31 2022] GET /identity/v3/projects/3811ac7a7eab4e3e9040f45371523192 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:32.065753 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1795f7-30f9-4b9b-84c2-2b977da058b2 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:32.093511 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:32.099809 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85d7f8-d97b-4419-803b-cce1907fd3bb None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:32.134521 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45df8a7-b2d2-4686-b8d6-b0e082a7dd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:32.135163 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45df8a7-b2d2-4686-b8d6-b0e082a7dd17 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:32.135470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45df8a7-b2d2-4686-b8d6-b0e082a7dd17 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:32.135739 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45df8a7-b2d2-4686-b8d6-b0e082a7dd17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:32.169649 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1795f7-30f9-4b9b-84c2-2b977da058b2 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:32.200511 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45df8a7-b2d2-4686-b8d6-b0e082a7dd17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:32.201670 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8a8dd-f2e2-4271-ae0a-82f28ec36099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:32.202092 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45df8a7-b2d2-4686-b8d6-b0e082a7dd17 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:32.202637 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8a8dd-f2e2-4271-ae0a-82f28ec36099 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:32.202924 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8a8dd-f2e2-4271-ae0a-82f28ec36099 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:32.203230 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8a8dd-f2e2-4271-ae0a-82f28ec36099 None admin] PATH_INFO: `/v3/projects/3811ac7a7eab4e3e9040f45371523192` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:32.204415 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8a8dd-f2e2-4271-ae0a-82f28ec36099 None admin] RBAC: Authorizing `identity:get_project(project_id=3811ac7a7eab4e3e9040f45371523192)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:32.205873 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8a8dd-f2e2-4271-ae0a-82f28ec36099 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:32.208108 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 47/87] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:42:32 2022] GET /identity/v3/projects/3811ac7a7eab4e3e9040f45371523192 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:32.208695 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8a8dd-f2e2-4271-ae0a-82f28ec36099 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:32.226554 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:32.297474 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:32.300534 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 41/88] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:42:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 05:42:32.301193 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45df8a7-b2d2-4686-b8d6-b0e082a7dd17 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:32.312118 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8a8dd-f2e2-4271-ae0a-82f28ec36099 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:32.345836 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e25385-b3ea-4ca7-b16c-6a8b80c0dda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:32.346513 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e25385-b3ea-4ca7-b16c-6a8b80c0dda8 None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:32.346802 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e25385-b3ea-4ca7-b16c-6a8b80c0dda8 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:32.347080 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e25385-b3ea-4ca7-b16c-6a8b80c0dda8 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:32.347854 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e25385-b3ea-4ca7-b16c-6a8b80c0dda8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:32.349296 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e25385-b3ea-4ca7-b16c-6a8b80c0dda8 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:32.369158 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 48/89] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 4 05:42:32 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:42:32.369962 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e25385-b3ea-4ca7-b16c-6a8b80c0dda8 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:32.418998 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45df8a7-b2d2-4686-b8d6-b0e082a7dd17 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:32.448539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:32.461422 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7996ddb-43b0-4f71-8c17-bbb4d0759adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:32.462320 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7996ddb-43b0-4f71-8c17-bbb4d0759adf None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:32.462612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7996ddb-43b0-4f71-8c17-bbb4d0759adf None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:32.462889 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7996ddb-43b0-4f71-8c17-bbb4d0759adf None admin] PATH_INFO: `/v3/users/915c0bffe1874fe6a9640f49dbeefe61` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:32.464173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7996ddb-43b0-4f71-8c17-bbb4d0759adf None admin] RBAC: Authorizing `identity:get_user(user_id=915c0bffe1874fe6a9640f49dbeefe61)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:32.465661 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7996ddb-43b0-4f71-8c17-bbb4d0759adf None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:32.467407 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 42/90] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:42:32 2022] GET /identity/v3/users/915c0bffe1874fe6a9640f49dbeefe61 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:32.467407 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7996ddb-43b0-4f71-8c17-bbb4d0759adf None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:32.486471 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e25385-b3ea-4ca7-b16c-6a8b80c0dda8 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:32.523273 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9d6e5-fb01-4afd-ae76-97c40caa485e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:32.523955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9d6e5-fb01-4afd-ae76-97c40caa485e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:32.524242 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9d6e5-fb01-4afd-ae76-97c40caa485e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:32.524525 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9d6e5-fb01-4afd-ae76-97c40caa485e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:32.525371 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9d6e5-fb01-4afd-ae76-97c40caa485e None admin] RBAC: Adding query filter params (role.id=9fdc0a5e493c44c9add5859af9d4f394, scope.project.id=3811ac7a7eab4e3e9040f45371523192, user.id=915c0bffe1874fe6a9640f49dbeefe61) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:32.525693 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9d6e5-fb01-4afd-ae76-97c40caa485e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:32.527201 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9d6e5-fb01-4afd-ae76-97c40caa485e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:32.534139 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 49/91] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:42:32 2022] GET /identity/v3/role_assignments?user.id=915c0bffe1874fe6a9640f49dbeefe61&scope.project.id=3811ac7a7eab4e3e9040f45371523192&role.id=9fdc0a5e493c44c9add5859af9d4f394 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:32.534781 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9d6e5-fb01-4afd-ae76-97c40caa485e None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:32.557999 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:32.610074 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7996ddb-43b0-4f71-8c17-bbb4d0759adf None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:32.658573 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d783b-6ff1-4846-82ed-ca3900c47565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:32.659296 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d783b-6ff1-4846-82ed-ca3900c47565 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:32.659584 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d783b-6ff1-4846-82ed-ca3900c47565 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:32.659863 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d783b-6ff1-4846-82ed-ca3900c47565 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:32.660716 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d783b-6ff1-4846-82ed-ca3900c47565 None admin] RBAC: Adding query filter params (role.id=6c5b161dbf33447fa1d383915d3c9382, scope.project.id=3811ac7a7eab4e3e9040f45371523192, user.id=d0887b5131454893aad43e5ea46999bb) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:32.661030 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d783b-6ff1-4846-82ed-ca3900c47565 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:32.663247 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d783b-6ff1-4846-82ed-ca3900c47565 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:32.671024 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 43/92] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:42:32 2022] GET /identity/v3/role_assignments?user.id=d0887b5131454893aad43e5ea46999bb&scope.project.id=3811ac7a7eab4e3e9040f45371523192&role.id=6c5b161dbf33447fa1d383915d3c9382 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:32.674012 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d783b-6ff1-4846-82ed-ca3900c47565 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:32.708316 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9d6e5-fb01-4afd-ae76-97c40caa485e None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:32.762266 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:32.770001 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613e87a-35dd-4a2f-a23f-e01d26cb9f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:32.771087 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613e87a-35dd-4a2f-a23f-e01d26cb9f92 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:32.771332 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613e87a-35dd-4a2f-a23f-e01d26cb9f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:32.771609 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613e87a-35dd-4a2f-a23f-e01d26cb9f92 None admin] PATH_INFO: `/v3/projects/3811ac7a7eab4e3e9040f45371523192` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:32.772916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613e87a-35dd-4a2f-a23f-e01d26cb9f92 None admin] RBAC: Authorizing `identity:get_project(project_id=3811ac7a7eab4e3e9040f45371523192)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:32.774417 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613e87a-35dd-4a2f-a23f-e01d26cb9f92 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:32.776399 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 50/93] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:42:32 2022] GET /identity/v3/projects/3811ac7a7eab4e3e9040f45371523192 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:32.782907 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613e87a-35dd-4a2f-a23f-e01d26cb9f92 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:32.815305 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d783b-6ff1-4846-82ed-ca3900c47565 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:32.851663 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2298d-0c83-42e5-b679-026db25f41fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:32.852696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2298d-0c83-42e5-b679-026db25f41fc None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:32.853172 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2298d-0c83-42e5-b679-026db25f41fc None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:32.853638 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2298d-0c83-42e5-b679-026db25f41fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:32.871318 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:32.896721 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613e87a-35dd-4a2f-a23f-e01d26cb9f92 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:32.927223 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd2298d-0c83-42e5-b679-026db25f41fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:32.929133 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd2298d-0c83-42e5-b679-026db25f41fc None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:32.934927 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ee0d8-603f-4800-a205-07c7bdb2cf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:32.935634 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ee0d8-603f-4800-a205-07c7bdb2cf84 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:32.935925 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ee0d8-603f-4800-a205-07c7bdb2cf84 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:32.936277 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ee0d8-603f-4800-a205-07c7bdb2cf84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:32.937088 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ee0d8-603f-4800-a205-07c7bdb2cf84 None admin] RBAC: Adding query filter params (role.id=91c119444803497dafe274cc66f05208, scope.project.id=3811ac7a7eab4e3e9040f45371523192, user.id=915c0bffe1874fe6a9640f49dbeefe61) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:32.937403 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ee0d8-603f-4800-a205-07c7bdb2cf84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:32.938883 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ee0d8-603f-4800-a205-07c7bdb2cf84 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:32.945602 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 51/94] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:42:32 2022] GET /identity/v3/role_assignments?user.id=915c0bffe1874fe6a9640f49dbeefe61&scope.project.id=3811ac7a7eab4e3e9040f45371523192&role.id=91c119444803497dafe274cc66f05208 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:32.993252 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:33.045716 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 44/95] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:42:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 05:42:33.051547 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ee0d8-603f-4800-a205-07c7bdb2cf84 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:33.179907 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ee0d8-603f-4800-a205-07c7bdb2cf84 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:33.229861 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4307e8a-265c-4871-a580-6c97f001044e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:33.230747 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4307e8a-265c-4871-a580-6c97f001044e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:33.231029 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4307e8a-265c-4871-a580-6c97f001044e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:33.231338 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4307e8a-265c-4871-a580-6c97f001044e None admin] PATH_INFO: `/v3/projects/8e58ab5bf94d4ca4a78407548c068fb6` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:33.232604 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4307e8a-265c-4871-a580-6c97f001044e None admin] RBAC: Authorizing `identity:get_project(project_id=8e58ab5bf94d4ca4a78407548c068fb6)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:33.234146 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4307e8a-265c-4871-a580-6c97f001044e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:33.235924 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 52/96] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:42:33 2022] GET /identity/v3/projects/8e58ab5bf94d4ca4a78407548c068fb6 => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:33.242443 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2298d-0c83-42e5-b679-026db25f41fc None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:33.396752 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2298d-0c83-42e5-b679-026db25f41fc None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:33.443875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eab089-7348-4c6b-8708-da47277eade4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:33.445398 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eab089-7348-4c6b-8708-da47277eade4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:33.445818 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eab089-7348-4c6b-8708-da47277eade4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:33.446226 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eab089-7348-4c6b-8708-da47277eade4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:33.447215 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eab089-7348-4c6b-8708-da47277eade4 None admin] RBAC: Adding query filter params (role.id=9fdc0a5e493c44c9add5859af9d4f394, scope.project.id=8e58ab5bf94d4ca4a78407548c068fb6, user.id=915c0bffe1874fe6a9640f49dbeefe61) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:33.447824 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eab089-7348-4c6b-8708-da47277eade4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:33.449486 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eab089-7348-4c6b-8708-da47277eade4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:33.455760 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 45/97] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:42:33 2022] GET /identity/v3/role_assignments?user.id=915c0bffe1874fe6a9640f49dbeefe61&scope.project.id=8e58ab5bf94d4ca4a78407548c068fb6&role.id=9fdc0a5e493c44c9add5859af9d4f394 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:35.275964 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a5f63-74fd-4fc1-bed6-8d30cb40de54 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:35.277755 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b9659-e2df-4b12-b1a5-f00bb4f180e9 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:35.278126 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b9659-e2df-4b12-b1a5-f00bb4f180e9 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:35.278302 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b9659-e2df-4b12-b1a5-f00bb4f180e9 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:35.280070 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a5f63-74fd-4fc1-bed6-8d30cb40de54 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:35.280357 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a5f63-74fd-4fc1-bed6-8d30cb40de54 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:35.281988 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 46/98] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:35.282173 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 53/99] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:35.287865 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2e111-3f3d-4b7a-86a8-876f606222b9 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:35.288153 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2e111-3f3d-4b7a-86a8-876f606222b9 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:35.288430 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2e111-3f3d-4b7a-86a8-876f606222b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:35.291763 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968eb64-9522-45c0-babd-ce6cdb5b01fa None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:35.292052 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968eb64-9522-45c0-babd-ce6cdb5b01fa None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:35.292332 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968eb64-9522-45c0-babd-ce6cdb5b01fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:35.315224 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-24d2e111-3f3d-4b7a-86a8-876f606222b9 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:35.316703 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-24d2e111-3f3d-4b7a-86a8-876f606222b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:35.331208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-3968eb64-9522-45c0-babd-ce6cdb5b01fa None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:35.331208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-3968eb64-9522-45c0-babd-ce6cdb5b01fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:35.332424 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:35.347218 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:35.425901 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 47/100] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:35.428595 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f331a4f-9d5a-4a16-95bc-b5b9bec97584 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:35.428883 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f331a4f-9d5a-4a16-95bc-b5b9bec97584 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:35.429162 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f331a4f-9d5a-4a16-95bc-b5b9bec97584 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:35.430454 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 48/101] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:35.436291 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38bd71-92cc-4e88-9c29-e840d26834ee None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:35.436580 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38bd71-92cc-4e88-9c29-e840d26834ee None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:35.436862 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38bd71-92cc-4e88-9c29-e840d26834ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:35.468334 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-4b38bd71-92cc-4e88-9c29-e840d26834ee None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:35.469515 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4b38bd71-92cc-4e88-9c29-e840d26834ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:35.476714 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 54/102] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:35.477568 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968eb64-9522-45c0-babd-ce6cdb5b01fa None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:35.608812 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 49/103] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:35.609751 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38bd71-92cc-4e88-9c29-e840d26834ee None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:35.667592 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968eb64-9522-45c0-babd-ce6cdb5b01fa None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:35.719415 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc414f6-007e-4efa-b1ef-99ac9176d462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:35.719415 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc414f6-007e-4efa-b1ef-99ac9176d462 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:35.719415 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc414f6-007e-4efa-b1ef-99ac9176d462 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:35.719415 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc414f6-007e-4efa-b1ef-99ac9176d462 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:35.752594 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:35.756672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc414f6-007e-4efa-b1ef-99ac9176d462 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:42:35.773756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-1fc414f6-007e-4efa-b1ef-99ac9176d462 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:42:35.773756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:35.773756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:35.773756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:35.773756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:35.773756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:35.773756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:35.773756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:35.773756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:35.773756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:35.773756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:35.773756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:35.773756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:42:35.773756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:42:35.773756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:42:35.773756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:42:35.774660 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:42:35.774660 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:42:35.774660 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:42:35.774660 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:42:35.774660 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:35.774660 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:35.774660 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:35.774660 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:35.774660 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:35.774660 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:35.774660 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:35.774660 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:35.774660 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:35.774660 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:35.774660 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:35.774660 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:35.775426 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:35.775426 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:35.775426 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:35.775426 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:35.775426 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:42:35.775426 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:42:35.775426 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:42:35.775426 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:42:35.775426 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:42:35.775426 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:42:35.775426 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:42:35.775426 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:42:35.775426 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 55/104] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:42:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:42:35.776059 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc414f6-007e-4efa-b1ef-99ac9176d462 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:35.783457 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:35.816618 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38bd71-92cc-4e88-9c29-e840d26834ee None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:35.890319 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d424232-bd6b-4501-98ec-305719c991f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:35.891133 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d424232-bd6b-4501-98ec-305719c991f2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:35.891502 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d424232-bd6b-4501-98ec-305719c991f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:35.891784 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d424232-bd6b-4501-98ec-305719c991f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:35.912948 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d424232-bd6b-4501-98ec-305719c991f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:42:35.921002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-2d424232-bd6b-4501-98ec-305719c991f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:42:35.921002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:35.921002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:35.921002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:35.921002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:35.921002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:35.921002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:35.921002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:35.921002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:35.921002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:35.921002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:35.921002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:35.921002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:42:35.921002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:42:35.921002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:42:35.921002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:42:35.921830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:42:35.921830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:42:35.921830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:42:35.921830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:42:35.921830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:35.921830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:35.921830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:35.921830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:35.921830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:35.921830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:35.921830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:35.921830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:35.921830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:35.921830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:35.921830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:35.921830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:35.922647 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:35.922647 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:35.922647 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:35.922647 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:35.922647 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:42:35.922647 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:42:35.922647 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:42:35.922647 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:42:35.922647 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:42:35.922647 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:42:35.922647 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:42:35.922647 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:42:35.922647 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 50/105] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:42:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:42:35.923294 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d424232-bd6b-4501-98ec-305719c991f2 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:35.996981 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc414f6-007e-4efa-b1ef-99ac9176d462 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:36.056367 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8fcd5-9c61-409c-b986-6080f17d3b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:36.057184 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8fcd5-9c61-409c-b986-6080f17d3b97 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:36.057464 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8fcd5-9c61-409c-b986-6080f17d3b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:36.057735 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8fcd5-9c61-409c-b986-6080f17d3b97 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:36.071600 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8fcd5-9c61-409c-b986-6080f17d3b97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:42:36.082939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-a4a8fcd5-9c61-409c-b986-6080f17d3b97 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 05:42:36.082939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:36.082939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:36.082939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:36.082939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:36.082939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:36.082939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:36.082939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:36.082939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:36.082939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:36.082939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:36.082939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:36.082939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:42:36.082939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:42:36.082939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:42:36.082939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:42:36.083849 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:42:36.083849 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:42:36.083849 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:42:36.083849 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:42:36.083849 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:36.083849 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:36.083849 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:36.083849 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:36.083849 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:36.083849 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:36.083849 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:36.083849 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:36.083849 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:36.083849 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:36.083849 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:36.083849 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:36.084601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:36.084601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:36.084601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:36.084601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:36.084601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:42:36.084601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:42:36.084601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:42:36.084601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:42:36.084601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:42:36.084601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:42:36.084601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 05:42:36.084601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:42:36.087062 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 56/106] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:42:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:42:36.087773 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8fcd5-9c61-409c-b986-6080f17d3b97 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:36.100285 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d424232-bd6b-4501-98ec-305719c991f2 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:36.146347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608af5a-0434-4653-a500-0a0327a74fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:36.147638 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608af5a-0434-4653-a500-0a0327a74fef None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:36.148089 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608af5a-0434-4653-a500-0a0327a74fef None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:36.148655 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608af5a-0434-4653-a500-0a0327a74fef None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:36.149919 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608af5a-0434-4653-a500-0a0327a74fef None admin] RBAC: Adding query filter params (name=member) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:36.151174 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608af5a-0434-4653-a500-0a0327a74fef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:36.152710 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608af5a-0434-4653-a500-0a0327a74fef None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:36.166253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 51/107] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 4 05:42:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:36.166253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608af5a-0434-4653-a500-0a0327a74fef None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:36.166253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:36.184494 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:36.228010 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8fcd5-9c61-409c-b986-6080f17d3b97 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:36.267925 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192aa5dd-b898-48e7-9cb9-cd5c466923c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:36.268617 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192aa5dd-b898-48e7-9cb9-cd5c466923c6 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:36.268946 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192aa5dd-b898-48e7-9cb9-cd5c466923c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:36.269225 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192aa5dd-b898-48e7-9cb9-cd5c466923c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:36.269979 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192aa5dd-b898-48e7-9cb9-cd5c466923c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:36.270288 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192aa5dd-b898-48e7-9cb9-cd5c466923c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:36.271779 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192aa5dd-b898-48e7-9cb9-cd5c466923c6 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:36.273873 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608af5a-0434-4653-a500-0a0327a74fef None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:36.280671 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 57/108] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:42:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:36.282069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9003ed-4bb0-4e89-8bae-5eaac83f972a None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:36.282426 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9003ed-4bb0-4e89-8bae-5eaac83f972a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:36.282771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9003ed-4bb0-4e89-8bae-5eaac83f972a None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:36.284335 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 58/109] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:36.285371 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f90ca-6c52-47e0-9560-8175074cfc5b None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:36.285715 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f90ca-6c52-47e0-9560-8175074cfc5b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:36.285998 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f90ca-6c52-47e0-9560-8175074cfc5b None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:36.287384 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 59/110] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:36.289462 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f90ca-6c52-47e0-9560-8175074cfc5b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:36.315483 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c573ed-ef75-4144-97b4-0a05a568e5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:36.316176 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c573ed-ef75-4144-97b4-0a05a568e5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:36.316452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c573ed-ef75-4144-97b4-0a05a568e5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:36.316728 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c573ed-ef75-4144-97b4-0a05a568e5b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:36.317433 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c573ed-ef75-4144-97b4-0a05a568e5b2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:36.317821 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c573ed-ef75-4144-97b4-0a05a568e5b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:36.319124 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c573ed-ef75-4144-97b4-0a05a568e5b2 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:36.327389 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 52/111] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 4 05:42:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:36.328111 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c573ed-ef75-4144-97b4-0a05a568e5b2 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:36.386825 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:36.395830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f90ca-6c52-47e0-9560-8175074cfc5b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:36.417408 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:36.423545 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c573ed-ef75-4144-97b4-0a05a568e5b2 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:36.429682 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250baf2-696b-4d3e-ad6c-e765444f9fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:36.430554 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250baf2-696b-4d3e-ad6c-e765444f9fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:36.430840 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250baf2-696b-4d3e-ad6c-e765444f9fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:36.431116 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250baf2-696b-4d3e-ad6c-e765444f9fd2 None admin] PATH_INFO: `/v3/users/915c0bffe1874fe6a9640f49dbeefe61` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:36.432320 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250baf2-696b-4d3e-ad6c-e765444f9fd2 None admin] RBAC: Authorizing `identity:get_user(user_id=915c0bffe1874fe6a9640f49dbeefe61)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:36.433783 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250baf2-696b-4d3e-ad6c-e765444f9fd2 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:36.435462 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 60/112] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:42:36 2022] GET /identity/v3/users/915c0bffe1874fe6a9640f49dbeefe61 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:36.436629 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75755880-5184-459a-af05-2742979c4478 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:36.436907 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75755880-5184-459a-af05-2742979c4478 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:36.437182 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75755880-5184-459a-af05-2742979c4478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:36.453889 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-75755880-5184-459a-af05-2742979c4478 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:36.455067 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-75755880-5184-459a-af05-2742979c4478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:36.461434 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003c9e7-77b5-49ea-bbff-812835d549be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:36.462306 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003c9e7-77b5-49ea-bbff-812835d549be None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:36.462614 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003c9e7-77b5-49ea-bbff-812835d549be None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:36.462889 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003c9e7-77b5-49ea-bbff-812835d549be None admin] PATH_INFO: `/v3/users/d0887b5131454893aad43e5ea46999bb` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:36.464236 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003c9e7-77b5-49ea-bbff-812835d549be None admin] RBAC: Authorizing `identity:get_user(user_id=d0887b5131454893aad43e5ea46999bb)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:36.465688 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003c9e7-77b5-49ea-bbff-812835d549be None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:36.467518 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 53/113] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:42:36 2022] GET /identity/v3/users/d0887b5131454893aad43e5ea46999bb => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:36.468512 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89133ac1-05fb-464c-8001-498f7b0652f3 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:36.468780 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89133ac1-05fb-464c-8001-498f7b0652f3 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:36.469062 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89133ac1-05fb-464c-8001-498f7b0652f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:36.485921 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-89133ac1-05fb-464c-8001-498f7b0652f3 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:36.487122 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-89133ac1-05fb-464c-8001-498f7b0652f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:36.521805 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 61/114] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:36.523107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebe95e-5a10-4e41-8875-943219c1693f None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:36.523424 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebe95e-5a10-4e41-8875-943219c1693f None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:36.523702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebe95e-5a10-4e41-8875-943219c1693f None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:36.524980 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 62/115] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:36.525666 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeebe95e-5a10-4e41-8875-943219c1693f None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:36.566377 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 54/116] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:36.567408 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89133ac1-05fb-464c-8001-498f7b0652f3 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:36.627764 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:36.636759 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeebe95e-5a10-4e41-8875-943219c1693f None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:36.656880 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:36.667630 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89133ac1-05fb-464c-8001-498f7b0652f3 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:36.670977 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf889ae-959e-4965-979e-46de7119c241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:36.671889 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf889ae-959e-4965-979e-46de7119c241 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:36.672175 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf889ae-959e-4965-979e-46de7119c241 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:36.672451 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf889ae-959e-4965-979e-46de7119c241 None admin] PATH_INFO: `/v3/users/a3b4eaed8e51411aba85f0da253e9123` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:36.687372 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf889ae-959e-4965-979e-46de7119c241 None admin] RBAC: Authorizing `identity:get_user(user_id=a3b4eaed8e51411aba85f0da253e9123)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:36.688861 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf889ae-959e-4965-979e-46de7119c241 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:36.690579 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 63/117] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:42:36 2022] GET /identity/v3/users/a3b4eaed8e51411aba85f0da253e9123 => generated 289 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:36.695975 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf889ae-959e-4965-979e-46de7119c241 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:36.700011 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119af80b-b541-4868-9191-c3d5ed42cf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:36.700878 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119af80b-b541-4868-9191-c3d5ed42cf14 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:36.701160 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119af80b-b541-4868-9191-c3d5ed42cf14 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:36.701436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119af80b-b541-4868-9191-c3d5ed42cf14 None admin] PATH_INFO: `/v3/projects/3811ac7a7eab4e3e9040f45371523192` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:36.702746 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119af80b-b541-4868-9191-c3d5ed42cf14 None admin] RBAC: Authorizing `identity:get_project(project_id=3811ac7a7eab4e3e9040f45371523192)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:36.704234 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119af80b-b541-4868-9191-c3d5ed42cf14 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:36.705945 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 55/118] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:42:36 2022] GET /identity/v3/projects/3811ac7a7eab4e3e9040f45371523192 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:36.705945 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d21bf1-a235-49ae-8e4d-594768f527b4 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:36.705945 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d21bf1-a235-49ae-8e4d-594768f527b4 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:36.705945 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d21bf1-a235-49ae-8e4d-594768f527b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:36.723346 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-33d21bf1-a235-49ae-8e4d-594768f527b4 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:36.724518 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-33d21bf1-a235-49ae-8e4d-594768f527b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:36.791827 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 56/119] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:36.792657 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d21bf1-a235-49ae-8e4d-594768f527b4 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:36.803834 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf889ae-959e-4965-979e-46de7119c241 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:36.837474 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95df67-7c19-4bf2-9e1b-3475cce155fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:36.838369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95df67-7c19-4bf2-9e1b-3475cce155fd None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:36.838645 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95df67-7c19-4bf2-9e1b-3475cce155fd None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:36.838916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95df67-7c19-4bf2-9e1b-3475cce155fd None admin] PATH_INFO: `/v3/projects/3811ac7a7eab4e3e9040f45371523192` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:36.840130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95df67-7c19-4bf2-9e1b-3475cce155fd None admin] RBAC: Authorizing `identity:get_project(project_id=3811ac7a7eab4e3e9040f45371523192)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:36.841647 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95df67-7c19-4bf2-9e1b-3475cce155fd None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:36.848223 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 64/120] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:42:36 2022] GET /identity/v3/projects/3811ac7a7eab4e3e9040f45371523192 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:36.848223 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95df67-7c19-4bf2-9e1b-3475cce155fd None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:36.853331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:36.891117 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:36.894715 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d21bf1-a235-49ae-8e4d-594768f527b4 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:36.927960 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98425553-8765-449e-849e-e3cebfeb14d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:36.928756 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98425553-8765-449e-849e-e3cebfeb14d4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:36.929037 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98425553-8765-449e-849e-e3cebfeb14d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:36.929311 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98425553-8765-449e-849e-e3cebfeb14d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:36.930483 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98425553-8765-449e-849e-e3cebfeb14d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:36.932003 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98425553-8765-449e-849e-e3cebfeb14d4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:36.933681 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 57/121] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:42:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:36.934417 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98425553-8765-449e-849e-e3cebfeb14d4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:36.949811 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95df67-7c19-4bf2-9e1b-3475cce155fd None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:36.982756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d1d7f7-2691-40c0-9266-cdbb6b81f407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:36.983600 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1d7f7-2691-40c0-9266-cdbb6b81f407 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:36.983882 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1d7f7-2691-40c0-9266-cdbb6b81f407 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:36.984161 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1d7f7-2691-40c0-9266-cdbb6b81f407 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:36.994205 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d1d7f7-2691-40c0-9266-cdbb6b81f407 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:42:37.002584 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-32d1d7f7-2691-40c0-9266-cdbb6b81f407 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 05:42:37.002584 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:37.002584 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:37.002584 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:37.002584 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:37.002584 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:37.002584 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:37.002584 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:37.002584 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:37.002584 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:37.002584 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:37.002584 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:37.002584 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:42:37.002584 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:42:37.002584 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:42:37.002584 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:42:37.003624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:42:37.003624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:42:37.003624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:42:37.003624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:42:37.003624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:37.003624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:37.003624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:37.003624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:37.003624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:37.003624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:37.003624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:37.003624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:37.003624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:37.003624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:37.003624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:37.003624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:37.004404 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:37.004404 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:37.004404 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:37.004404 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:37.004404 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:42:37.004404 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:42:37.004404 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:42:37.004404 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:42:37.004404 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:42:37.004404 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:42:37.004404 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 05:42:37.004404 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:42:37.004404 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 65/122] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 4 05:42:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:42:37.005347 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d1d7f7-2691-40c0-9266-cdbb6b81f407 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:37.030015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98425553-8765-449e-849e-e3cebfeb14d4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:37.056892 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:37.065634 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92736de-4009-4d2e-97af-d3cf62aa4d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:37.066380 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92736de-4009-4d2e-97af-d3cf62aa4d06 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:37.066671 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92736de-4009-4d2e-97af-d3cf62aa4d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:37.066974 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92736de-4009-4d2e-97af-d3cf62aa4d06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:37.104616 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d1d7f7-2691-40c0-9266-cdbb6b81f407 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:37.111354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:37.133249 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92736de-4009-4d2e-97af-d3cf62aa4d06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:37.134746 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92736de-4009-4d2e-97af-d3cf62aa4d06 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:37.138432 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25294c8-f462-44bf-9e7b-e6ff8f63ece8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:37.139374 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25294c8-f462-44bf-9e7b-e6ff8f63ece8 None admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:37.139661 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25294c8-f462-44bf-9e7b-e6ff8f63ece8 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:37.139936 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25294c8-f462-44bf-9e7b-e6ff8f63ece8 None admin] PATH_INFO: `/v3/projects/3811ac7a7eab4e3e9040f45371523192/users/915c0bffe1874fe6a9640f49dbeefe61/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:37.141935 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25294c8-f462-44bf-9e7b-e6ff8f63ece8 None admin] RBAC: Authorizing `identity:create_grant(project_id=3811ac7a7eab4e3e9040f45371523192, user_id=915c0bffe1874fe6a9640f49dbeefe61, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:37.143386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25294c8-f462-44bf-9e7b-e6ff8f63ece8 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:37.156576 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 66/123] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 4 05:42:37 2022] PUT /identity/v3/projects/3811ac7a7eab4e3e9040f45371523192/users/915c0bffe1874fe6a9640f49dbeefe61/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:42:37.166654 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25294c8-f462-44bf-9e7b-e6ff8f63ece8 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:37.248459 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 58/124] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:42:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 05:42:37.249617 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92736de-4009-4d2e-97af-d3cf62aa4d06 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:37.277858 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25294c8-f462-44bf-9e7b-e6ff8f63ece8 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:37.280604 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:37.318798 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65910815-966c-4146-bf0c-ed238e3e29dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:37.319722 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65910815-966c-4146-bf0c-ed238e3e29dc None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:37.320012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65910815-966c-4146-bf0c-ed238e3e29dc None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:37.320373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65910815-966c-4146-bf0c-ed238e3e29dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:37.330993 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65910815-966c-4146-bf0c-ed238e3e29dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:42:37.339062 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-65910815-966c-4146-bf0c-ed238e3e29dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:42:37.339062 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:37.339062 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:37.339062 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:37.339062 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:37.339062 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:37.339062 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:37.339062 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:37.339062 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:37.339062 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:37.339062 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:37.339062 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:37.339062 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:42:37.339062 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:42:37.339062 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:42:37.339062 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:42:37.339987 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:42:37.339987 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:42:37.339987 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:42:37.339987 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:42:37.339987 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:37.339987 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:37.339987 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:37.339987 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:37.339987 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:37.339987 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:37.339987 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:37.339987 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:37.339987 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:37.339987 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:37.339987 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:37.339987 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:37.340737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:37.340737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:37.340737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:37.340737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:37.340737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:42:37.340737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:42:37.340737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:42:37.340737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:42:37.340737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:42:37.340737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:42:37.340737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:42:37.340737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:42:37.340737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 67/125] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:42:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:42:37.341348 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65910815-966c-4146-bf0c-ed238e3e29dc None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:37.364747 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92736de-4009-4d2e-97af-d3cf62aa4d06 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:37.370071 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:37.402368 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039bf2bf-3269-4893-8cc5-e61d20c0f4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:37.403363 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bf2bf-3269-4893-8cc5-e61d20c0f4e5 None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:37.403949 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bf2bf-3269-4893-8cc5-e61d20c0f4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:37.404316 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bf2bf-3269-4893-8cc5-e61d20c0f4e5 None admin] PATH_INFO: `/v3/projects/3811ac7a7eab4e3e9040f45371523192/users/d0887b5131454893aad43e5ea46999bb/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:37.406190 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039bf2bf-3269-4893-8cc5-e61d20c0f4e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=3811ac7a7eab4e3e9040f45371523192, user_id=d0887b5131454893aad43e5ea46999bb, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:37.407712 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039bf2bf-3269-4893-8cc5-e61d20c0f4e5 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:37.425881 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 59/126] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 4 05:42:37 2022] PUT /identity/v3/projects/3811ac7a7eab4e3e9040f45371523192/users/d0887b5131454893aad43e5ea46999bb/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:42:37.426505 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039bf2bf-3269-4893-8cc5-e61d20c0f4e5 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:37.469786 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65910815-966c-4146-bf0c-ed238e3e29dc None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:37.528826 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea87c8e-2ed4-4125-942a-a35bb935c293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:37.529511 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea87c8e-2ed4-4125-942a-a35bb935c293 None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:37.529840 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea87c8e-2ed4-4125-942a-a35bb935c293 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:37.530163 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea87c8e-2ed4-4125-942a-a35bb935c293 None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:37.530886 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea87c8e-2ed4-4125-942a-a35bb935c293 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:37.532433 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea87c8e-2ed4-4125-942a-a35bb935c293 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:37.538402 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:37.556882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039bf2bf-3269-4893-8cc5-e61d20c0f4e5 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:37.564996 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 68/127] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 4 05:42:37 2022] POST /identity/v3/projects => generated 302 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:42:37.566275 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea87c8e-2ed4-4125-942a-a35bb935c293 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:37.595194 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5452b21-9db7-47fc-8102-0a2f140b2753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:37.596114 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5452b21-9db7-47fc-8102-0a2f140b2753 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:37.596369 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5452b21-9db7-47fc-8102-0a2f140b2753 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:37.596724 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5452b21-9db7-47fc-8102-0a2f140b2753 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:37.597901 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5452b21-9db7-47fc-8102-0a2f140b2753 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:37.597901 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5452b21-9db7-47fc-8102-0a2f140b2753 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:37.599457 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5452b21-9db7-47fc-8102-0a2f140b2753 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:37.609074 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 60/128] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:42:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:37.609986 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5452b21-9db7-47fc-8102-0a2f140b2753 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:37.667057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:37.694867 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea87c8e-2ed4-4125-942a-a35bb935c293 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:37.725728 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5452b21-9db7-47fc-8102-0a2f140b2753 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:37.735541 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f99c37-b17e-4d75-a81b-d1b1bd6086b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:37.736957 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f99c37-b17e-4d75-a81b-d1b1bd6086b9 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:37.737419 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f99c37-b17e-4d75-a81b-d1b1bd6086b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:37.737866 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f99c37-b17e-4d75-a81b-d1b1bd6086b9 None admin] PATH_INFO: `/v3/projects/3811ac7a7eab4e3e9040f45371523192` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:37.739413 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f99c37-b17e-4d75-a81b-d1b1bd6086b9 None admin] RBAC: Authorizing `identity:get_project(project_id=3811ac7a7eab4e3e9040f45371523192)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:37.741405 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f99c37-b17e-4d75-a81b-d1b1bd6086b9 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:37.743650 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 69/129] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:42:37 2022] GET /identity/v3/projects/3811ac7a7eab4e3e9040f45371523192 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:37.744623 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f99c37-b17e-4d75-a81b-d1b1bd6086b9 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:37.763921 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3872c8-c6a0-4db9-8e50-200e5f41c188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:37.764592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3872c8-c6a0-4db9-8e50-200e5f41c188 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:37.764864 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3872c8-c6a0-4db9-8e50-200e5f41c188 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:37.765140 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3872c8-c6a0-4db9-8e50-200e5f41c188 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:37.765901 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3872c8-c6a0-4db9-8e50-200e5f41c188 None admin] RBAC: Adding query filter params (name=member) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:37.766212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3872c8-c6a0-4db9-8e50-200e5f41c188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:37.767677 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3872c8-c6a0-4db9-8e50-200e5f41c188 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:37.777289 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 61/130] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 4 05:42:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:37.778092 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3872c8-c6a0-4db9-8e50-200e5f41c188 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:37.797780 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:37.864149 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f99c37-b17e-4d75-a81b-d1b1bd6086b9 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:37.892902 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3872c8-c6a0-4db9-8e50-200e5f41c188 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:37.909577 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63940b77-7e93-40f9-b816-ac6507dd38d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:37.910589 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63940b77-7e93-40f9-b816-ac6507dd38d3 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:37.910876 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63940b77-7e93-40f9-b816-ac6507dd38d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:37.911416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63940b77-7e93-40f9-b816-ac6507dd38d3 None admin] PATH_INFO: `/v3/users/915c0bffe1874fe6a9640f49dbeefe61` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:37.912641 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63940b77-7e93-40f9-b816-ac6507dd38d3 None admin] RBAC: Authorizing `identity:get_user(user_id=915c0bffe1874fe6a9640f49dbeefe61)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:37.914482 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63940b77-7e93-40f9-b816-ac6507dd38d3 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:37.916789 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 70/131] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:42:37 2022] GET /identity/v3/users/915c0bffe1874fe6a9640f49dbeefe61 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:37.917625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63940b77-7e93-40f9-b816-ac6507dd38d3 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:37.936961 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:37.938213 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04af54-5a15-48f0-bdd2-b0dadaafdc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:37.938890 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04af54-5a15-48f0-bdd2-b0dadaafdc2c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:37.939196 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04af54-5a15-48f0-bdd2-b0dadaafdc2c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:37.939524 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04af54-5a15-48f0-bdd2-b0dadaafdc2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:37.940371 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a04af54-5a15-48f0-bdd2-b0dadaafdc2c None admin] RBAC: Adding query filter params (role.id=5357c224d018422198be89d0268ef167, scope.project.id=3811ac7a7eab4e3e9040f45371523192, user.id=a3b4eaed8e51411aba85f0da253e9123) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:37.940686 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a04af54-5a15-48f0-bdd2-b0dadaafdc2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:37.942389 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a04af54-5a15-48f0-bdd2-b0dadaafdc2c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:37.948914 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 62/132] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:42:37 2022] GET /identity/v3/role_assignments?user.id=a3b4eaed8e51411aba85f0da253e9123&scope.project.id=3811ac7a7eab4e3e9040f45371523192&role.id=5357c224d018422198be89d0268ef167 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:37.949741 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04af54-5a15-48f0-bdd2-b0dadaafdc2c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:38.104678 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63940b77-7e93-40f9-b816-ac6507dd38d3 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:38.123426 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:38.181118 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e920c9b-f49a-4a7c-ae4d-6d521c6d4635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:38.181957 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e920c9b-f49a-4a7c-ae4d-6d521c6d4635 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:38.182245 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e920c9b-f49a-4a7c-ae4d-6d521c6d4635 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:38.182524 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e920c9b-f49a-4a7c-ae4d-6d521c6d4635 None admin] PATH_INFO: `/v3/users/915c0bffe1874fe6a9640f49dbeefe61` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:38.183785 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e920c9b-f49a-4a7c-ae4d-6d521c6d4635 None admin] RBAC: Authorizing `identity:get_user(user_id=915c0bffe1874fe6a9640f49dbeefe61)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:38.185269 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e920c9b-f49a-4a7c-ae4d-6d521c6d4635 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:38.187000 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 71/133] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:42:37 2022] GET /identity/v3/users/915c0bffe1874fe6a9640f49dbeefe61 => generated 275 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:38.192779 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e920c9b-f49a-4a7c-ae4d-6d521c6d4635 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:38.193304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04af54-5a15-48f0-bdd2-b0dadaafdc2c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:38.269713 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3f883-2645-4fbc-954c-b1f90904aca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:38.270604 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3f883-2645-4fbc-954c-b1f90904aca1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:38.270894 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3f883-2645-4fbc-954c-b1f90904aca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:38.271174 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3f883-2645-4fbc-954c-b1f90904aca1 None admin] PATH_INFO: `/v3/projects/3811ac7a7eab4e3e9040f45371523192` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:38.273139 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3f883-2645-4fbc-954c-b1f90904aca1 None admin] RBAC: Authorizing `identity:get_project(project_id=3811ac7a7eab4e3e9040f45371523192)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:38.279022 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3f883-2645-4fbc-954c-b1f90904aca1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:38.282836 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 63/134] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:42:37 2022] GET /identity/v3/projects/3811ac7a7eab4e3e9040f45371523192 => generated 298 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:38.286455 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3f883-2645-4fbc-954c-b1f90904aca1 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:38.290127 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:38.319205 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e920c9b-f49a-4a7c-ae4d-6d521c6d4635 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:38.379880 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de91ece-1ab0-4ed2-b50e-00965c39516c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:38.381136 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de91ece-1ab0-4ed2-b50e-00965c39516c None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:38.381629 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de91ece-1ab0-4ed2-b50e-00965c39516c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:38.382122 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de91ece-1ab0-4ed2-b50e-00965c39516c None admin] PATH_INFO: `/v3/projects/8e58ab5bf94d4ca4a78407548c068fb6` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:38.383627 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de91ece-1ab0-4ed2-b50e-00965c39516c None admin] RBAC: Authorizing `identity:get_project(project_id=8e58ab5bf94d4ca4a78407548c068fb6)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:38.385341 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de91ece-1ab0-4ed2-b50e-00965c39516c None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:38.387320 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 72/135] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:42:38 2022] GET /identity/v3/projects/8e58ab5bf94d4ca4a78407548c068fb6 => generated 312 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:42:38.396164 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de91ece-1ab0-4ed2-b50e-00965c39516c None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:38.398306 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3f883-2645-4fbc-954c-b1f90904aca1 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:38.434971 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211d139-3879-4293-b62f-9947d98c0d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:38.436152 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211d139-3879-4293-b62f-9947d98c0d11 None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:38.436494 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211d139-3879-4293-b62f-9947d98c0d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:38.436778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211d139-3879-4293-b62f-9947d98c0d11 None admin] PATH_INFO: `/v3/projects/3811ac7a7eab4e3e9040f45371523192/users/915c0bffe1874fe6a9640f49dbeefe61/roles/91c119444803497dafe274cc66f05208` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:38.439634 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211d139-3879-4293-b62f-9947d98c0d11 None admin] RBAC: Authorizing `identity:create_grant(project_id=3811ac7a7eab4e3e9040f45371523192, user_id=915c0bffe1874fe6a9640f49dbeefe61, role_id=91c119444803497dafe274cc66f05208)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:38.441321 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211d139-3879-4293-b62f-9947d98c0d11 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:38.458809 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 64/136] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 4 05:42:38 2022] PUT /identity/v3/projects/3811ac7a7eab4e3e9040f45371523192/users/915c0bffe1874fe6a9640f49dbeefe61/roles/91c119444803497dafe274cc66f05208 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:42:38.579654 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de91ece-1ab0-4ed2-b50e-00965c39516c None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:38.635065 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b1e0d-f9bc-4c32-9d5d-5224c10745b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:38.636021 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b1e0d-f9bc-4c32-9d5d-5224c10745b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:38.636312 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b1e0d-f9bc-4c32-9d5d-5224c10745b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:38.636591 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b1e0d-f9bc-4c32-9d5d-5224c10745b7 None admin] PATH_INFO: `/v3/projects/8e58ab5bf94d4ca4a78407548c068fb6/users/915c0bffe1874fe6a9640f49dbeefe61/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:38.638610 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443b1e0d-f9bc-4c32-9d5d-5224c10745b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e58ab5bf94d4ca4a78407548c068fb6, user_id=915c0bffe1874fe6a9640f49dbeefe61, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:38.640167 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443b1e0d-f9bc-4c32-9d5d-5224c10745b7 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:38.659074 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 73/137] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 4 05:42:38 2022] PUT /identity/v3/projects/8e58ab5bf94d4ca4a78407548c068fb6/users/915c0bffe1874fe6a9640f49dbeefe61/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 05:42:39.343152 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dc2cc-2746-43ed-a712-4afbee138a56 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:39.343496 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dc2cc-2746-43ed-a712-4afbee138a56 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:39.343739 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dc2cc-2746-43ed-a712-4afbee138a56 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:39.345402 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 65/138] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:39.352518 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4515e-487a-4351-ba58-aa43bfa2ffa6 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:39.352984 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4515e-487a-4351-ba58-aa43bfa2ffa6 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:39.353175 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4515e-487a-4351-ba58-aa43bfa2ffa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:39.370354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d2f4515e-487a-4351-ba58-aa43bfa2ffa6 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:39.371582 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d2f4515e-487a-4351-ba58-aa43bfa2ffa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:39.374812 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:39.441370 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 74/139] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:39.464720 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631dc2cc-2746-43ed-a712-4afbee138a56 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:39.468717 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:39.573755 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631dc2cc-2746-43ed-a712-4afbee138a56 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:39.608215 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193736b-99f1-491c-b143-02d5178d37b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:39.608943 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193736b-99f1-491c-b143-02d5178d37b5 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:39.609231 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193736b-99f1-491c-b143-02d5178d37b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:39.609512 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193736b-99f1-491c-b143-02d5178d37b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:39.624926 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4193736b-99f1-491c-b143-02d5178d37b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:42:39.632774 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-4193736b-99f1-491c-b143-02d5178d37b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:42:39.632774 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:39.632774 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:39.632774 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:39.632774 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:39.632774 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:39.632774 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:39.632774 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:39.632774 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:39.632774 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:39.632774 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:39.632774 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:39.632774 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:42:39.632774 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:42:39.632774 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:42:39.632774 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:42:39.633638 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:42:39.633638 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:42:39.633638 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:42:39.633638 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:42:39.633638 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:39.633638 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:39.633638 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:39.633638 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:39.633638 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:39.633638 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:39.633638 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:39.633638 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:39.633638 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:39.633638 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:39.633638 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:39.633638 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:39.634412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:39.634412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:39.634412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:39.634412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:39.634412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:42:39.634412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:42:39.634412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:42:39.634412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:42:39.634412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:42:39.634412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:42:39.634412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:42:39.634412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:42:39.634412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 66/140] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:42:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:42:39.644303 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4515e-487a-4351-ba58-aa43bfa2ffa6 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:39.773102 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4515e-487a-4351-ba58-aa43bfa2ffa6 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:39.807525 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39712e-036a-44d7-88c4-82c49eb20e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:39.808475 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39712e-036a-44d7-88c4-82c49eb20e63 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:39.808910 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39712e-036a-44d7-88c4-82c49eb20e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:39.809337 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39712e-036a-44d7-88c4-82c49eb20e63 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:39.810244 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c39712e-036a-44d7-88c4-82c49eb20e63 None admin] RBAC: Adding query filter params (name=member) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:39.810700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c39712e-036a-44d7-88c4-82c49eb20e63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:39.812329 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c39712e-036a-44d7-88c4-82c49eb20e63 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:39.821313 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 75/141] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 4 05:42:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:39.832305 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193736b-99f1-491c-b143-02d5178d37b5 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:39.941312 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:39.991424 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193736b-99f1-491c-b143-02d5178d37b5 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:40.044800 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26eb7c5-3add-49d9-9b15-2b51e94d1633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:40.045736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26eb7c5-3add-49d9-9b15-2b51e94d1633 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:40.046033 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26eb7c5-3add-49d9-9b15-2b51e94d1633 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:40.046316 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26eb7c5-3add-49d9-9b15-2b51e94d1633 None admin] PATH_INFO: `/v3/users/915c0bffe1874fe6a9640f49dbeefe61` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:40.047561 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26eb7c5-3add-49d9-9b15-2b51e94d1633 None admin] RBAC: Authorizing `identity:get_user(user_id=915c0bffe1874fe6a9640f49dbeefe61)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:40.049038 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26eb7c5-3add-49d9-9b15-2b51e94d1633 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:40.050701 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 67/142] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:42:39 2022] GET /identity/v3/users/915c0bffe1874fe6a9640f49dbeefe61 => generated 275 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:40.056735 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39712e-036a-44d7-88c4-82c49eb20e63 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:40.059410 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:40.196285 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39712e-036a-44d7-88c4-82c49eb20e63 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:40.230214 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c3a74f-775d-4e2a-8a32-e3ffe1b92fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:40.230880 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3a74f-775d-4e2a-8a32-e3ffe1b92fef None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:40.231164 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3a74f-775d-4e2a-8a32-e3ffe1b92fef None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:40.231471 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3a74f-775d-4e2a-8a32-e3ffe1b92fef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:40.305240 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c3a74f-775d-4e2a-8a32-e3ffe1b92fef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:40.306725 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c3a74f-775d-4e2a-8a32-e3ffe1b92fef None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:40.311564 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:40.410806 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 76/143] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:42:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 05:42:40.416306 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26eb7c5-3add-49d9-9b15-2b51e94d1633 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:40.572454 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26eb7c5-3add-49d9-9b15-2b51e94d1633 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:40.611172 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:40.622239 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2af444-b0b1-4709-83ae-900748be2b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:40.623165 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2af444-b0b1-4709-83ae-900748be2b67 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:40.623535 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2af444-b0b1-4709-83ae-900748be2b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:40.623823 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2af444-b0b1-4709-83ae-900748be2b67 None admin] PATH_INFO: `/v3/projects/3811ac7a7eab4e3e9040f45371523192` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:40.625672 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2af444-b0b1-4709-83ae-900748be2b67 None admin] RBAC: Authorizing `identity:get_project(project_id=3811ac7a7eab4e3e9040f45371523192)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:40.629793 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2af444-b0b1-4709-83ae-900748be2b67 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:40.632928 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 68/144] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:42:40 2022] GET /identity/v3/projects/3811ac7a7eab4e3e9040f45371523192 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:40.638663 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c3a74f-775d-4e2a-8a32-e3ffe1b92fef None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:40.756267 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c3a74f-775d-4e2a-8a32-e3ffe1b92fef None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:40.757803 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:40.804887 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3152253-5d5f-4348-9641-c8ca39dc2342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:40.805472 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3152253-5d5f-4348-9641-c8ca39dc2342 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:40.805756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3152253-5d5f-4348-9641-c8ca39dc2342 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:40.806035 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3152253-5d5f-4348-9641-c8ca39dc2342 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:40.806876 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3152253-5d5f-4348-9641-c8ca39dc2342 None admin] RBAC: Adding query filter params (role.id=9fdc0a5e493c44c9add5859af9d4f394, scope.project.id=3811ac7a7eab4e3e9040f45371523192, user.id=915c0bffe1874fe6a9640f49dbeefe61) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:40.807221 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3152253-5d5f-4348-9641-c8ca39dc2342 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:40.808683 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3152253-5d5f-4348-9641-c8ca39dc2342 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:40.815278 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 77/145] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:42:40 2022] GET /identity/v3/role_assignments?user.id=915c0bffe1874fe6a9640f49dbeefe61&scope.project.id=3811ac7a7eab4e3e9040f45371523192&role.id=9fdc0a5e493c44c9add5859af9d4f394 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:40.844124 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1fdfe-a833-4080-bd33-1e703448068c None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:40.844451 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1fdfe-a833-4080-bd33-1e703448068c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:40.844687 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1fdfe-a833-4080-bd33-1e703448068c None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:40.846346 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 69/146] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:40.851934 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afac2a5-1922-4ae8-a5da-f3c621a29c06 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:40.852222 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afac2a5-1922-4ae8-a5da-f3c621a29c06 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:40.852498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afac2a5-1922-4ae8-a5da-f3c621a29c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:40.858189 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5329ed3-ae2f-46bb-a649-716bfe464481 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:40.858511 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5329ed3-ae2f-46bb-a649-716bfe464481 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:40.858748 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5329ed3-ae2f-46bb-a649-716bfe464481 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:40.860568 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 70/147] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:40.865678 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05ebf3-4f90-4c88-b28e-b63ff86d4a2a None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:40.865983 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05ebf3-4f90-4c88-b28e-b63ff86d4a2a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:40.866245 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05ebf3-4f90-4c88-b28e-b63ff86d4a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:40.904077 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-2afac2a5-1922-4ae8-a5da-f3c621a29c06 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:40.905370 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-2afac2a5-1922-4ae8-a5da-f3c621a29c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:40.906949 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-ce05ebf3-4f90-4c88-b28e-b63ff86d4a2a None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:40.908169 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ce05ebf3-4f90-4c88-b28e-b63ff86d4a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:41.017563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 78/148] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:41.071757 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afac2a5-1922-4ae8-a5da-f3c621a29c06 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:41.080436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 71/149] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 05:42:41.104851 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05ebf3-4f90-4c88-b28e-b63ff86d4a2a None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:41.257872 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:41.269901 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afac2a5-1922-4ae8-a5da-f3c621a29c06 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:41.279843 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05ebf3-4f90-4c88-b28e-b63ff86d4a2a None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:41.316413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:41.318145 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6691d72-fb61-4746-a5c5-0e1124e5932c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:41.319525 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6691d72-fb61-4746-a5c5-0e1124e5932c None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:41.320647 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6691d72-fb61-4746-a5c5-0e1124e5932c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:41.320647 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6691d72-fb61-4746-a5c5-0e1124e5932c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:41.322224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6691d72-fb61-4746-a5c5-0e1124e5932c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:41.324270 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9e5f5-26f9-4efa-b3a5-2f6984394b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:41.324774 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6691d72-fb61-4746-a5c5-0e1124e5932c None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:41.325664 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9e5f5-26f9-4efa-b3a5-2f6984394b44 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:41.326037 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9e5f5-26f9-4efa-b3a5-2f6984394b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:41.326423 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9e5f5-26f9-4efa-b3a5-2f6984394b44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:41.327593 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 79/150] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:42:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:42:41.331364 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2898e7-8891-478d-bb28-921e847e5de7 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:41.331364 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2898e7-8891-478d-bb28-921e847e5de7 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:41.331364 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2898e7-8891-478d-bb28-921e847e5de7 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:41.331755 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 80/151] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:41.336180 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2898e7-8891-478d-bb28-921e847e5de7 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:41.349634 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9e5f5-26f9-4efa-b3a5-2f6984394b44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:42:41.360834 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-6db9e5f5-26f9-4efa-b3a5-2f6984394b44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:42:41.360834 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:41.360834 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:41.360834 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:41.360834 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:41.360834 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:41.360834 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:41.360834 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:41.360834 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:41.360834 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:41.360834 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:41.360834 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:41.360834 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:42:41.360834 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:42:41.360834 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:42:41.360834 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:42:41.361714 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:42:41.361714 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:42:41.361714 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:42:41.361714 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:42:41.361714 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:41.361714 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:41.361714 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:41.361714 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:41.361714 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:41.361714 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:41.361714 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:41.361714 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:41.361714 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:41.361714 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:41.361714 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:41.361714 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:41.362480 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:41.362480 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:41.362480 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:41.362480 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:41.362480 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:42:41.362480 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:42:41.362480 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:42:41.362480 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:42:41.362480 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:42:41.362480 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:42:41.362480 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:42:41.362480 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:42:41.370378 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 72/152] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:42:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:42:41.372014 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297777c-96a7-45f3-b164-febe9bd597c0 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:41.372521 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297777c-96a7-45f3-b164-febe9bd597c0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:41.373001 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297777c-96a7-45f3-b164-febe9bd597c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:41.397083 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-f297777c-96a7-45f3-b164-febe9bd597c0 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:41.398607 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f297777c-96a7-45f3-b164-febe9bd597c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:41.473614 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 73/153] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:41.474865 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297777c-96a7-45f3-b164-febe9bd597c0 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:41.479571 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2898e7-8891-478d-bb28-921e847e5de7 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:41.522484 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ebf373-7fe7-4ea7-b957-c337a96357c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:41.523163 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebf373-7fe7-4ea7-b957-c337a96357c5 None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:41.523467 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebf373-7fe7-4ea7-b957-c337a96357c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:41.523741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebf373-7fe7-4ea7-b957-c337a96357c5 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:41.524452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ebf373-7fe7-4ea7-b957-c337a96357c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:41.526034 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ebf373-7fe7-4ea7-b957-c337a96357c5 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:41.555208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 81/154] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 4 05:42:41 2022] POST /identity/v3/users => generated 283 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:42:41.555208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9ffa4-8ddc-4e4c-ad5f-afb111d6a209 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:41.555208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9ffa4-8ddc-4e4c-ad5f-afb111d6a209 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:41.555208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9ffa4-8ddc-4e4c-ad5f-afb111d6a209 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:41.555208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 82/155] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:41.555208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9ffa4-8ddc-4e4c-ad5f-afb111d6a209 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:41.579994 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:41.606976 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297777c-96a7-45f3-b164-febe9bd597c0 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:41.638187 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:41.658537 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605ad7e-5707-4994-b561-4c5abc9289e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:41.659652 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605ad7e-5707-4994-b561-4c5abc9289e3 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:41.660009 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605ad7e-5707-4994-b561-4c5abc9289e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:41.660373 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605ad7e-5707-4994-b561-4c5abc9289e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:41.661491 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605ad7e-5707-4994-b561-4c5abc9289e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:41.662366 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605ad7e-5707-4994-b561-4c5abc9289e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:41.664457 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605ad7e-5707-4994-b561-4c5abc9289e3 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:41.675324 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 74/156] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:42:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:41.676725 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48aaaef-158b-41f9-bb62-ccfa635266c5 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:41.677074 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48aaaef-158b-41f9-bb62-ccfa635266c5 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:41.677413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48aaaef-158b-41f9-bb62-ccfa635266c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:41.680389 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9ffa4-8ddc-4e4c-ad5f-afb111d6a209 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:41.699872 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-e48aaaef-158b-41f9-bb62-ccfa635266c5 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:41.702096 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e48aaaef-158b-41f9-bb62-ccfa635266c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:41.718978 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904b817-df31-4011-b3a9-cea2f99a85ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:41.719919 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904b817-df31-4011-b3a9-cea2f99a85ea None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:41.720262 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904b817-df31-4011-b3a9-cea2f99a85ea None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:41.720598 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904b817-df31-4011-b3a9-cea2f99a85ea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:41.732588 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904b817-df31-4011-b3a9-cea2f99a85ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:42:41.741541 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-b904b817-df31-4011-b3a9-cea2f99a85ea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 05:42:41.741541 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:41.741541 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:41.741541 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:41.741541 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:41.741541 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:41.741541 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:41.741541 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:41.741541 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:41.741541 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:41.741541 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:41.741541 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:41.741541 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:42:41.741541 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:42:41.741541 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:42:41.741541 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:42:41.742599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:42:41.742599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:42:41.742599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:42:41.742599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:42:41.742599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:41.742599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:41.742599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:41.742599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:41.742599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:41.742599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:41.742599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:41.742599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:41.742599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:41.742599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:41.742599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:41.742599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:41.743507 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:41.743507 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:41.743507 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:41.743507 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:41.743507 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:42:41.743507 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:42:41.743507 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:42:41.743507 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:42:41.743507 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:42:41.743507 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:42:41.743507 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 05:42:41.743507 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:42:41.743507 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 83/157] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:42:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:42:41.744164 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904b817-df31-4011-b3a9-cea2f99a85ea None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:41.791982 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 75/158] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:41.792886 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48aaaef-158b-41f9-bb62-ccfa635266c5 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:41.851369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:41.869294 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904b817-df31-4011-b3a9-cea2f99a85ea None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:41.912946 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dca781-a0be-48de-800b-8a882b76f115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:41.914402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dca781-a0be-48de-800b-8a882b76f115 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:41.914829 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dca781-a0be-48de-800b-8a882b76f115 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:41.915259 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dca781-a0be-48de-800b-8a882b76f115 None admin] PATH_INFO: `/v3/users/d0887b5131454893aad43e5ea46999bb` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:41.916649 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dca781-a0be-48de-800b-8a882b76f115 None admin] RBAC: Authorizing `identity:get_user(user_id=d0887b5131454893aad43e5ea46999bb)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:41.918728 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dca781-a0be-48de-800b-8a882b76f115 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:41.921231 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 84/159] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:42:41 2022] GET /identity/v3/users/d0887b5131454893aad43e5ea46999bb => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:41.922061 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dca781-a0be-48de-800b-8a882b76f115 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:41.923155 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48aaaef-158b-41f9-bb62-ccfa635266c5 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:41.939584 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:41.964880 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe86d16-f626-4f17-ae8a-67b4e5f60b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:41.965565 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe86d16-f626-4f17-ae8a-67b4e5f60b2d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:41.965845 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe86d16-f626-4f17-ae8a-67b4e5f60b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:41.966113 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe86d16-f626-4f17-ae8a-67b4e5f60b2d None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:41.966870 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe86d16-f626-4f17-ae8a-67b4e5f60b2d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:41.967289 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe86d16-f626-4f17-ae8a-67b4e5f60b2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:41.968691 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe86d16-f626-4f17-ae8a-67b4e5f60b2d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:41.983941 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 76/160] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 4 05:42:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:41.985351 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a4d17-a41d-4843-aea6-f2c879ec4ef9 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:41.985619 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a4d17-a41d-4843-aea6-f2c879ec4ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:41.985895 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a4d17-a41d-4843-aea6-f2c879ec4ef9 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:41.992513 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 77/161] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:41.993346 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a4d17-a41d-4843-aea6-f2c879ec4ef9 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:42.050759 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dca781-a0be-48de-800b-8a882b76f115 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:42.095026 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632f9be-7015-4eeb-bcad-c0bcfa5d085b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:42.095919 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632f9be-7015-4eeb-bcad-c0bcfa5d085b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:42.096207 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632f9be-7015-4eeb-bcad-c0bcfa5d085b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:42.096486 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632f9be-7015-4eeb-bcad-c0bcfa5d085b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:42.112232 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632f9be-7015-4eeb-bcad-c0bcfa5d085b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:42:42.122530 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-a632f9be-7015-4eeb-bcad-c0bcfa5d085b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:42:42.122530 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:42.122530 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:42.122530 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:42.122530 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:42.122530 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:42.122530 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:42.122530 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:42.122530 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:42.122530 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:42.122530 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:42.122530 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:42.122530 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:42:42.122530 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:42:42.122530 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:42:42.122530 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:42:42.123639 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:42:42.123639 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:42:42.123639 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:42:42.123639 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:42:42.123639 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:42.123639 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:42.123639 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:42.123639 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:42.123639 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:42.123639 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:42.123639 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:42.123639 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:42.123639 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:42.123639 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:42.123639 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:42.123639 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:42.124712 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:42.124712 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:42.124712 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:42.124712 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:42.124712 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:42:42.124712 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:42:42.124712 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:42:42.124712 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:42:42.124712 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:42:42.124712 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:42:42.124712 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:42:42.124712 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:42:42.124712 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 85/162] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:42:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:42:42.125354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632f9be-7015-4eeb-bcad-c0bcfa5d085b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:42.131653 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a4d17-a41d-4843-aea6-f2c879ec4ef9 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:42.137444 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:42.167896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8b9e9-8786-42bf-b525-bc1f2d04180e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:42.168374 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8b9e9-8786-42bf-b525-bc1f2d04180e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:42.168751 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8b9e9-8786-42bf-b525-bc1f2d04180e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:42.169170 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8b9e9-8786-42bf-b525-bc1f2d04180e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:42.225028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:42.230954 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632f9be-7015-4eeb-bcad-c0bcfa5d085b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:42.255447 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8b9e9-8786-42bf-b525-bc1f2d04180e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:42.257518 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8b9e9-8786-42bf-b525-bc1f2d04180e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:42.276164 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c1a9e-721e-4e0a-8a58-0a706f91a12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:42.277847 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c1a9e-721e-4e0a-8a58-0a706f91a12a None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:42.278244 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c1a9e-721e-4e0a-8a58-0a706f91a12a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:42.278618 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c1a9e-721e-4e0a-8a58-0a706f91a12a None admin] PATH_INFO: `/v3/users/a3b4eaed8e51411aba85f0da253e9123` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:42.280198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c1a9e-721e-4e0a-8a58-0a706f91a12a None admin] RBAC: Authorizing `identity:get_user(user_id=a3b4eaed8e51411aba85f0da253e9123)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:42.282080 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c1a9e-721e-4e0a-8a58-0a706f91a12a None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:42.285224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 86/163] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:42:42 2022] GET /identity/v3/users/a3b4eaed8e51411aba85f0da253e9123 => generated 289 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:42.285701 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794ce23-1d57-476a-9ba0-7ef85825e14d None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:42.286078 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794ce23-1d57-476a-9ba0-7ef85825e14d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:42.286452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794ce23-1d57-476a-9ba0-7ef85825e14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:42.306692 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-1794ce23-1d57-476a-9ba0-7ef85825e14d None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:42.310023 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-1794ce23-1d57-476a-9ba0-7ef85825e14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:42.383386 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 78/164] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:42:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 05:42:42.384665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8b9e9-8786-42bf-b525-bc1f2d04180e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:42.393778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 87/165] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:42.394614 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794ce23-1d57-476a-9ba0-7ef85825e14d None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:42.407809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:42.487120 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:42.514520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8b9e9-8786-42bf-b525-bc1f2d04180e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:42.551819 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f13d2-c297-46e6-9dcb-9a7a46755a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:42.552498 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f13d2-c297-46e6-9dcb-9a7a46755a33 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:42.552778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f13d2-c297-46e6-9dcb-9a7a46755a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:42.553049 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f13d2-c297-46e6-9dcb-9a7a46755a33 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:42.553805 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f13d2-c297-46e6-9dcb-9a7a46755a33 None admin] RBAC: Adding query filter params (name=member) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:42.554564 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f13d2-c297-46e6-9dcb-9a7a46755a33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:42.557175 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f13d2-c297-46e6-9dcb-9a7a46755a33 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:42.575420 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 79/166] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 4 05:42:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:42.576101 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f13d2-c297-46e6-9dcb-9a7a46755a33 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:42.653972 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794ce23-1d57-476a-9ba0-7ef85825e14d None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:42.710749 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a06ad9-6224-46c5-9971-2c650e2c0e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:42.711661 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a06ad9-6224-46c5-9971-2c650e2c0e27 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:42.711944 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a06ad9-6224-46c5-9971-2c650e2c0e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:42.712219 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a06ad9-6224-46c5-9971-2c650e2c0e27 None admin] PATH_INFO: `/v3/projects/3811ac7a7eab4e3e9040f45371523192` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:42.717449 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a06ad9-6224-46c5-9971-2c650e2c0e27 None admin] RBAC: Authorizing `identity:get_project(project_id=3811ac7a7eab4e3e9040f45371523192)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:42.718917 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a06ad9-6224-46c5-9971-2c650e2c0e27 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:42.720833 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 88/167] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:42:42 2022] GET /identity/v3/projects/3811ac7a7eab4e3e9040f45371523192 => generated 298 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:42.721426 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a06ad9-6224-46c5-9971-2c650e2c0e27 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:42.785684 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f13d2-c297-46e6-9dcb-9a7a46755a33 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:42.845417 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3ec63-cec4-4545-a045-f77edd56f8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:42.846291 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3ec63-cec4-4545-a045-f77edd56f8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:42.846573 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3ec63-cec4-4545-a045-f77edd56f8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:42.846847 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3ec63-cec4-4545-a045-f77edd56f8e7 None admin] PATH_INFO: `/v3/projects/3811ac7a7eab4e3e9040f45371523192` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:42.848967 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3ec63-cec4-4545-a045-f77edd56f8e7 None admin] RBAC: Authorizing `identity:get_project(project_id=3811ac7a7eab4e3e9040f45371523192)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:42.850432 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3ec63-cec4-4545-a045-f77edd56f8e7 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:42.852334 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 80/168] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:42:42 2022] GET /identity/v3/projects/3811ac7a7eab4e3e9040f45371523192 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:42.857789 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3ec63-cec4-4545-a045-f77edd56f8e7 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:42.867523 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:42.868026 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:42.916065 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a06ad9-6224-46c5-9971-2c650e2c0e27 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:42.970726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067eee08-5019-444a-9d55-624e17c05945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:42.971964 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067eee08-5019-444a-9d55-624e17c05945 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:42.972520 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067eee08-5019-444a-9d55-624e17c05945 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:42.972989 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067eee08-5019-444a-9d55-624e17c05945 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:42.987044 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067eee08-5019-444a-9d55-624e17c05945 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:42:42.995532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-067eee08-5019-444a-9d55-624e17c05945 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 05:42:42.995532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:42.995532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:42.995532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:42.995532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:42.995532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:42.995532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:42.995532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:42.995532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:42.995532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:42.995532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:42.995532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:42.995532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:42:42.995532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:42:42.995532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:42:42.995532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:42:42.996386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:42:42.996386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:42:42.996386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:42:42.996386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:42:42.996386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:42.996386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:42.996386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:42.996386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:42.996386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:42.996386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:42.996386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:42.996386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:42.996386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:42.996386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:42.996386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:42.996386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:42.997171 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:42.997171 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:42.997171 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:42.997171 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:42.997171 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:42:42.997171 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:42:42.997171 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:42:42.997171 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:42:42.997171 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:42:42.997171 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:42:42.997171 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 05:42:42.997171 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:42:42.999953 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 89/169] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 4 05:42:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:42:43.000902 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067eee08-5019-444a-9d55-624e17c05945 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:43.037952 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3ec63-cec4-4545-a045-f77edd56f8e7 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:43.093246 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b4258-a8fa-436c-9225-ba0ca9d4b0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:43.094540 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b4258-a8fa-436c-9225-ba0ca9d4b0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:43.095684 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b4258-a8fa-436c-9225-ba0ca9d4b0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:43.097306 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b4258-a8fa-436c-9225-ba0ca9d4b0f1 None admin] PATH_INFO: `/v3/users/915c0bffe1874fe6a9640f49dbeefe61` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:43.099958 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b4258-a8fa-436c-9225-ba0ca9d4b0f1 None admin] RBAC: Authorizing `identity:get_user(user_id=915c0bffe1874fe6a9640f49dbeefe61)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:43.101647 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b4258-a8fa-436c-9225-ba0ca9d4b0f1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:43.105697 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 81/170] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:42:42 2022] GET /identity/v3/users/915c0bffe1874fe6a9640f49dbeefe61 => generated 275 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:43.116260 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b4258-a8fa-436c-9225-ba0ca9d4b0f1 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:43.153388 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067eee08-5019-444a-9d55-624e17c05945 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:43.191335 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422de0c9-0241-451f-8b88-ad9e610eb3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:43.192730 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422de0c9-0241-451f-8b88-ad9e610eb3fc None admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:43.193288 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422de0c9-0241-451f-8b88-ad9e610eb3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:43.193785 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422de0c9-0241-451f-8b88-ad9e610eb3fc None admin] PATH_INFO: `/v3/projects/3811ac7a7eab4e3e9040f45371523192/users/a3b4eaed8e51411aba85f0da253e9123/roles/5357c224d018422198be89d0268ef167` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:43.196102 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422de0c9-0241-451f-8b88-ad9e610eb3fc None admin] RBAC: Authorizing `identity:create_grant(project_id=3811ac7a7eab4e3e9040f45371523192, user_id=a3b4eaed8e51411aba85f0da253e9123, role_id=5357c224d018422198be89d0268ef167)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:43.197910 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422de0c9-0241-451f-8b88-ad9e610eb3fc None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:43.200461 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:43.214433 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 90/171] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 4 05:42:43 2022] PUT /identity/v3/projects/3811ac7a7eab4e3e9040f45371523192/users/a3b4eaed8e51411aba85f0da253e9123/roles/5357c224d018422198be89d0268ef167 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:42:43.215798 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422de0c9-0241-451f-8b88-ad9e610eb3fc None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:43.274693 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:43.326820 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b4258-a8fa-436c-9225-ba0ca9d4b0f1 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:43.376109 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b8fd3-97b2-4a81-9cf3-5dc80bbbb3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:43.376807 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b8fd3-97b2-4a81-9cf3-5dc80bbbb3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:43.377069 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b8fd3-97b2-4a81-9cf3-5dc80bbbb3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:43.377341 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b8fd3-97b2-4a81-9cf3-5dc80bbbb3d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:43.378474 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b8fd3-97b2-4a81-9cf3-5dc80bbbb3d7 None admin] RBAC: Adding query filter params (role.id=6c5b161dbf33447fa1d383915d3c9382, scope.project.id=3811ac7a7eab4e3e9040f45371523192, user.id=d0887b5131454893aad43e5ea46999bb) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:43.378782 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b8fd3-97b2-4a81-9cf3-5dc80bbbb3d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:43.380307 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b8fd3-97b2-4a81-9cf3-5dc80bbbb3d7 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:43.387206 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 82/172] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:42:43 2022] GET /identity/v3/role_assignments?user.id=d0887b5131454893aad43e5ea46999bb&scope.project.id=3811ac7a7eab4e3e9040f45371523192&role.id=6c5b161dbf33447fa1d383915d3c9382 => generated 608 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:43.387979 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b8fd3-97b2-4a81-9cf3-5dc80bbbb3d7 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:43.523103 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422de0c9-0241-451f-8b88-ad9e610eb3fc None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:43.584854 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b8fd3-97b2-4a81-9cf3-5dc80bbbb3d7 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:43.627951 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe9fae-e1fd-4301-979f-1127a96077eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:43.628728 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe9fae-e1fd-4301-979f-1127a96077eb None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:43.629011 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe9fae-e1fd-4301-979f-1127a96077eb None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:43.629291 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe9fae-e1fd-4301-979f-1127a96077eb None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:43.630067 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe9fae-e1fd-4301-979f-1127a96077eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:43.630369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe9fae-e1fd-4301-979f-1127a96077eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:43.631834 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe9fae-e1fd-4301-979f-1127a96077eb None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:43.643990 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b12c92b-bdff-42b1-8d84-a890f0c7ea21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:43.644669 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b12c92b-bdff-42b1-8d84-a890f0c7ea21 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:43.644950 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b12c92b-bdff-42b1-8d84-a890f0c7ea21 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:43.645222 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b12c92b-bdff-42b1-8d84-a890f0c7ea21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:43.649607 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:43.657501 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 91/173] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:42:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:43.671740 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe9fae-e1fd-4301-979f-1127a96077eb None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:43.744480 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b12c92b-bdff-42b1-8d84-a890f0c7ea21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:43.745980 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b12c92b-bdff-42b1-8d84-a890f0c7ea21 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:43.827510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:43.885237 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 83/174] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:42:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 05:42:43.892176 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b12c92b-bdff-42b1-8d84-a890f0c7ea21 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:43.920386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe9fae-e1fd-4301-979f-1127a96077eb None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:43.949232 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:43.984987 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db438d6f-9368-41d7-b642-f69b3a9e96a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:43.985900 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db438d6f-9368-41d7-b642-f69b3a9e96a1 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:43.986181 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db438d6f-9368-41d7-b642-f69b3a9e96a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:43.986461 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db438d6f-9368-41d7-b642-f69b3a9e96a1 None admin] PATH_INFO: `/v3/users/915c0bffe1874fe6a9640f49dbeefe61` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:43.987695 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db438d6f-9368-41d7-b642-f69b3a9e96a1 None admin] RBAC: Authorizing `identity:get_user(user_id=915c0bffe1874fe6a9640f49dbeefe61)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:43.989170 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db438d6f-9368-41d7-b642-f69b3a9e96a1 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:43.990839 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 92/175] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:42:43 2022] GET /identity/v3/users/915c0bffe1874fe6a9640f49dbeefe61 => generated 275 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:44.004499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db438d6f-9368-41d7-b642-f69b3a9e96a1 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:44.028959 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b12c92b-bdff-42b1-8d84-a890f0c7ea21 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:44.074740 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac4fc5-ad5c-4b0b-9a9c-a31f82a94445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:44.076005 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac4fc5-ad5c-4b0b-9a9c-a31f82a94445 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:44.076589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac4fc5-ad5c-4b0b-9a9c-a31f82a94445 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:44.077110 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac4fc5-ad5c-4b0b-9a9c-a31f82a94445 None admin] PATH_INFO: `/v3/projects/8e58ab5bf94d4ca4a78407548c068fb6` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:44.078616 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac4fc5-ad5c-4b0b-9a9c-a31f82a94445 None admin] RBAC: Authorizing `identity:get_project(project_id=8e58ab5bf94d4ca4a78407548c068fb6)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:44.080373 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac4fc5-ad5c-4b0b-9a9c-a31f82a94445 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:44.082341 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 84/176] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:42:43 2022] GET /identity/v3/projects/8e58ab5bf94d4ca4a78407548c068fb6 => generated 312 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:44.088209 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac4fc5-ad5c-4b0b-9a9c-a31f82a94445 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:44.133246 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db438d6f-9368-41d7-b642-f69b3a9e96a1 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:44.171566 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:44.174068 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782d474-a139-4a90-876f-600f7746ca09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:44.174739 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782d474-a139-4a90-876f-600f7746ca09 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:44.175196 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782d474-a139-4a90-876f-600f7746ca09 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:44.175517 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782d474-a139-4a90-876f-600f7746ca09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:44.220140 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac4fc5-ad5c-4b0b-9a9c-a31f82a94445 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:44.222993 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:44.247513 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d782d474-a139-4a90-876f-600f7746ca09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:44.249361 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d782d474-a139-4a90-876f-600f7746ca09 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:44.271349 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939aaab-9b20-445e-9f2b-c68031763a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:44.272430 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939aaab-9b20-445e-9f2b-c68031763a3c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:44.272913 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939aaab-9b20-445e-9f2b-c68031763a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:44.273426 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939aaab-9b20-445e-9f2b-c68031763a3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:44.274481 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939aaab-9b20-445e-9f2b-c68031763a3c None admin] RBAC: Adding query filter params (role.id=9fdc0a5e493c44c9add5859af9d4f394, scope.project.id=8e58ab5bf94d4ca4a78407548c068fb6, user.id=915c0bffe1874fe6a9640f49dbeefe61) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:44.275043 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939aaab-9b20-445e-9f2b-c68031763a3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:44.276817 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939aaab-9b20-445e-9f2b-c68031763a3c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:44.287799 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 85/177] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:42:44 2022] GET /identity/v3/role_assignments?user.id=915c0bffe1874fe6a9640f49dbeefe61&scope.project.id=8e58ab5bf94d4ca4a78407548c068fb6&role.id=9fdc0a5e493c44c9add5859af9d4f394 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:42:44.360337 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 93/178] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:42:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 05:42:44.366007 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939aaab-9b20-445e-9f2b-c68031763a3c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:44.517463 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939aaab-9b20-445e-9f2b-c68031763a3c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:44.519855 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76362104-bd60-485d-9d81-45f75570b103 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:44.520149 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76362104-bd60-485d-9d81-45f75570b103 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:44.520424 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76362104-bd60-485d-9d81-45f75570b103 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:44.521998 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 94/179] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:44.527449 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e1487-cd60-47b5-bf92-181f428374ad None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:44.528631 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e1487-cd60-47b5-bf92-181f428374ad None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:44.528631 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e1487-cd60-47b5-bf92-181f428374ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:44.551214 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-e52e1487-cd60-47b5-bf92-181f428374ad None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:44.551214 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e52e1487-cd60-47b5-bf92-181f428374ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:44.574868 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:44.575867 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147124e-1750-4764-8eb5-b0daac1b4f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:44.577049 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147124e-1750-4764-8eb5-b0daac1b4f9f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:44.577390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147124e-1750-4764-8eb5-b0daac1b4f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:44.577734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147124e-1750-4764-8eb5-b0daac1b4f9f None admin] PATH_INFO: `/v3/projects/3811ac7a7eab4e3e9040f45371523192` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:44.578968 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147124e-1750-4764-8eb5-b0daac1b4f9f None admin] RBAC: Authorizing `identity:get_project(project_id=3811ac7a7eab4e3e9040f45371523192)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:44.580477 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147124e-1750-4764-8eb5-b0daac1b4f9f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:44.582431 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 86/180] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:42:44 2022] GET /identity/v3/projects/3811ac7a7eab4e3e9040f45371523192 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:44.592263 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147124e-1750-4764-8eb5-b0daac1b4f9f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:44.650875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:44.656113 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 95/181] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:44.658655 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7431c9-6bb4-4a95-84a7-6c2018d8e847 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:44.659481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7431c9-6bb4-4a95-84a7-6c2018d8e847 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:44.659481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7431c9-6bb4-4a95-84a7-6c2018d8e847 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:44.660966 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 96/182] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:44.669214 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677c796-16f2-4638-a880-d9674dcbd294 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:44.669504 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677c796-16f2-4638-a880-d9674dcbd294 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:44.669787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677c796-16f2-4638-a880-d9674dcbd294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:44.695400 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-4677c796-16f2-4638-a880-d9674dcbd294 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:44.697672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-4677c796-16f2-4638-a880-d9674dcbd294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:44.731833 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147124e-1750-4764-8eb5-b0daac1b4f9f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:44.773901 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642b11a-26e1-4e11-a8bd-a411524837d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:44.774563 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642b11a-26e1-4e11-a8bd-a411524837d4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:44.774883 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642b11a-26e1-4e11-a8bd-a411524837d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:44.775159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642b11a-26e1-4e11-a8bd-a411524837d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:44.776039 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642b11a-26e1-4e11-a8bd-a411524837d4 None admin] RBAC: Adding query filter params (role.id=91c119444803497dafe274cc66f05208, scope.project.id=3811ac7a7eab4e3e9040f45371523192, user.id=915c0bffe1874fe6a9640f49dbeefe61) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:44.776348 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642b11a-26e1-4e11-a8bd-a411524837d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:44.777878 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642b11a-26e1-4e11-a8bd-a411524837d4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:44.791699 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 97/183] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:44.792556 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677c796-16f2-4638-a880-d9674dcbd294 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:44.793146 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 87/184] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:42:44 2022] GET /identity/v3/role_assignments?user.id=915c0bffe1874fe6a9640f49dbeefe61&scope.project.id=3811ac7a7eab4e3e9040f45371523192&role.id=91c119444803497dafe274cc66f05208 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:44.834167 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642b11a-26e1-4e11-a8bd-a411524837d4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:44.899558 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:44.924421 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677c796-16f2-4638-a880-d9674dcbd294 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:44.965559 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad064846-309f-44d1-a036-a8b1771389e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:44.966895 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad064846-309f-44d1-a036-a8b1771389e4 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:44.966895 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad064846-309f-44d1-a036-a8b1771389e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:44.967092 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad064846-309f-44d1-a036-a8b1771389e4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:44.979741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad064846-309f-44d1-a036-a8b1771389e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:42:44.988152 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-ad064846-309f-44d1-a036-a8b1771389e4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 05:42:44.988152 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:44.988152 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:44.988152 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:44.988152 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:44.988152 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:44.988152 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:44.988152 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:44.988152 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:44.988152 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:44.988152 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:44.988152 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:44.988152 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:42:44.988152 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:42:44.988152 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:42:44.988152 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:42:44.989165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:42:44.989165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:42:44.989165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:42:44.989165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:42:44.989165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:44.989165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:44.989165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:44.989165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:44.989165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:44.989165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:44.989165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:44.989165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:44.989165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:44.989165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:44.989165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:44.989165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:44.990973 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:44.990973 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:44.990973 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:44.990973 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:44.990973 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:42:44.990973 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:42:44.990973 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:42:44.990973 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:42:44.990973 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:42:44.990973 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:42:44.990973 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 05:42:44.990973 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:42:44.990973 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 98/185] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 4 05:42:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:42:44.990973 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2fdf9-c52b-41be-b54b-24ab43d8eb3e None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:44.991799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2fdf9-c52b-41be-b54b-24ab43d8eb3e None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:44.991799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2fdf9-c52b-41be-b54b-24ab43d8eb3e None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:44.992788 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 99/186] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:44.996238 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2fdf9-c52b-41be-b54b-24ab43d8eb3e None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:45.010443 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:45.016501 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642b11a-26e1-4e11-a8bd-a411524837d4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:45.067007 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f81b4-a7e3-45be-a039-5f3abffd3bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:45.068029 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f81b4-a7e3-45be-a039-5f3abffd3bff None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:45.068390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f81b4-a7e3-45be-a039-5f3abffd3bff None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:45.068698 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f81b4-a7e3-45be-a039-5f3abffd3bff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:45.083855 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f81b4-a7e3-45be-a039-5f3abffd3bff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:42:45.092624 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-196f81b4-a7e3-45be-a039-5f3abffd3bff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:42:45.092624 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:45.092624 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:45.092624 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:45.092624 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:45.092624 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:45.092624 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:45.092624 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:45.092624 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:45.092624 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:45.092624 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:45.092624 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:45.092624 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:42:45.092624 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:42:45.092624 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:42:45.092624 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:42:45.093745 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:42:45.093745 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:42:45.093745 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:42:45.093745 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:42:45.093745 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:45.093745 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:45.093745 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:45.093745 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:45.093745 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:45.093745 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:45.093745 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:45.093745 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:45.093745 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:45.093745 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:45.093745 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:45.093745 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:45.095086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:45.095086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:45.095086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:45.095086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:45.095086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:42:45.095086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:42:45.095086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:42:45.095086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:42:45.095086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:42:45.095086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:42:45.095086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:42:45.095086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:42:45.095086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 88/187] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:42:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:42:45.095086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104b156-3580-4e94-ada0-b0dbdc56f674 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:45.095911 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104b156-3580-4e94-ada0-b0dbdc56f674 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:45.095911 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104b156-3580-4e94-ada0-b0dbdc56f674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:45.112858 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9104b156-3580-4e94-ada0-b0dbdc56f674 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:45.114076 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9104b156-3580-4e94-ada0-b0dbdc56f674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:45.130217 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2fdf9-c52b-41be-b54b-24ab43d8eb3e None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:45.164926 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad998cef-f7b2-47e1-86c3-eb1416a94ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:45.165599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad998cef-f7b2-47e1-86c3-eb1416a94ced None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:45.165881 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad998cef-f7b2-47e1-86c3-eb1416a94ced None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:45.166154 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad998cef-f7b2-47e1-86c3-eb1416a94ced None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:45.166902 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad998cef-f7b2-47e1-86c3-eb1416a94ced None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:45.167228 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad998cef-f7b2-47e1-86c3-eb1416a94ced None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:45.168630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad998cef-f7b2-47e1-86c3-eb1416a94ced None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:45.176922 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 100/188] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:42:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:45.177652 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad998cef-f7b2-47e1-86c3-eb1416a94ced None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:45.187799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:45.196039 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 89/189] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:45.200231 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104b156-3580-4e94-ada0-b0dbdc56f674 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:45.292770 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad998cef-f7b2-47e1-86c3-eb1416a94ced None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:45.295619 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:45.305442 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104b156-3580-4e94-ada0-b0dbdc56f674 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:45.328097 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621c6d5-1fbd-489c-8fb8-5486e5577ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:45.328771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621c6d5-1fbd-489c-8fb8-5486e5577ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:45.329055 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621c6d5-1fbd-489c-8fb8-5486e5577ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:45.329333 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621c6d5-1fbd-489c-8fb8-5486e5577ff9 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:45.330080 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621c6d5-1fbd-489c-8fb8-5486e5577ff9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:45.330383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621c6d5-1fbd-489c-8fb8-5486e5577ff9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:45.331804 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621c6d5-1fbd-489c-8fb8-5486e5577ff9 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:45.340934 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 101/190] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:42:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:45.345627 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca202cf-a362-40bc-8cb1-328c4b430529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:45.345748 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621c6d5-1fbd-489c-8fb8-5486e5577ff9 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:45.345836 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca202cf-a362-40bc-8cb1-328c4b430529 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:45.345836 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca202cf-a362-40bc-8cb1-328c4b430529 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:45.345836 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca202cf-a362-40bc-8cb1-328c4b430529 None admin] PATH_INFO: `/v3/users/350c5b2458914375b8584557c0e288c7` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:45.359979 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca202cf-a362-40bc-8cb1-328c4b430529 None admin] RBAC: Authorizing `identity:get_user(user_id=350c5b2458914375b8584557c0e288c7)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:45.361501 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca202cf-a362-40bc-8cb1-328c4b430529 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:45.363313 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 90/191] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:42:45 2022] GET /identity/v3/users/350c5b2458914375b8584557c0e288c7 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:45.368493 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca202cf-a362-40bc-8cb1-328c4b430529 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:45.412197 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:45.447518 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621c6d5-1fbd-489c-8fb8-5486e5577ff9 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:45.469704 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca202cf-a362-40bc-8cb1-328c4b430529 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:45.482050 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93418c2b-64d6-4716-b3c1-32dc32eebbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:45.483068 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93418c2b-64d6-4716-b3c1-32dc32eebbc4 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:45.483373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93418c2b-64d6-4716-b3c1-32dc32eebbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:45.483647 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93418c2b-64d6-4716-b3c1-32dc32eebbc4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:45.484802 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93418c2b-64d6-4716-b3c1-32dc32eebbc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:45.486264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93418c2b-64d6-4716-b3c1-32dc32eebbc4 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:45.488094 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 102/192] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:42:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:45.493203 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93418c2b-64d6-4716-b3c1-32dc32eebbc4 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:45.504969 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426919b-3392-4749-a3c5-734ed0598e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:45.505844 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426919b-3392-4749-a3c5-734ed0598e35 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:45.506125 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426919b-3392-4749-a3c5-734ed0598e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:45.506399 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426919b-3392-4749-a3c5-734ed0598e35 None admin] PATH_INFO: `/v3/users/350c5b2458914375b8584557c0e288c7` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:45.507612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426919b-3392-4749-a3c5-734ed0598e35 None admin] RBAC: Authorizing `identity:get_user(user_id=350c5b2458914375b8584557c0e288c7)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:45.509070 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426919b-3392-4749-a3c5-734ed0598e35 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:45.515051 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 91/193] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:42:45 2022] GET /identity/v3/users/350c5b2458914375b8584557c0e288c7 => generated 283 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:45.515051 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426919b-3392-4749-a3c5-734ed0598e35 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:45.539813 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:45.603255 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93418c2b-64d6-4716-b3c1-32dc32eebbc4 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:45.626954 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426919b-3392-4749-a3c5-734ed0598e35 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:45.644377 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53115a-c49f-48d6-b6f4-003d800a8b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:45.645040 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53115a-c49f-48d6-b6f4-003d800a8b06 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:45.645320 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53115a-c49f-48d6-b6f4-003d800a8b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:45.645594 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53115a-c49f-48d6-b6f4-003d800a8b06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:45.649060 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:45.662331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ce584-f2ca-4417-a2ba-302d07212b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:45.663075 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ce584-f2ca-4417-a2ba-302d07212b7b None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:45.663336 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ce584-f2ca-4417-a2ba-302d07212b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:45.663605 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ce584-f2ca-4417-a2ba-302d07212b7b None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:45.664312 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ce584-f2ca-4417-a2ba-302d07212b7b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:45.665766 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ce584-f2ca-4417-a2ba-302d07212b7b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:45.703306 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 92/194] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 4 05:42:45 2022] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:42:45.703306 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ce584-f2ca-4417-a2ba-302d07212b7b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:45.734061 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53115a-c49f-48d6-b6f4-003d800a8b06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:45.735594 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53115a-c49f-48d6-b6f4-003d800a8b06 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:45.794567 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:45.837464 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ce584-f2ca-4417-a2ba-302d07212b7b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:45.850778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 103/195] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:42:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 05:42:45.857009 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53115a-c49f-48d6-b6f4-003d800a8b06 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:45.888583 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7124c-8d0d-41a0-8c40-2d468a4f0bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:45.889248 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7124c-8d0d-41a0-8c40-2d468a4f0bbb None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:45.889835 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7124c-8d0d-41a0-8c40-2d468a4f0bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:45.889835 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7124c-8d0d-41a0-8c40-2d468a4f0bbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:45.905340 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:45.972115 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb7124c-8d0d-41a0-8c40-2d468a4f0bbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:45.973570 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb7124c-8d0d-41a0-8c40-2d468a4f0bbb None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:45.990563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53115a-c49f-48d6-b6f4-003d800a8b06 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:46.040536 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98fd8a-01e9-446b-b1ca-0e0a3dff0c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:46.041346 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98fd8a-01e9-446b-b1ca-0e0a3dff0c8e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:46.041633 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98fd8a-01e9-446b-b1ca-0e0a3dff0c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:46.041906 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98fd8a-01e9-446b-b1ca-0e0a3dff0c8e None admin] PATH_INFO: `/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:46.043562 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98fd8a-01e9-446b-b1ca-0e0a3dff0c8e None admin] RBAC: Authorizing `identity:get_project(project_id=e7ac8d54998946acb55e1b10e3a9c30b)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:46.045365 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98fd8a-01e9-446b-b1ca-0e0a3dff0c8e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:46.047334 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 104/196] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:42:45 2022] GET /identity/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:42:46.048630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec85172-ef0e-42a8-8930-2e9a6b049fe9 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:46.048841 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec85172-ef0e-42a8-8930-2e9a6b049fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:46.049114 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec85172-ef0e-42a8-8930-2e9a6b049fe9 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:46.050378 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 105/197] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:46.055635 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:46.057496 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec85172-ef0e-42a8-8930-2e9a6b049fe9 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:46.099538 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 93/198] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:42:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 05:42:46.100841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2a967-a5fc-476c-a022-689e8b3fe814 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:46.101126 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2a967-a5fc-476c-a022-689e8b3fe814 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:46.101404 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2a967-a5fc-476c-a022-689e8b3fe814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:46.125626 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-b1e2a967-a5fc-476c-a022-689e8b3fe814 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:46.128088 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b1e2a967-a5fc-476c-a022-689e8b3fe814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:46.190916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec85172-ef0e-42a8-8930-2e9a6b049fe9 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:46.203534 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:46.212702 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 94/199] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:46.213874 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2a967-a5fc-476c-a022-689e8b3fe814 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:46.248662 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cb0cf-fd4b-4f03-bde5-ac25a5f82e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:46.250269 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cb0cf-fd4b-4f03-bde5-ac25a5f82e61 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:46.250809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cb0cf-fd4b-4f03-bde5-ac25a5f82e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:46.251366 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cb0cf-fd4b-4f03-bde5-ac25a5f82e61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:46.252609 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5cb0cf-fd4b-4f03-bde5-ac25a5f82e61 None admin] RBAC: Adding query filter params (role.id=91c119444803497dafe274cc66f05208, scope.project.id=e7ac8d54998946acb55e1b10e3a9c30b, user.id=350c5b2458914375b8584557c0e288c7) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:46.253183 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5cb0cf-fd4b-4f03-bde5-ac25a5f82e61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:46.255058 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5cb0cf-fd4b-4f03-bde5-ac25a5f82e61 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:46.264369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 106/200] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:42:46 2022] GET /identity/v3/role_assignments?user.id=350c5b2458914375b8584557c0e288c7&scope.project.id=e7ac8d54998946acb55e1b10e3a9c30b&role.id=91c119444803497dafe274cc66f05208 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:46.265746 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cb0cf-fd4b-4f03-bde5-ac25a5f82e61 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:46.338605 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2a967-a5fc-476c-a022-689e8b3fe814 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:46.340366 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:46.413383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57834213-459a-4b48-a383-2cdb0750e7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:46.414280 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57834213-459a-4b48-a383-2cdb0750e7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:46.414563 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57834213-459a-4b48-a383-2cdb0750e7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:46.414838 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57834213-459a-4b48-a383-2cdb0750e7d7 None admin] PATH_INFO: `/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:46.416093 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57834213-459a-4b48-a383-2cdb0750e7d7 None admin] RBAC: Authorizing `identity:get_project(project_id=e7ac8d54998946acb55e1b10e3a9c30b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:46.417790 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57834213-459a-4b48-a383-2cdb0750e7d7 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:46.419584 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 95/201] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:42:46 2022] GET /identity/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:46.429006 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57834213-459a-4b48-a383-2cdb0750e7d7 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:46.463779 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cb0cf-fd4b-4f03-bde5-ac25a5f82e61 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:46.499445 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe598e-2e4a-4e8f-a975-9bb99755e95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:46.500495 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe598e-2e4a-4e8f-a975-9bb99755e95f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:46.500922 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe598e-2e4a-4e8f-a975-9bb99755e95f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:46.501334 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe598e-2e4a-4e8f-a975-9bb99755e95f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:46.512083 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe598e-2e4a-4e8f-a975-9bb99755e95f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:42:46.520123 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-9cbe598e-2e4a-4e8f-a975-9bb99755e95f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 05:42:46.520123 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:46.520123 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:46.520123 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:46.520123 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:46.520123 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:46.520123 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:46.520123 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:46.520123 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:46.520123 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:46.520123 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:46.520123 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:46.520123 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:42:46.520123 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:42:46.520123 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:42:46.520123 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:42:46.521089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:42:46.521089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:42:46.521089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:42:46.521089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:42:46.521089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:46.521089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:46.521089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:46.521089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:46.521089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:46.521089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:46.521089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:46.521089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:46.521089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:46.521089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:46.521089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:46.521089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:46.521852 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:46.521852 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:46.521852 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:46.521852 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:46.521852 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:42:46.521852 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:42:46.521852 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:42:46.521852 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:42:46.521852 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:42:46.521852 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:42:46.521852 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 05:42:46.521852 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:42:46.524278 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 107/202] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:42:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:42:46.536287 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe598e-2e4a-4e8f-a975-9bb99755e95f None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:46.595450 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:46.641085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57834213-459a-4b48-a383-2cdb0750e7d7 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:46.707871 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea95568-fa28-49e3-b07d-e345e7eef485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:46.709164 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea95568-fa28-49e3-b07d-e345e7eef485 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:46.710498 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea95568-fa28-49e3-b07d-e345e7eef485 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:46.712145 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea95568-fa28-49e3-b07d-e345e7eef485 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:46.713211 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea95568-fa28-49e3-b07d-e345e7eef485 None admin] RBAC: Adding query filter params (role.id=6c5b161dbf33447fa1d383915d3c9382, scope.project.id=e7ac8d54998946acb55e1b10e3a9c30b, user.id=350c5b2458914375b8584557c0e288c7) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:46.714898 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea95568-fa28-49e3-b07d-e345e7eef485 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:46.716654 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea95568-fa28-49e3-b07d-e345e7eef485 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:46.720809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe598e-2e4a-4e8f-a975-9bb99755e95f None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:46.729126 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 96/203] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:42:46 2022] GET /identity/v3/role_assignments?user.id=350c5b2458914375b8584557c0e288c7&scope.project.id=e7ac8d54998946acb55e1b10e3a9c30b&role.id=6c5b161dbf33447fa1d383915d3c9382 => generated 259 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:46.770608 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942564d5-f106-495a-8f82-6ac9661a90e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:46.772003 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942564d5-f106-495a-8f82-6ac9661a90e2 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:46.772481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942564d5-f106-495a-8f82-6ac9661a90e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:46.772950 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942564d5-f106-495a-8f82-6ac9661a90e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:46.773921 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942564d5-f106-495a-8f82-6ac9661a90e2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:46.774449 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942564d5-f106-495a-8f82-6ac9661a90e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:46.776121 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942564d5-f106-495a-8f82-6ac9661a90e2 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:46.786193 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 108/204] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 4 05:42:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:46.792543 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea95568-fa28-49e3-b07d-e345e7eef485 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:46.839450 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:46.929912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea95568-fa28-49e3-b07d-e345e7eef485 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:46.966145 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8fa95b-5993-4c65-8264-245e78404b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:46.967403 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fa95b-5993-4c65-8264-245e78404b7c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:46.967882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fa95b-5993-4c65-8264-245e78404b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:46.968349 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fa95b-5993-4c65-8264-245e78404b7c None admin] PATH_INFO: `/v3/users/a3b4eaed8e51411aba85f0da253e9123` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:46.969751 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8fa95b-5993-4c65-8264-245e78404b7c None admin] RBAC: Authorizing `identity:get_user(user_id=a3b4eaed8e51411aba85f0da253e9123)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:46.971433 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8fa95b-5993-4c65-8264-245e78404b7c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:46.981003 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 97/205] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:42:46 2022] GET /identity/v3/users/a3b4eaed8e51411aba85f0da253e9123 => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:46.986802 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942564d5-f106-495a-8f82-6ac9661a90e2 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:47.096987 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:47.110186 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942564d5-f106-495a-8f82-6ac9661a90e2 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:47.145726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af7836-d4d7-453a-a169-ce2a75de59e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:47.146747 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af7836-d4d7-453a-a169-ce2a75de59e4 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:47.147272 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af7836-d4d7-453a-a169-ce2a75de59e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:47.147742 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af7836-d4d7-453a-a169-ce2a75de59e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:47.219675 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af7836-d4d7-453a-a169-ce2a75de59e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:47.221523 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af7836-d4d7-453a-a169-ce2a75de59e4 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:47.314541 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:47.326975 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 109/206] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:42:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 05:42:47.336264 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8fa95b-5993-4c65-8264-245e78404b7c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:47.531841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8fa95b-5993-4c65-8264-245e78404b7c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:47.539515 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:47.593007 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ae9e4-3d82-43c9-8e23-eb34bc653753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:47.594470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ae9e4-3d82-43c9-8e23-eb34bc653753 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:47.594920 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ae9e4-3d82-43c9-8e23-eb34bc653753 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:47.595440 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ae9e4-3d82-43c9-8e23-eb34bc653753 None admin] PATH_INFO: `/v3/projects/3811ac7a7eab4e3e9040f45371523192` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:47.597475 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ae9e4-3d82-43c9-8e23-eb34bc653753 None admin] RBAC: Authorizing `identity:get_project(project_id=3811ac7a7eab4e3e9040f45371523192)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:47.600236 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ae9e4-3d82-43c9-8e23-eb34bc653753 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:47.603749 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 98/207] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:42:47 2022] GET /identity/v3/projects/3811ac7a7eab4e3e9040f45371523192 => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:47.612283 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af7836-d4d7-453a-a169-ce2a75de59e4 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:47.738791 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af7836-d4d7-453a-a169-ce2a75de59e4 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:47.774292 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38d345-fe7a-444a-b3f4-7f64e0a1255a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:47.775034 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38d345-fe7a-444a-b3f4-7f64e0a1255a None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:47.775246 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38d345-fe7a-444a-b3f4-7f64e0a1255a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:47.775523 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38d345-fe7a-444a-b3f4-7f64e0a1255a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:47.776350 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38d345-fe7a-444a-b3f4-7f64e0a1255a None admin] RBAC: Adding query filter params (role.id=5357c224d018422198be89d0268ef167, scope.project.id=3811ac7a7eab4e3e9040f45371523192, user.id=a3b4eaed8e51411aba85f0da253e9123) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:47.776653 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38d345-fe7a-444a-b3f4-7f64e0a1255a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:47.778181 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38d345-fe7a-444a-b3f4-7f64e0a1255a None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:47.784908 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 110/208] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:42:47 2022] GET /identity/v3/role_assignments?user.id=a3b4eaed8e51411aba85f0da253e9123&scope.project.id=3811ac7a7eab4e3e9040f45371523192&role.id=5357c224d018422198be89d0268ef167 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:48.042543 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d764f-ef8c-45bb-9941-f238061de77c None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:48.042955 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d764f-ef8c-45bb-9941-f238061de77c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:48.043367 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d764f-ef8c-45bb-9941-f238061de77c None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:48.045318 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 99/209] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:48.050912 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7406208-4fd9-4cd7-a97f-31d870dc4c57 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:48.051234 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7406208-4fd9-4cd7-a97f-31d870dc4c57 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:48.051497 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7406208-4fd9-4cd7-a97f-31d870dc4c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:48.071237 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-c7406208-4fd9-4cd7-a97f-31d870dc4c57 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:48.072441 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c7406208-4fd9-4cd7-a97f-31d870dc4c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:48.125672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:48.149283 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 111/210] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:48.174722 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d764f-ef8c-45bb-9941-f238061de77c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:48.286881 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d764f-ef8c-45bb-9941-f238061de77c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:48.326005 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7661a99-57ab-4562-9433-06139001303b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:48.326871 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7661a99-57ab-4562-9433-06139001303b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:48.327162 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7661a99-57ab-4562-9433-06139001303b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:48.327495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7661a99-57ab-4562-9433-06139001303b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:48.328674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7661a99-57ab-4562-9433-06139001303b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:48.330147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7661a99-57ab-4562-9433-06139001303b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:48.332225 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 100/211] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:42:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:48.337523 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7406208-4fd9-4cd7-a97f-31d870dc4c57 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:48.456141 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7406208-4fd9-4cd7-a97f-31d870dc4c57 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:48.491427 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682f5eb-9b77-4eea-aec9-14524dac4236 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:48.491931 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682f5eb-9b77-4eea-aec9-14524dac4236 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:48.492005 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682f5eb-9b77-4eea-aec9-14524dac4236 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:48.493555 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 101/212] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:42:48.500345 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beadefd3-de99-498e-9d94-bdaf6833d63b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:48.500737 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beadefd3-de99-498e-9d94-bdaf6833d63b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:48.501114 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beadefd3-de99-498e-9d94-bdaf6833d63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:48.503411 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d83b3-1e4e-415f-9bf5-eaad4c8641fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:48.504256 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d83b3-1e4e-415f-9bf5-eaad4c8641fe None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:48.504675 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d83b3-1e4e-415f-9bf5-eaad4c8641fe None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:48.505112 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d83b3-1e4e-415f-9bf5-eaad4c8641fe None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:48.505964 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d83b3-1e4e-415f-9bf5-eaad4c8641fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:48.507809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d83b3-1e4e-415f-9bf5-eaad4c8641fe None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:48.520527 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-beadefd3-de99-498e-9d94-bdaf6833d63b None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:48.521829 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-beadefd3-de99-498e-9d94-bdaf6833d63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:48.541873 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 112/213] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 4 05:42:48 2022] POST /identity/v3/users => generated 297 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 05:42:48.554059 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:48.596677 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 102/214] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:48.620272 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d83b3-1e4e-415f-9bf5-eaad4c8641fe None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:48.670739 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:48.743175 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d83b3-1e4e-415f-9bf5-eaad4c8641fe None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:48.780294 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9113376-188c-4c3d-853f-f21320df59dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:48.781903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9113376-188c-4c3d-853f-f21320df59dc None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:48.782379 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9113376-188c-4c3d-853f-f21320df59dc None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:48.782864 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9113376-188c-4c3d-853f-f21320df59dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:48.794659 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9113376-188c-4c3d-853f-f21320df59dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:42:48.802685 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-c9113376-188c-4c3d-853f-f21320df59dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:42:48.802685 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:48.802685 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:48.802685 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:48.802685 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:48.802685 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:48.802685 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:48.802685 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:48.802685 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:48.802685 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:48.802685 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:48.802685 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:48.802685 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:42:48.802685 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:42:48.802685 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:42:48.802685 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:42:48.803623 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:42:48.803623 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:42:48.803623 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:42:48.803623 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:42:48.803623 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:48.803623 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:48.803623 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:48.803623 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:48.803623 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:48.803623 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:48.803623 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:48.803623 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:48.803623 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:48.803623 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:48.803623 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:48.803623 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:48.804402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:48.804402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:48.804402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:48.804402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:48.804402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:42:48.804402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:42:48.804402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:42:48.804402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:42:48.804402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:42:48.804402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:42:48.804402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:42:48.804402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:42:48.804402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 113/215] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:42:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:42:48.811909 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beadefd3-de99-498e-9d94-bdaf6833d63b None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:48.898250 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398d624-a2a6-4e76-aaba-77ae46947f4f None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:48.898874 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398d624-a2a6-4e76-aaba-77ae46947f4f None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:48.899532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398d624-a2a6-4e76-aaba-77ae46947f4f None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:48.901138 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 114/216] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:42:48.908969 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c964fc-038d-4baf-9195-5dfd4d7e2119 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:48.909546 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c964fc-038d-4baf-9195-5dfd4d7e2119 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:48.910129 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c964fc-038d-4baf-9195-5dfd4d7e2119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:48.933116 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-b8c964fc-038d-4baf-9195-5dfd4d7e2119 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:48.934547 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b8c964fc-038d-4baf-9195-5dfd4d7e2119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:48.936717 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beadefd3-de99-498e-9d94-bdaf6833d63b None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:48.978652 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f836b-39eb-45ef-8610-90f53079a6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:48.980155 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f836b-39eb-45ef-8610-90f53079a6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:48.980582 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f836b-39eb-45ef-8610-90f53079a6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:48.981287 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f836b-39eb-45ef-8610-90f53079a6d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:48.982511 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f836b-39eb-45ef-8610-90f53079a6d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:48.982962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f836b-39eb-45ef-8610-90f53079a6d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:48.984733 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f836b-39eb-45ef-8610-90f53079a6d7 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:48.995892 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 103/217] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 4 05:42:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:42:49.005641 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f836b-39eb-45ef-8610-90f53079a6d7 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:49.017962 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 115/218] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:49.039712 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:49.041299 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c964fc-038d-4baf-9195-5dfd4d7e2119 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:49.074053 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:49.125465 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f836b-39eb-45ef-8610-90f53079a6d7 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:49.160604 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abe4e7-3b67-4a22-a1a5-7c19b2598469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:49.161562 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abe4e7-3b67-4a22-a1a5-7c19b2598469 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:49.161940 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abe4e7-3b67-4a22-a1a5-7c19b2598469 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:49.162307 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abe4e7-3b67-4a22-a1a5-7c19b2598469 None admin] PATH_INFO: `/v3/users/1556e94463af403c940bc8181cc17065` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:49.167547 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c964fc-038d-4baf-9195-5dfd4d7e2119 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:49.177626 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18abe4e7-3b67-4a22-a1a5-7c19b2598469 None admin] RBAC: Authorizing `identity:get_user(user_id=1556e94463af403c940bc8181cc17065)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:49.179416 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18abe4e7-3b67-4a22-a1a5-7c19b2598469 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:49.181587 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 104/219] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:42:49 2022] GET /identity/v3/users/1556e94463af403c940bc8181cc17065 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:49.186938 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abe4e7-3b67-4a22-a1a5-7c19b2598469 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:49.206522 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800efa7-bf62-4b6e-b622-01855ef6b377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:49.207563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800efa7-bf62-4b6e-b622-01855ef6b377 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:49.207951 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800efa7-bf62-4b6e-b622-01855ef6b377 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:49.208493 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800efa7-bf62-4b6e-b622-01855ef6b377 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:49.219423 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800efa7-bf62-4b6e-b622-01855ef6b377 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:42:49.227878 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-e800efa7-bf62-4b6e-b622-01855ef6b377 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 05:42:49.227878 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:49.227878 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:49.227878 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:49.227878 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:49.227878 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:49.227878 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:49.227878 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:49.227878 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:49.227878 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:49.227878 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:49.227878 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:49.227878 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:42:49.227878 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:42:49.227878 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:42:49.227878 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:42:49.228749 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:42:49.228749 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:42:49.228749 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:42:49.228749 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:42:49.228749 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:49.228749 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:49.228749 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:49.228749 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:49.228749 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:49.228749 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:49.228749 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:49.228749 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:49.228749 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:49.228749 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:49.228749 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:49.228749 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:49.230215 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:49.230215 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:49.230215 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:49.230215 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:49.230215 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:42:49.230215 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:42:49.230215 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:42:49.230215 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:42:49.230215 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:42:49.230215 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:42:49.230215 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 05:42:49.230215 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:42:49.230215 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 116/220] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 4 05:42:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:42:49.235637 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cac6b-59f3-456e-81db-22a774093196 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:49.235996 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cac6b-59f3-456e-81db-22a774093196 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:49.236340 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cac6b-59f3-456e-81db-22a774093196 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:49.237769 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 117/221] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:49.238523 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8cac6b-59f3-456e-81db-22a774093196 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:49.300147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:49.314794 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abe4e7-3b67-4a22-a1a5-7c19b2598469 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:49.345209 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:49.357995 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901fee8-22bc-469b-a506-7d9e2c8d22b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:49.358859 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901fee8-22bc-469b-a506-7d9e2c8d22b4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:49.359311 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901fee8-22bc-469b-a506-7d9e2c8d22b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:49.359721 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901fee8-22bc-469b-a506-7d9e2c8d22b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:49.360367 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8cac6b-59f3-456e-81db-22a774093196 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:49.409632 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bdf4d-92f2-40fc-9e68-262cd9217b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:49.410556 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bdf4d-92f2-40fc-9e68-262cd9217b91 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:49.411039 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bdf4d-92f2-40fc-9e68-262cd9217b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:49.411545 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bdf4d-92f2-40fc-9e68-262cd9217b91 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:49.412444 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005bdf4d-92f2-40fc-9e68-262cd9217b91 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:49.413436 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005bdf4d-92f2-40fc-9e68-262cd9217b91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:49.415509 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005bdf4d-92f2-40fc-9e68-262cd9217b91 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:49.426972 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 118/222] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:42:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:49.428495 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4c8f3-881d-4e73-8303-d48328e2be2a None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:49.428933 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4c8f3-881d-4e73-8303-d48328e2be2a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:49.429330 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4c8f3-881d-4e73-8303-d48328e2be2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:49.451239 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-57b4c8f3-881d-4e73-8303-d48328e2be2a None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:49.452584 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-57b4c8f3-881d-4e73-8303-d48328e2be2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:49.456728 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901fee8-22bc-469b-a506-7d9e2c8d22b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:49.458405 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901fee8-22bc-469b-a506-7d9e2c8d22b4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:49.521968 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 119/223] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:49.527221 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4c8f3-881d-4e73-8303-d48328e2be2a None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:49.578787 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:49.594256 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 105/224] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:42:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 04 05:42:49.595453 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901fee8-22bc-469b-a506-7d9e2c8d22b4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:49.638261 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:49.658293 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4c8f3-881d-4e73-8303-d48328e2be2a None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:49.693647 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22388b62-84a7-48cb-bb89-5c3780d5ad93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:49.694708 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22388b62-84a7-48cb-bb89-5c3780d5ad93 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:49.694834 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22388b62-84a7-48cb-bb89-5c3780d5ad93 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:49.695084 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22388b62-84a7-48cb-bb89-5c3780d5ad93 None admin] PATH_INFO: `/v3/users/350c5b2458914375b8584557c0e288c7` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:49.696349 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22388b62-84a7-48cb-bb89-5c3780d5ad93 None admin] RBAC: Authorizing `identity:get_user(user_id=350c5b2458914375b8584557c0e288c7)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:49.697954 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22388b62-84a7-48cb-bb89-5c3780d5ad93 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:49.698409 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901fee8-22bc-469b-a506-7d9e2c8d22b4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:49.699821 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 120/225] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:42:49 2022] GET /identity/v3/users/350c5b2458914375b8584557c0e288c7 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:49.704996 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22388b62-84a7-48cb-bb89-5c3780d5ad93 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:49.734557 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a188510-c9c5-4652-925b-0be0764b8238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:49.735773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a188510-c9c5-4652-925b-0be0764b8238 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:49.736265 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a188510-c9c5-4652-925b-0be0764b8238 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:49.736743 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a188510-c9c5-4652-925b-0be0764b8238 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:49.747769 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a188510-c9c5-4652-925b-0be0764b8238 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:42:49.756171 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-3a188510-c9c5-4652-925b-0be0764b8238 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:42:49.756171 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:49.756171 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:49.756171 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:49.756171 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:49.756171 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:49.756171 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:49.756171 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:49.756171 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:49.756171 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:49.756171 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:49.756171 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:49.756171 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:42:49.756171 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:42:49.756171 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:42:49.756171 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:42:49.757043 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:42:49.757043 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:42:49.757043 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:42:49.757043 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:42:49.757043 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:49.757043 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:49.757043 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:49.757043 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:49.757043 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:49.757043 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:49.757043 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:49.757043 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:49.757043 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:49.757043 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:49.757043 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:49.757043 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:49.757827 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:49.757827 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:49.757827 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:49.757827 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:49.757827 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:42:49.757827 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:42:49.757827 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:42:49.757827 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:42:49.757827 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:42:49.757827 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:42:49.757827 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:42:49.757827 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:42:49.760547 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 106/226] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:42:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:42:49.761534 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a188510-c9c5-4652-925b-0be0764b8238 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:49.814145 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22388b62-84a7-48cb-bb89-5c3780d5ad93 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:49.816677 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:49.850988 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab1e6b-d25c-4c30-bb38-646fedabdbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:49.851888 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab1e6b-d25c-4c30-bb38-646fedabdbbe None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:49.852210 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab1e6b-d25c-4c30-bb38-646fedabdbbe None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:49.852441 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab1e6b-d25c-4c30-bb38-646fedabdbbe None admin] PATH_INFO: `/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:49.853636 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab1e6b-d25c-4c30-bb38-646fedabdbbe None admin] RBAC: Authorizing `identity:get_project(project_id=e7ac8d54998946acb55e1b10e3a9c30b)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:49.855354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab1e6b-d25c-4c30-bb38-646fedabdbbe None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:49.857118 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 121/227] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:42:49 2022] GET /identity/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:49.862587 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab1e6b-d25c-4c30-bb38-646fedabdbbe None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:49.870617 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a188510-c9c5-4652-925b-0be0764b8238 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:49.884889 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:49.907237 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a46b1-0353-49e5-9812-abc3d47f7a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:49.908459 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a46b1-0353-49e5-9812-abc3d47f7a2d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:49.909016 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a46b1-0353-49e5-9812-abc3d47f7a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:49.909485 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a46b1-0353-49e5-9812-abc3d47f7a2d None admin] PATH_INFO: `/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:49.910936 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a46b1-0353-49e5-9812-abc3d47f7a2d None admin] RBAC: Authorizing `identity:get_project(project_id=e7ac8d54998946acb55e1b10e3a9c30b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:49.912670 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a46b1-0353-49e5-9812-abc3d47f7a2d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:49.914671 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 107/228] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:42:49 2022] GET /identity/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:49.915705 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a46b1-0353-49e5-9812-abc3d47f7a2d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:49.981975 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab1e6b-d25c-4c30-bb38-646fedabdbbe None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:50.017793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6ad8f-d53a-44b3-bf58-c9b7946fae6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:50.018484 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6ad8f-d53a-44b3-bf58-c9b7946fae6b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:50.018770 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6ad8f-d53a-44b3-bf58-c9b7946fae6b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:50.019058 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6ad8f-d53a-44b3-bf58-c9b7946fae6b None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:50.019848 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6ad8f-d53a-44b3-bf58-c9b7946fae6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:50.020156 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6ad8f-d53a-44b3-bf58-c9b7946fae6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:50.021556 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6ad8f-d53a-44b3-bf58-c9b7946fae6b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:50.022042 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a46b1-0353-49e5-9812-abc3d47f7a2d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:50.035382 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 122/229] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:42:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:50.036531 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6ad8f-d53a-44b3-bf58-c9b7946fae6b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:50.045730 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:50.059129 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1d42f-9e72-4d40-8259-97db1bd8c1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:50.060316 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1d42f-9e72-4d40-8259-97db1bd8c1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:50.060812 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1d42f-9e72-4d40-8259-97db1bd8c1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:50.061295 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1d42f-9e72-4d40-8259-97db1bd8c1d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:50.062334 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1d42f-9e72-4d40-8259-97db1bd8c1d5 None admin] RBAC: Adding query filter params (role.id=9fdc0a5e493c44c9add5859af9d4f394, scope.project.id=e7ac8d54998946acb55e1b10e3a9c30b, user.id=1556e94463af403c940bc8181cc17065) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:50.062928 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1d42f-9e72-4d40-8259-97db1bd8c1d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:50.064736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1d42f-9e72-4d40-8259-97db1bd8c1d5 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:50.071090 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 108/230] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:42:49 2022] GET /identity/v3/role_assignments?user.id=1556e94463af403c940bc8181cc17065&scope.project.id=e7ac8d54998946acb55e1b10e3a9c30b&role.id=9fdc0a5e493c44c9add5859af9d4f394 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:50.072233 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1d42f-9e72-4d40-8259-97db1bd8c1d5 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:50.188265 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:50.226762 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6ad8f-d53a-44b3-bf58-c9b7946fae6b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:50.277843 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b4823-8c85-495a-b3bb-4618afbcce4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:50.279130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b4823-8c85-495a-b3bb-4618afbcce4d None admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:50.279668 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b4823-8c85-495a-b3bb-4618afbcce4d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:50.280132 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b4823-8c85-495a-b3bb-4618afbcce4d None admin] PATH_INFO: `/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b/users/350c5b2458914375b8584557c0e288c7/roles/91c119444803497dafe274cc66f05208` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:50.280598 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1d42f-9e72-4d40-8259-97db1bd8c1d5 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:50.282910 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b4823-8c85-495a-b3bb-4618afbcce4d None admin] RBAC: Authorizing `identity:create_grant(project_id=e7ac8d54998946acb55e1b10e3a9c30b, user_id=350c5b2458914375b8584557c0e288c7, role_id=91c119444803497dafe274cc66f05208)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:50.284656 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b4823-8c85-495a-b3bb-4618afbcce4d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:50.310644 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 123/231] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 4 05:42:50 2022] PUT /identity/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b/users/350c5b2458914375b8584557c0e288c7/roles/91c119444803497dafe274cc66f05208 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:42:50.323578 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad26749-68cf-4a7f-a53f-20b3c04c47cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:50.324470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad26749-68cf-4a7f-a53f-20b3c04c47cf None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:50.324795 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad26749-68cf-4a7f-a53f-20b3c04c47cf None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:50.325074 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad26749-68cf-4a7f-a53f-20b3c04c47cf None admin] PATH_INFO: `/v3/users/350c5b2458914375b8584557c0e288c7` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:50.326375 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad26749-68cf-4a7f-a53f-20b3c04c47cf None admin] RBAC: Authorizing `identity:get_user(user_id=350c5b2458914375b8584557c0e288c7)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:50.327894 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad26749-68cf-4a7f-a53f-20b3c04c47cf None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:50.337706 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 109/232] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:42:50 2022] GET /identity/v3/users/350c5b2458914375b8584557c0e288c7 => generated 283 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:50.343693 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b4823-8c85-495a-b3bb-4618afbcce4d None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:50.464903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b4823-8c85-495a-b3bb-4618afbcce4d None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:50.501869 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5aea8-0584-46bd-b2b6-c893558e55b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:50.503143 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5aea8-0584-46bd-b2b6-c893558e55b0 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:50.503651 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5aea8-0584-46bd-b2b6-c893558e55b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:50.504136 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5aea8-0584-46bd-b2b6-c893558e55b0 None admin] PATH_INFO: `/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:50.505599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5aea8-0584-46bd-b2b6-c893558e55b0 None admin] RBAC: Authorizing `identity:get_project(project_id=e7ac8d54998946acb55e1b10e3a9c30b)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:50.507328 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5aea8-0584-46bd-b2b6-c893558e55b0 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:50.509331 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 124/233] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:42:50 2022] GET /identity/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:50.515410 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad26749-68cf-4a7f-a53f-20b3c04c47cf None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:50.589861 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:50.644568 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad26749-68cf-4a7f-a53f-20b3c04c47cf None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:50.681115 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1746efd-0884-4767-b29b-3576cdf00f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:50.682022 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1746efd-0884-4767-b29b-3576cdf00f03 None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:50.682304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1746efd-0884-4767-b29b-3576cdf00f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:50.682583 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1746efd-0884-4767-b29b-3576cdf00f03 None admin] PATH_INFO: `/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b/users/350c5b2458914375b8584557c0e288c7/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:50.684615 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1746efd-0884-4767-b29b-3576cdf00f03 None admin] RBAC: Authorizing `identity:create_grant(project_id=e7ac8d54998946acb55e1b10e3a9c30b, user_id=350c5b2458914375b8584557c0e288c7, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:50.686136 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1746efd-0884-4767-b29b-3576cdf00f03 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:50.712718 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 110/234] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 4 05:42:50 2022] PUT /identity/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b/users/350c5b2458914375b8584557c0e288c7/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:42:50.907754 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3df5c-596a-4fa6-a749-e6963f9c57c6 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:50.908276 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3df5c-596a-4fa6-a749-e6963f9c57c6 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:50.908276 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3df5c-596a-4fa6-a749-e6963f9c57c6 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:50.909690 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 125/235] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:50.915271 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e39ed8-a527-48b4-8f56-a2519344efc6 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:50.915559 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e39ed8-a527-48b4-8f56-a2519344efc6 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:50.915831 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e39ed8-a527-48b4-8f56-a2519344efc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:50.933553 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-f3e39ed8-a527-48b4-8f56-a2519344efc6 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:50.934793 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f3e39ed8-a527-48b4-8f56-a2519344efc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:51.005940 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 111/236] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:51.030598 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3df5c-596a-4fa6-a749-e6963f9c57c6 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:51.042404 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:51.115822 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619aac5-9543-4335-818e-e7df4ba6c1c5 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:51.116101 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619aac5-9543-4335-818e-e7df4ba6c1c5 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:51.116374 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619aac5-9543-4335-818e-e7df4ba6c1c5 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:51.117769 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 112/237] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:42:51.123044 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a483871-8d28-4670-9c61-7f9e26e0e577 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:51.123374 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a483871-8d28-4670-9c61-7f9e26e0e577 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:51.123962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a483871-8d28-4670-9c61-7f9e26e0e577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:51.158453 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3df5c-596a-4fa6-a749-e6963f9c57c6 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:51.161860 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-8a483871-8d28-4670-9c61-7f9e26e0e577 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:51.163569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8a483871-8d28-4670-9c61-7f9e26e0e577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:51.220192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413fc730-2ca7-43b1-b148-3af842273f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:51.221521 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fc730-2ca7-43b1-b148-3af842273f20 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:51.222577 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:51.223786 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fc730-2ca7-43b1-b148-3af842273f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:51.224782 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fc730-2ca7-43b1-b148-3af842273f20 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:51.249621 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413fc730-2ca7-43b1-b148-3af842273f20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:42:51.263246 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-413fc730-2ca7-43b1-b148-3af842273f20 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 05:42:51.263246 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:51.263246 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:51.263246 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:51.263246 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:51.263246 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:51.263246 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:51.263246 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:51.263246 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:51.263246 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:51.263246 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:51.263246 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:51.263246 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:42:51.263246 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:42:51.263246 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:42:51.263246 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:42:51.264401 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:42:51.264401 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:42:51.264401 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:42:51.264401 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:42:51.264401 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:51.264401 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:51.264401 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:51.264401 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:51.264401 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:51.264401 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:51.264401 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:51.264401 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:51.264401 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:51.264401 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:51.264401 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:51.264401 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:51.265383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:51.265383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:51.265383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:51.265383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:51.265383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:42:51.265383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:42:51.265383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:42:51.265383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:42:51.265383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:42:51.265383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:42:51.265383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 05:42:51.265383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:42:51.272569 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 126/238] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:42:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:42:51.278978 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413fc730-2ca7-43b1-b148-3af842273f20 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:51.291393 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 113/239] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 05:42:51.340657 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a483871-8d28-4670-9c61-7f9e26e0e577 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:51.383222 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:51.431116 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413fc730-2ca7-43b1-b148-3af842273f20 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:51.494431 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a483871-8d28-4670-9c61-7f9e26e0e577 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:51.506890 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53c649-34ae-477d-9c2b-d71dce568ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:51.507859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53c649-34ae-477d-9c2b-d71dce568ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:51.508277 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53c649-34ae-477d-9c2b-d71dce568ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:51.508727 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53c649-34ae-477d-9c2b-d71dce568ab8 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:51.509614 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53c649-34ae-477d-9c2b-d71dce568ab8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:51.510054 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53c649-34ae-477d-9c2b-d71dce568ab8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:51.511638 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53c649-34ae-477d-9c2b-d71dce568ab8 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:51.528445 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 127/240] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 4 05:42:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:42:51.537037 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53c649-34ae-477d-9c2b-d71dce568ab8 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:51.548979 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357e0aa-651d-4a81-b6db-4edf023b2fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:51.549801 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357e0aa-651d-4a81-b6db-4edf023b2fce None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:51.550080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357e0aa-651d-4a81-b6db-4edf023b2fce None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:51.550374 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357e0aa-651d-4a81-b6db-4edf023b2fce None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:51.553450 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357e0aa-651d-4a81-b6db-4edf023b2fce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:51.555293 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357e0aa-651d-4a81-b6db-4edf023b2fce None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:51.557711 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 114/241] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:42:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:42:51.564421 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357e0aa-651d-4a81-b6db-4edf023b2fce None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:51.656069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53c649-34ae-477d-9c2b-d71dce568ab8 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:51.656265 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:51.688501 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:51.694872 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717cd6ee-7122-4805-93e4-5e807c6428c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:51.696236 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cd6ee-7122-4805-93e4-5e807c6428c6 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:51.696709 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cd6ee-7122-4805-93e4-5e807c6428c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:51.697204 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cd6ee-7122-4805-93e4-5e807c6428c6 None admin] PATH_INFO: `/v3/users/e87d080db2cc4c6d99dc8e33014378d4` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:51.712666 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717cd6ee-7122-4805-93e4-5e807c6428c6 None admin] RBAC: Authorizing `identity:get_user(user_id=e87d080db2cc4c6d99dc8e33014378d4)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:51.714448 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717cd6ee-7122-4805-93e4-5e807c6428c6 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:51.716684 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 128/242] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:42:51 2022] GET /identity/v3/users/e87d080db2cc4c6d99dc8e33014378d4 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:51.722128 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717cd6ee-7122-4805-93e4-5e807c6428c6 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:51.807037 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357e0aa-651d-4a81-b6db-4edf023b2fce None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:51.830777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717cd6ee-7122-4805-93e4-5e807c6428c6 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:51.881626 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340c30c-a65a-4d00-ba80-9b588b92c9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:51.883691 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340c30c-a65a-4d00-ba80-9b588b92c9e8 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:51.884714 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340c30c-a65a-4d00-ba80-9b588b92c9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:51.885179 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340c30c-a65a-4d00-ba80-9b588b92c9e8 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:51.886726 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0340c30c-a65a-4d00-ba80-9b588b92c9e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:51.890304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0340c30c-a65a-4d00-ba80-9b588b92c9e8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:51.898933 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff4bc4-e65a-4891-a2bc-72645f2b150c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:51.899908 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff4bc4-e65a-4891-a2bc-72645f2b150c None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:51.900393 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff4bc4-e65a-4891-a2bc-72645f2b150c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:51.900854 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff4bc4-e65a-4891-a2bc-72645f2b150c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:51.935822 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 115/243] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 4 05:42:51 2022] POST /identity/v3/users => generated 293 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 05:42:51.991678 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:52.003329 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff4bc4-e65a-4891-a2bc-72645f2b150c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:52.005287 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff4bc4-e65a-4891-a2bc-72645f2b150c None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:52.112654 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 129/244] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:42:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 04 05:42:52.118362 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340c30c-a65a-4d00-ba80-9b588b92c9e8 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:52.218310 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:52.228523 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340c30c-a65a-4d00-ba80-9b588b92c9e8 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:52.269366 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00309cd5-c0e6-4c53-a37b-665a1e308727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:52.270244 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00309cd5-c0e6-4c53-a37b-665a1e308727 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:52.270523 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00309cd5-c0e6-4c53-a37b-665a1e308727 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:52.270793 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00309cd5-c0e6-4c53-a37b-665a1e308727 None admin] PATH_INFO: `/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:52.272025 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00309cd5-c0e6-4c53-a37b-665a1e308727 None admin] RBAC: Authorizing `identity:get_project(project_id=e7ac8d54998946acb55e1b10e3a9c30b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:52.273546 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00309cd5-c0e6-4c53-a37b-665a1e308727 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:52.275332 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 116/245] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:42:52 2022] GET /identity/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:52.281188 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff4bc4-e65a-4891-a2bc-72645f2b150c None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:52.375474 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:52.389110 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff4bc4-e65a-4891-a2bc-72645f2b150c None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:52.425636 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01af72-1aac-459f-9d43-f12ed2e95d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:52.426302 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01af72-1aac-459f-9d43-f12ed2e95d1d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:52.426579 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01af72-1aac-459f-9d43-f12ed2e95d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:52.426853 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01af72-1aac-459f-9d43-f12ed2e95d1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:52.427717 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01af72-1aac-459f-9d43-f12ed2e95d1d None admin] RBAC: Adding query filter params (role.id=5357c224d018422198be89d0268ef167, scope.project.id=e7ac8d54998946acb55e1b10e3a9c30b, user.id=e87d080db2cc4c6d99dc8e33014378d4) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:52.428024 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01af72-1aac-459f-9d43-f12ed2e95d1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:52.429559 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01af72-1aac-459f-9d43-f12ed2e95d1d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:52.435358 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 130/246] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:42:52 2022] GET /identity/v3/role_assignments?user.id=e87d080db2cc4c6d99dc8e33014378d4&scope.project.id=e7ac8d54998946acb55e1b10e3a9c30b&role.id=5357c224d018422198be89d0268ef167 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:52.722590 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14067924-1be9-412f-9520-7109b2550e46 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:52.723091 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14067924-1be9-412f-9520-7109b2550e46 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:52.723165 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14067924-1be9-412f-9520-7109b2550e46 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:52.724836 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 117/247] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:52.730992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25153a6-45bf-48e8-b0bc-bba4d08c657f None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:52.731307 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25153a6-45bf-48e8-b0bc-bba4d08c657f None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:52.731583 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25153a6-45bf-48e8-b0bc-bba4d08c657f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:52.754082 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-f25153a6-45bf-48e8-b0bc-bba4d08c657f None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:52.755314 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f25153a6-45bf-48e8-b0bc-bba4d08c657f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:52.840283 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 131/248] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 05:42:52.861941 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14067924-1be9-412f-9520-7109b2550e46 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:52.898101 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5766d5-74bb-4167-8e87-eeb83315b05d None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:52.898928 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5766d5-74bb-4167-8e87-eeb83315b05d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:52.899438 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5766d5-74bb-4167-8e87-eeb83315b05d None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:52.901862 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 132/249] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:52.908079 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafcbf3-e419-49ff-8433-deee70f291c4 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:52.908659 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafcbf3-e419-49ff-8433-deee70f291c4 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:52.909135 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafcbf3-e419-49ff-8433-deee70f291c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:52.941212 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-feafcbf3-e419-49ff-8433-deee70f291c4 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:52.942422 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-feafcbf3-e419-49ff-8433-deee70f291c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:53.019455 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 133/250] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 05:42:53.042065 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafcbf3-e419-49ff-8433-deee70f291c4 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:53.057548 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14067924-1be9-412f-9520-7109b2550e46 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:53.063535 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:53.126864 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0b892-d0e4-4299-a3b6-23e628f3ede4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:53.127618 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0b892-d0e4-4299-a3b6-23e628f3ede4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:53.127899 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0b892-d0e4-4299-a3b6-23e628f3ede4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:53.128175 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0b892-d0e4-4299-a3b6-23e628f3ede4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:53.138919 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0b892-d0e4-4299-a3b6-23e628f3ede4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:42:53.146882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-bfe0b892-d0e4-4299-a3b6-23e628f3ede4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:42:53.146882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:53.146882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:53.146882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:53.146882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:53.146882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:53.146882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:53.146882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:53.146882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:53.146882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:53.146882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:53.146882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:53.146882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:42:53.146882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:42:53.146882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:42:53.146882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:42:53.147814 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:42:53.147814 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:42:53.147814 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:42:53.147814 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:42:53.147814 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:53.147814 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:53.147814 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:53.147814 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:53.147814 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:53.147814 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:53.147814 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:53.147814 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:53.147814 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:53.147814 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:53.147814 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:53.147814 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:53.148602 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:53.148602 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:53.148602 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:53.148602 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:53.148602 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:42:53.148602 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:42:53.148602 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:42:53.148602 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:42:53.148602 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:42:53.148602 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:42:53.148602 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:42:53.148602 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:42:53.148602 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 118/251] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:42:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:42:53.155236 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0b892-d0e4-4299-a3b6-23e628f3ede4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:53.178748 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:53.205375 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafcbf3-e419-49ff-8433-deee70f291c4 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:53.259888 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0b892-d0e4-4299-a3b6-23e628f3ede4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:53.283327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0aaab-e0a2-423d-985c-cb903cecdfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:53.284198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0aaab-e0a2-423d-985c-cb903cecdfee None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:53.284488 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0aaab-e0a2-423d-985c-cb903cecdfee None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:53.284768 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0aaab-e0a2-423d-985c-cb903cecdfee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:53.302510 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2f6ae-b0c7-4ba1-b1f8-cef8561a5817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:53.303281 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2f6ae-b0c7-4ba1-b1f8-cef8561a5817 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:53.303562 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2f6ae-b0c7-4ba1-b1f8-cef8561a5817 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:53.303837 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2f6ae-b0c7-4ba1-b1f8-cef8561a5817 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:53.304629 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2f6ae-b0c7-4ba1-b1f8-cef8561a5817 None admin] RBAC: Adding query filter params (name=member) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:53.304945 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2f6ae-b0c7-4ba1-b1f8-cef8561a5817 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:53.306349 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2f6ae-b0c7-4ba1-b1f8-cef8561a5817 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:53.307978 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb0aaab-e0a2-423d-985c-cb903cecdfee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:42:53.324477 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 119/252] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 4 05:42:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:53.325808 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603dc05-9d37-4949-97b1-21772549df44 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:53.326098 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603dc05-9d37-4949-97b1-21772549df44 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:53.326943 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-ddb0aaab-e0a2-423d-985c-cb903cecdfee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 05:42:53.326943 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:53.326943 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:53.326943 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:53.326943 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:53.326943 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:53.326943 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:53.326943 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:53.326943 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:53.326943 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:53.326943 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:53.326943 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:53.326943 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:42:53.326943 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:42:53.326943 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:42:53.326943 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:42:53.329013 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:42:53.329013 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:42:53.329013 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:42:53.329013 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:42:53.329013 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:53.329013 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:53.329013 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:53.329013 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:53.329013 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:53.329013 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:53.329013 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:53.329013 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:53.329013 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:53.329013 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:53.329013 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:53.329013 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:53.330955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:53.330955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:53.330955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:53.330955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:53.330955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:42:53.330955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:42:53.330955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:42:53.330955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:42:53.330955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:42:53.330955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:42:53.330955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 05:42:53.330955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:42:53.332438 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 134/253] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 4 05:42:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:42:53.332574 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603dc05-9d37-4949-97b1-21772549df44 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:53.335221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 120/254] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:53.335620 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0aaab-e0a2-423d-985c-cb903cecdfee None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:53.344198 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591fd29-b7f4-4c8b-b221-967e03f735f2 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:53.344475 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591fd29-b7f4-4c8b-b221-967e03f735f2 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:53.344799 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591fd29-b7f4-4c8b-b221-967e03f735f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:53.363479 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6591fd29-b7f4-4c8b-b221-967e03f735f2 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:53.364683 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6591fd29-b7f4-4c8b-b221-967e03f735f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:53.410353 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:53.436875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 121/255] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 05:42:53.437724 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591fd29-b7f4-4c8b-b221-967e03f735f2 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:53.452497 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:53.476940 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0aaab-e0a2-423d-985c-cb903cecdfee None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:53.542495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591fd29-b7f4-4c8b-b221-967e03f735f2 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:53.543974 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960acc3-d11f-48ea-801a-6bbd89d6be5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:53.545031 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960acc3-d11f-48ea-801a-6bbd89d6be5c None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:53.545316 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960acc3-d11f-48ea-801a-6bbd89d6be5c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:53.545589 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960acc3-d11f-48ea-801a-6bbd89d6be5c None admin] PATH_INFO: `/v3/users/1556e94463af403c940bc8181cc17065` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:53.550796 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960acc3-d11f-48ea-801a-6bbd89d6be5c None admin] RBAC: Authorizing `identity:get_user(user_id=1556e94463af403c940bc8181cc17065)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:53.552404 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960acc3-d11f-48ea-801a-6bbd89d6be5c None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:53.554533 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 135/256] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:42:53 2022] GET /identity/v3/users/1556e94463af403c940bc8181cc17065 => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:42:53.555356 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960acc3-d11f-48ea-801a-6bbd89d6be5c None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:53.582553 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b1f25-efd9-4001-92a1-ba908ae73f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:53.583251 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b1f25-efd9-4001-92a1-ba908ae73f29 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:53.583631 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b1f25-efd9-4001-92a1-ba908ae73f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:53.583907 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b1f25-efd9-4001-92a1-ba908ae73f29 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:53.584870 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b1f25-efd9-4001-92a1-ba908ae73f29 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:53.585175 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b1f25-efd9-4001-92a1-ba908ae73f29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:53.586613 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b1f25-efd9-4001-92a1-ba908ae73f29 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:53.595802 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 122/257] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:42:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:53.596604 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b1f25-efd9-4001-92a1-ba908ae73f29 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:53.679636 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:53.699791 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b1f25-efd9-4001-92a1-ba908ae73f29 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:53.734844 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c4fb4-fa4d-4519-b932-5d0b0c960ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:53.735766 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c4fb4-fa4d-4519-b932-5d0b0c960ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:53.735991 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c4fb4-fa4d-4519-b932-5d0b0c960ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:53.736262 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c4fb4-fa4d-4519-b932-5d0b0c960ca7 None admin] PATH_INFO: `/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:53.737450 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c4fb4-fa4d-4519-b932-5d0b0c960ca7 None admin] RBAC: Authorizing `identity:get_project(project_id=e7ac8d54998946acb55e1b10e3a9c30b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:53.739024 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c4fb4-fa4d-4519-b932-5d0b0c960ca7 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:53.741106 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 123/258] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:42:53 2022] GET /identity/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:53.741647 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c4fb4-fa4d-4519-b932-5d0b0c960ca7 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:53.802153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960acc3-d11f-48ea-801a-6bbd89d6be5c None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:53.851315 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c4fb4-fa4d-4519-b932-5d0b0c960ca7 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:53.894274 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dcd6e0-3bc7-4c24-a99a-52fc1402d87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:53.895168 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dcd6e0-3bc7-4c24-a99a-52fc1402d87a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:53.895839 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf423e3-6834-429c-a790-e8bff98f2af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:53.896640 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf423e3-6834-429c-a790-e8bff98f2af0 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:53.896916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf423e3-6834-429c-a790-e8bff98f2af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:53.897186 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf423e3-6834-429c-a790-e8bff98f2af0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:53.897955 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dcd6e0-3bc7-4c24-a99a-52fc1402d87a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:53.898187 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dcd6e0-3bc7-4c24-a99a-52fc1402d87a None admin] PATH_INFO: `/v3/users/350c5b2458914375b8584557c0e288c7` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:53.899671 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dcd6e0-3bc7-4c24-a99a-52fc1402d87a None admin] RBAC: Authorizing `identity:get_user(user_id=350c5b2458914375b8584557c0e288c7)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:53.902343 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dcd6e0-3bc7-4c24-a99a-52fc1402d87a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:53.904558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 124/259] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:42:53 2022] GET /identity/v3/users/350c5b2458914375b8584557c0e288c7 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:53.905347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dcd6e0-3bc7-4c24-a99a-52fc1402d87a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:53.915877 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:53.921211 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf423e3-6834-429c-a790-e8bff98f2af0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:42:53.929416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-caf423e3-6834-429c-a790-e8bff98f2af0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:42:53.929416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:53.929416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:53.929416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:53.929416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:53.929416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:53.929416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:53.929416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:53.929416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:53.929416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:53.929416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:53.929416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:53.929416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:42:53.929416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:42:53.929416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:42:53.929416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:42:53.930339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:42:53.930339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:42:53.930339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:42:53.930339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:42:53.930339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:53.930339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:53.930339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:53.930339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:53.930339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:53.930339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:53.930339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:53.930339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:53.930339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:53.930339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:53.930339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:53.930339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:53.931227 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:53.931227 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:53.931227 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:53.931227 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:53.931227 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:42:53.931227 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:42:53.931227 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:42:53.931227 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:42:53.931227 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:42:53.931227 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:42:53.931227 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:42:53.931227 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:42:53.931227 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 136/260] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:42:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:42:53.931901 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf423e3-6834-429c-a790-e8bff98f2af0 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:53.936300 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:54.045891 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dcd6e0-3bc7-4c24-a99a-52fc1402d87a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:54.084793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf423e3-6834-429c-a790-e8bff98f2af0 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:54.089428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29044c-b36d-4951-9f2a-1abe9c684b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:54.090495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29044c-b36d-4951-9f2a-1abe9c684b9d None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:54.090918 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29044c-b36d-4951-9f2a-1abe9c684b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:54.091412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29044c-b36d-4951-9f2a-1abe9c684b9d None admin] PATH_INFO: `/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b/users/1556e94463af403c940bc8181cc17065/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:54.096700 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb29044c-b36d-4951-9f2a-1abe9c684b9d None admin] RBAC: Authorizing `identity:create_grant(project_id=e7ac8d54998946acb55e1b10e3a9c30b, user_id=1556e94463af403c940bc8181cc17065, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:54.098341 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb29044c-b36d-4951-9f2a-1abe9c684b9d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:54.122103 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd1478-1994-4103-9e56-0473c4552ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:54.126992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd1478-1994-4103-9e56-0473c4552ebc None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:54.126992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd1478-1994-4103-9e56-0473c4552ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:54.126992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd1478-1994-4103-9e56-0473c4552ebc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:54.129837 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 125/261] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 4 05:42:53 2022] PUT /identity/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b/users/1556e94463af403c940bc8181cc17065/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:42:54.130864 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29044c-b36d-4951-9f2a-1abe9c684b9d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:54.268746 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:54.273597 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:54.280440 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd1478-1994-4103-9e56-0473c4552ebc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:54.282026 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd1478-1994-4103-9e56-0473c4552ebc None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:54.337718 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29044c-b36d-4951-9f2a-1abe9c684b9d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:54.423920 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602639d-c4a5-4313-ac70-b387313cbdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:54.424617 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602639d-c4a5-4313-ac70-b387313cbdc3 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:54.424909 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602639d-c4a5-4313-ac70-b387313cbdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:54.425190 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602639d-c4a5-4313-ac70-b387313cbdc3 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:54.429227 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b602639d-c4a5-4313-ac70-b387313cbdc3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:54.429227 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b602639d-c4a5-4313-ac70-b387313cbdc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:54.429227 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b602639d-c4a5-4313-ac70-b387313cbdc3 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:54.445232 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 137/262] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:42:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 05:42:54.450901 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd1478-1994-4103-9e56-0473c4552ebc None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:54.453375 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 126/263] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:42:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:54.458840 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602639d-c4a5-4313-ac70-b387313cbdc3 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:54.586868 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602639d-c4a5-4313-ac70-b387313cbdc3 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:54.616522 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:54.620415 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:54.625699 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd1478-1994-4103-9e56-0473c4552ebc None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:54.640930 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cf4be-17bb-402e-a061-79ef1fbcecd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:54.641855 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cf4be-17bb-402e-a061-79ef1fbcecd5 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:54.642141 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cf4be-17bb-402e-a061-79ef1fbcecd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:54.642419 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cf4be-17bb-402e-a061-79ef1fbcecd5 None admin] PATH_INFO: `/v3/users/350c5b2458914375b8584557c0e288c7` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:54.648052 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87cf4be-17bb-402e-a061-79ef1fbcecd5 None admin] RBAC: Authorizing `identity:get_user(user_id=350c5b2458914375b8584557c0e288c7)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:54.649537 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87cf4be-17bb-402e-a061-79ef1fbcecd5 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:54.651488 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 127/264] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:42:54 2022] GET /identity/v3/users/350c5b2458914375b8584557c0e288c7 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:42:54.657006 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cf4be-17bb-402e-a061-79ef1fbcecd5 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:54.688193 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b16b3-8df3-45e9-9f1b-b9c69722f43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:54.689167 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b16b3-8df3-45e9-9f1b-b9c69722f43c None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:54.689451 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b16b3-8df3-45e9-9f1b-b9c69722f43c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:54.689726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b16b3-8df3-45e9-9f1b-b9c69722f43c None admin] PATH_INFO: `/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:54.695936 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b16b3-8df3-45e9-9f1b-b9c69722f43c None admin] RBAC: Authorizing `identity:get_project(project_id=e7ac8d54998946acb55e1b10e3a9c30b)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:54.697535 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b16b3-8df3-45e9-9f1b-b9c69722f43c None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:54.699741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 138/265] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:42:54 2022] GET /identity/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:54.705569 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b16b3-8df3-45e9-9f1b-b9c69722f43c None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:54.764343 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cf4be-17bb-402e-a061-79ef1fbcecd5 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:54.806009 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd55913-490f-452f-9c6e-ae42ec943649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:54.811212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd55913-490f-452f-9c6e-ae42ec943649 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:54.811212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd55913-490f-452f-9c6e-ae42ec943649 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:54.811212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd55913-490f-452f-9c6e-ae42ec943649 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:54.883518 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b16b3-8df3-45e9-9f1b-b9c69722f43c None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:54.927659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:54.931969 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd55913-490f-452f-9c6e-ae42ec943649 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:54.933505 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd55913-490f-452f-9c6e-ae42ec943649 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:54.948548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cddacf-99a4-479d-9ac0-94d867d64f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:54.949215 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cddacf-99a4-479d-9ac0-94d867d64f3b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:54.949494 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cddacf-99a4-479d-9ac0-94d867d64f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:54.949768 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cddacf-99a4-479d-9ac0-94d867d64f3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:54.950653 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cddacf-99a4-479d-9ac0-94d867d64f3b None admin] RBAC: Adding query filter params (role.id=91c119444803497dafe274cc66f05208, scope.project.id=e7ac8d54998946acb55e1b10e3a9c30b, user.id=350c5b2458914375b8584557c0e288c7) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:54.952441 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cddacf-99a4-479d-9ac0-94d867d64f3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:54.953936 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cddacf-99a4-479d-9ac0-94d867d64f3b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:54.964917 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 139/266] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:42:54 2022] GET /identity/v3/role_assignments?user.id=350c5b2458914375b8584557c0e288c7&scope.project.id=e7ac8d54998946acb55e1b10e3a9c30b&role.id=91c119444803497dafe274cc66f05208 => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:42:55.110388 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 128/267] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:42:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 04 05:42:55.116201 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cddacf-99a4-479d-9ac0-94d867d64f3b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:55.165975 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:55.260527 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cddacf-99a4-479d-9ac0-94d867d64f3b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:55.274175 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ee9b3-c4ca-4778-a441-1dd5427aab3b None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:55.274485 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ee9b3-c4ca-4778-a441-1dd5427aab3b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:55.274721 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ee9b3-c4ca-4778-a441-1dd5427aab3b None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:55.277102 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 129/268] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:55.283368 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe7b88-6a70-484f-ac9b-a7fca49ee138 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:55.284155 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe7b88-6a70-484f-ac9b-a7fca49ee138 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:55.284621 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe7b88-6a70-484f-ac9b-a7fca49ee138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:55.304596 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-b9fe7b88-6a70-484f-ac9b-a7fca49ee138 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:55.306796 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b9fe7b88-6a70-484f-ac9b-a7fca49ee138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:55.318756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e91c4f-b9fe-41b1-a166-f4e9153f7008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:55.319688 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e91c4f-b9fe-41b1-a166-f4e9153f7008 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:55.319967 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e91c4f-b9fe-41b1-a166-f4e9153f7008 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:55.320786 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e91c4f-b9fe-41b1-a166-f4e9153f7008 None admin] PATH_INFO: `/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:55.322461 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e91c4f-b9fe-41b1-a166-f4e9153f7008 None admin] RBAC: Authorizing `identity:get_project(project_id=e7ac8d54998946acb55e1b10e3a9c30b)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:55.327666 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e91c4f-b9fe-41b1-a166-f4e9153f7008 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:55.327666 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 140/269] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:42:55 2022] GET /identity/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:55.328596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbeeb2-1943-443d-9c78-5c77c0c3d0f9 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:55.328880 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbeeb2-1943-443d-9c78-5c77c0c3d0f9 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:55.329156 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbeeb2-1943-443d-9c78-5c77c0c3d0f9 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:55.330621 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 141/270] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:55.333918 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbeeb2-1943-443d-9c78-5c77c0c3d0f9 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:55.395688 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 130/271] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 05:42:55.398145 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc834b4-9207-47d1-bf7d-756ca5f171e6 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:55.398682 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc834b4-9207-47d1-bf7d-756ca5f171e6 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:55.399154 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc834b4-9207-47d1-bf7d-756ca5f171e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:55.429145 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9fc834b4-9207-47d1-bf7d-756ca5f171e6 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:55.430693 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9fc834b4-9207-47d1-bf7d-756ca5f171e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:55.458624 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:55.479320 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:55.486199 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbeeb2-1943-443d-9c78-5c77c0c3d0f9 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:55.507037 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 131/272] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:55.508253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc834b4-9207-47d1-bf7d-756ca5f171e6 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:55.529097 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b51bb-ab03-4f99-9f51-727fe446cd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:55.531294 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b51bb-ab03-4f99-9f51-727fe446cd82 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:55.531587 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b51bb-ab03-4f99-9f51-727fe446cd82 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:55.533268 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b51bb-ab03-4f99-9f51-727fe446cd82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:55.534123 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b51bb-ab03-4f99-9f51-727fe446cd82 None admin] RBAC: Adding query filter params (role.id=6c5b161dbf33447fa1d383915d3c9382, scope.project.id=e7ac8d54998946acb55e1b10e3a9c30b, user.id=350c5b2458914375b8584557c0e288c7) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:55.535318 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b51bb-ab03-4f99-9f51-727fe446cd82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:55.539418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b51bb-ab03-4f99-9f51-727fe446cd82 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:55.552852 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 142/273] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:42:55 2022] GET /identity/v3/role_assignments?user.id=350c5b2458914375b8584557c0e288c7&scope.project.id=e7ac8d54998946acb55e1b10e3a9c30b&role.id=6c5b161dbf33447fa1d383915d3c9382 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:55.553703 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b51bb-ab03-4f99-9f51-727fe446cd82 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:55.640499 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc834b4-9207-47d1-bf7d-756ca5f171e6 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:55.665202 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b51bb-ab03-4f99-9f51-727fe446cd82 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:55.678228 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40102cd-b847-4302-b55a-e024e3ab111a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:55.679480 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40102cd-b847-4302-b55a-e024e3ab111a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:55.679968 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40102cd-b847-4302-b55a-e024e3ab111a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:55.680430 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40102cd-b847-4302-b55a-e024e3ab111a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:55.692447 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40102cd-b847-4302-b55a-e024e3ab111a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:42:55.700895 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-b40102cd-b847-4302-b55a-e024e3ab111a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 05:42:55.700895 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:55.700895 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:55.700895 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:55.700895 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:55.700895 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:55.700895 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:55.700895 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:55.700895 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:55.700895 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:55.700895 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:55.700895 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:55.700895 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:42:55.700895 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:42:55.700895 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:42:55.700895 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:42:55.702015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:42:55.702015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:42:55.702015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:42:55.702015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:42:55.702015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:55.702015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:55.702015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:55.702015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:55.702015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:55.702015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:55.702015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:55.702015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:55.702015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:55.702015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:55.702015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:55.702015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:55.702993 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:55.702993 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:55.702993 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:55.702993 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:55.702993 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:42:55.702993 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:42:55.702993 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:42:55.702993 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:42:55.702993 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:42:55.702993 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:42:55.702993 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 05:42:55.702993 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:42:55.705317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 132/274] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:42:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:42:55.705429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798505f4-cc32-4af3-8ba7-c509df7088ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:55.706393 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798505f4-cc32-4af3-8ba7-c509df7088ea None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:55.706825 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798505f4-cc32-4af3-8ba7-c509df7088ea None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:55.707172 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f0cc1-b327-4727-a9cd-e6d0bc6190bc None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:55.707294 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798505f4-cc32-4af3-8ba7-c509df7088ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:55.707676 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f0cc1-b327-4727-a9cd-e6d0bc6190bc None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:55.708168 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f0cc1-b327-4727-a9cd-e6d0bc6190bc None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:55.709604 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 133/275] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:55.714226 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f0cc1-b327-4727-a9cd-e6d0bc6190bc None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:55.726284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798505f4-cc32-4af3-8ba7-c509df7088ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:42:55.737770 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-798505f4-cc32-4af3-8ba7-c509df7088ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:42:55.737770 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:55.737770 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:55.737770 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:55.737770 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:55.737770 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:55.737770 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:55.737770 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:55.737770 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:55.737770 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:55.737770 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:55.737770 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:55.737770 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:42:55.737770 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:42:55.737770 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:42:55.737770 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:42:55.738741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:42:55.738741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:42:55.738741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:42:55.738741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:42:55.738741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:55.738741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:55.738741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:55.738741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:55.738741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:55.738741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:55.738741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:55.738741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:55.738741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:55.738741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:55.738741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:55.738741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:55.739561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:55.739561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:55.739561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:55.739561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:55.739561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:42:55.739561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:42:55.739561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:42:55.739561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:42:55.739561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:42:55.739561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:42:55.739561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:42:55.739561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:42:55.739561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 143/276] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:42:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:42:55.740807 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc608d5-7cdf-48cd-a2b7-1ec0f77bf342 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:55.740902 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc608d5-7cdf-48cd-a2b7-1ec0f77bf342 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:55.743553 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc608d5-7cdf-48cd-a2b7-1ec0f77bf342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:55.751237 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:55.769711 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-4fc608d5-7cdf-48cd-a2b7-1ec0f77bf342 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:55.770428 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-4fc608d5-7cdf-48cd-a2b7-1ec0f77bf342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:55.789606 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:55.851090 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 144/277] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:55.851811 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc608d5-7cdf-48cd-a2b7-1ec0f77bf342 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:55.852284 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f0cc1-b327-4727-a9cd-e6d0bc6190bc None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:55.893489 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900cb4e-44b5-458e-a08c-6ef3921ea55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:55.894168 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900cb4e-44b5-458e-a08c-6ef3921ea55f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:55.894455 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900cb4e-44b5-458e-a08c-6ef3921ea55f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:55.894734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900cb4e-44b5-458e-a08c-6ef3921ea55f None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:55.895525 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b900cb4e-44b5-458e-a08c-6ef3921ea55f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:55.895863 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b900cb4e-44b5-458e-a08c-6ef3921ea55f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:55.897245 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b900cb4e-44b5-458e-a08c-6ef3921ea55f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:55.907016 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 134/278] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 4 05:42:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:55.907990 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900cb4e-44b5-458e-a08c-6ef3921ea55f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:55.969758 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc608d5-7cdf-48cd-a2b7-1ec0f77bf342 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:55.995312 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:56.003935 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc5542-3da2-494c-86cc-a0f5b0f10d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:56.004584 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc5542-3da2-494c-86cc-a0f5b0f10d60 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:56.004899 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc5542-3da2-494c-86cc-a0f5b0f10d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:56.005174 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc5542-3da2-494c-86cc-a0f5b0f10d60 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:56.005901 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc5542-3da2-494c-86cc-a0f5b0f10d60 None admin] RBAC: Adding query filter params (name=member) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:56.006234 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc5542-3da2-494c-86cc-a0f5b0f10d60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:56.007640 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc5542-3da2-494c-86cc-a0f5b0f10d60 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:56.020270 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 145/279] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 4 05:42:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:56.020270 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc5542-3da2-494c-86cc-a0f5b0f10d60 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:56.020507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900cb4e-44b5-458e-a08c-6ef3921ea55f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:56.036228 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:56.063978 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d4c48-78bb-4d11-a82f-c8c135726e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:56.065227 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d4c48-78bb-4d11-a82f-c8c135726e77 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:56.065680 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d4c48-78bb-4d11-a82f-c8c135726e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:56.066127 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d4c48-78bb-4d11-a82f-c8c135726e77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:56.068023 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d4c48-78bb-4d11-a82f-c8c135726e77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:56.070274 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d4c48-78bb-4d11-a82f-c8c135726e77 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:56.077351 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 135/280] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:42:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:56.077351 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d4c48-78bb-4d11-a82f-c8c135726e77 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:56.145859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc5542-3da2-494c-86cc-a0f5b0f10d60 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:56.183810 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883a645-676c-4e35-a73f-a555035427a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:56.184684 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883a645-676c-4e35-a73f-a555035427a1 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:56.184959 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883a645-676c-4e35-a73f-a555035427a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:56.185225 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883a645-676c-4e35-a73f-a555035427a1 None admin] PATH_INFO: `/v3/users/e87d080db2cc4c6d99dc8e33014378d4` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:56.186428 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883a645-676c-4e35-a73f-a555035427a1 None admin] RBAC: Authorizing `identity:get_user(user_id=e87d080db2cc4c6d99dc8e33014378d4)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:56.187924 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883a645-676c-4e35-a73f-a555035427a1 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:56.189479 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d4c48-78bb-4d11-a82f-c8c135726e77 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:56.189591 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 146/281] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:42:56 2022] GET /identity/v3/users/e87d080db2cc4c6d99dc8e33014378d4 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:56.194846 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883a645-676c-4e35-a73f-a555035427a1 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:56.225019 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5a8c7-ab03-4f76-9248-875841ef1ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:56.225814 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5a8c7-ab03-4f76-9248-875841ef1ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:56.226092 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5a8c7-ab03-4f76-9248-875841ef1ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:56.226360 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5a8c7-ab03-4f76-9248-875841ef1ea7 None admin] PATH_INFO: `/v3/users/de5cc4cf4b5d4fe89f20ca7073f1a2aa` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:56.239995 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5a8c7-ab03-4f76-9248-875841ef1ea7 None admin] RBAC: Authorizing `identity:get_user(user_id=de5cc4cf4b5d4fe89f20ca7073f1a2aa)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:56.241595 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5a8c7-ab03-4f76-9248-875841ef1ea7 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:56.243493 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 136/282] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:42:56 2022] GET /identity/v3/users/de5cc4cf4b5d4fe89f20ca7073f1a2aa => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:56.250204 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5a8c7-ab03-4f76-9248-875841ef1ea7 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:56.261786 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:56.282095 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:56.298573 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883a645-676c-4e35-a73f-a555035427a1 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:56.332821 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23295a0e-8e08-4d20-8722-0cb62233be52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:56.333617 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23295a0e-8e08-4d20-8722-0cb62233be52 None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:56.333903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23295a0e-8e08-4d20-8722-0cb62233be52 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:56.334178 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23295a0e-8e08-4d20-8722-0cb62233be52 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:56.334887 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23295a0e-8e08-4d20-8722-0cb62233be52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:56.336371 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23295a0e-8e08-4d20-8722-0cb62233be52 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:56.357533 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5a8c7-ab03-4f76-9248-875841ef1ea7 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:56.359367 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 147/283] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 4 05:42:56 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:42:56.361031 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23295a0e-8e08-4d20-8722-0cb62233be52 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:56.398627 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a21f7d-1963-416b-861b-7995c5cf8b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:56.399827 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a21f7d-1963-416b-861b-7995c5cf8b51 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:56.400267 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a21f7d-1963-416b-861b-7995c5cf8b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:56.400538 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a21f7d-1963-416b-861b-7995c5cf8b51 None admin] PATH_INFO: `/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:56.401942 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a21f7d-1963-416b-861b-7995c5cf8b51 None admin] RBAC: Authorizing `identity:get_project(project_id=e7ac8d54998946acb55e1b10e3a9c30b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:56.403688 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a21f7d-1963-416b-861b-7995c5cf8b51 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:56.405639 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 137/284] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:42:56 2022] GET /identity/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:56.411594 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a21f7d-1963-416b-861b-7995c5cf8b51 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:56.506715 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:56.517895 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23295a0e-8e08-4d20-8722-0cb62233be52 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:56.544907 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a21f7d-1963-416b-861b-7995c5cf8b51 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:56.575270 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56caca2e-2cc2-4bbe-a85c-fd45afac4369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:56.575933 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56caca2e-2cc2-4bbe-a85c-fd45afac4369 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:56.576378 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56caca2e-2cc2-4bbe-a85c-fd45afac4369 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:56.576790 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56caca2e-2cc2-4bbe-a85c-fd45afac4369 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:56.577791 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56caca2e-2cc2-4bbe-a85c-fd45afac4369 None admin] RBAC: Adding query filter params (role.id=9fdc0a5e493c44c9add5859af9d4f394, user.id=de5cc4cf4b5d4fe89f20ca7073f1a2aa, scope.system=all) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:56.578244 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56caca2e-2cc2-4bbe-a85c-fd45afac4369 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:56.579948 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56caca2e-2cc2-4bbe-a85c-fd45afac4369 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:56.586654 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 148/285] 10.222.0.16 () {56 vars in 1308 bytes} [Mon Jul 4 05:42:56 2022] GET /identity/v3/role_assignments?user.id=de5cc4cf4b5d4fe89f20ca7073f1a2aa&scope.system=all&role.id=9fdc0a5e493c44c9add5859af9d4f394 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:56.589523 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707be558-de8c-43b4-b222-f1b3d72bb0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:56.590433 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707be558-de8c-43b4-b222-f1b3d72bb0a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:56.590715 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707be558-de8c-43b4-b222-f1b3d72bb0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:56.590989 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707be558-de8c-43b4-b222-f1b3d72bb0a1 None admin] PATH_INFO: `/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b/users/e87d080db2cc4c6d99dc8e33014378d4/roles/5357c224d018422198be89d0268ef167` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:56.593139 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707be558-de8c-43b4-b222-f1b3d72bb0a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=e7ac8d54998946acb55e1b10e3a9c30b, user_id=e87d080db2cc4c6d99dc8e33014378d4, role_id=5357c224d018422198be89d0268ef167)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:56.594647 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707be558-de8c-43b4-b222-f1b3d72bb0a1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:56.615327 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 138/286] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 4 05:42:56 2022] PUT /identity/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b/users/e87d080db2cc4c6d99dc8e33014378d4/roles/5357c224d018422198be89d0268ef167 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 05:42:56.831405 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb24b65-bd43-49d8-b8a7-ee2a3fd95071 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:56.832049 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb24b65-bd43-49d8-b8a7-ee2a3fd95071 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:56.832553 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb24b65-bd43-49d8-b8a7-ee2a3fd95071 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:56.834148 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 149/287] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:56.839490 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2d154-31f7-4f3a-bb79-474648f4647e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:56.839780 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2d154-31f7-4f3a-bb79-474648f4647e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:56.840057 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2d154-31f7-4f3a-bb79-474648f4647e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:56.861949 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-35c2d154-31f7-4f3a-bb79-474648f4647e None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:56.863192 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-35c2d154-31f7-4f3a-bb79-474648f4647e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:56.957863 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 139/288] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:56.992831 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb24b65-bd43-49d8-b8a7-ee2a3fd95071 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:56.997185 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:57.108647 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb24b65-bd43-49d8-b8a7-ee2a3fd95071 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:57.156061 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c81e8-1724-4a58-8b53-dc8e1e2e47bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:57.156873 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c81e8-1724-4a58-8b53-dc8e1e2e47bd None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:57.157148 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c81e8-1724-4a58-8b53-dc8e1e2e47bd None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:57.157418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c81e8-1724-4a58-8b53-dc8e1e2e47bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:57.171878 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c81e8-1724-4a58-8b53-dc8e1e2e47bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:42:57.180253 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-664c81e8-1724-4a58-8b53-dc8e1e2e47bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:42:57.180253 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:57.180253 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:57.180253 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:57.180253 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:57.180253 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:57.180253 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:57.180253 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:57.180253 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:57.180253 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:57.180253 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:57.180253 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:57.180253 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:42:57.180253 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:42:57.180253 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:42:57.180253 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:42:57.181150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:42:57.181150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:42:57.181150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:42:57.181150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:42:57.181150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:57.181150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:57.181150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:57.181150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:57.181150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:57.181150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:57.181150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:57.181150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:57.181150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:57.181150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:57.181150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:57.181150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:57.181940 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:57.181940 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:57.181940 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:57.181940 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:57.181940 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:42:57.181940 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:42:57.181940 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:42:57.181940 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:42:57.181940 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:42:57.181940 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:42:57.181940 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:42:57.181940 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:42:57.184429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 150/289] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:42:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:42:57.196326 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2d154-31f7-4f3a-bb79-474648f4647e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:57.286539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:57.331955 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2d154-31f7-4f3a-bb79-474648f4647e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:57.378251 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c57e7-dbf7-4f66-b0be-5d172bb41392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:57.379303 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c57e7-dbf7-4f66-b0be-5d172bb41392 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:57.379780 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c57e7-dbf7-4f66-b0be-5d172bb41392 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:57.380240 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c57e7-dbf7-4f66-b0be-5d172bb41392 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:57.381174 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c57e7-dbf7-4f66-b0be-5d172bb41392 None admin] RBAC: Adding query filter params (name=member) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:57.381667 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c57e7-dbf7-4f66-b0be-5d172bb41392 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:57.383314 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c57e7-dbf7-4f66-b0be-5d172bb41392 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:57.391766 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 140/290] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 4 05:42:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:57.397623 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c81e8-1724-4a58-8b53-dc8e1e2e47bd None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:57.474687 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:57.536209 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c81e8-1724-4a58-8b53-dc8e1e2e47bd None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:57.584849 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fb3cb-c005-4d9f-8b17-678d4832b902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:57.585792 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fb3cb-c005-4d9f-8b17-678d4832b902 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:57.586080 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fb3cb-c005-4d9f-8b17-678d4832b902 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:57.586359 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fb3cb-c005-4d9f-8b17-678d4832b902 None admin] PATH_INFO: `/v3/users/1556e94463af403c940bc8181cc17065` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:57.587591 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70fb3cb-c005-4d9f-8b17-678d4832b902 None admin] RBAC: Authorizing `identity:get_user(user_id=1556e94463af403c940bc8181cc17065)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:57.589057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70fb3cb-c005-4d9f-8b17-678d4832b902 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:57.590722 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 151/291] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:42:57 2022] GET /identity/v3/users/1556e94463af403c940bc8181cc17065 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:57.596333 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c57e7-dbf7-4f66-b0be-5d172bb41392 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:57.750401 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c57e7-dbf7-4f66-b0be-5d172bb41392 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:57.785227 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:57.794797 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3dcf1-f4c1-4eb1-8fe8-c18f9ff3c7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:57.795954 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3dcf1-f4c1-4eb1-8fe8-c18f9ff3c7be None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:57.796518 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3dcf1-f4c1-4eb1-8fe8-c18f9ff3c7be None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:57.797135 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3dcf1-f4c1-4eb1-8fe8-c18f9ff3c7be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:57.882917 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a3dcf1-f4c1-4eb1-8fe8-c18f9ff3c7be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:57.884456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a3dcf1-f4c1-4eb1-8fe8-c18f9ff3c7be None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:58.020114 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 141/292] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:42:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 04 05:42:58.028545 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fb3cb-c005-4d9f-8b17-678d4832b902 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:58.175063 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fb3cb-c005-4d9f-8b17-678d4832b902 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:58.216105 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:58.223424 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e078d86-2d08-4db2-94bb-2674457ba8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:58.224605 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e078d86-2d08-4db2-94bb-2674457ba8a6 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:58.225135 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e078d86-2d08-4db2-94bb-2674457ba8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:58.225695 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e078d86-2d08-4db2-94bb-2674457ba8a6 None admin] PATH_INFO: `/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:58.227010 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e078d86-2d08-4db2-94bb-2674457ba8a6 None admin] RBAC: Authorizing `identity:get_project(project_id=e7ac8d54998946acb55e1b10e3a9c30b)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:58.228632 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e078d86-2d08-4db2-94bb-2674457ba8a6 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:58.230808 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 152/293] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:42:58 2022] GET /identity/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:58.237052 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3dcf1-f4c1-4eb1-8fe8-c18f9ff3c7be None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:58.287299 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:58.383365 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3dcf1-f4c1-4eb1-8fe8-c18f9ff3c7be None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:58.430551 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3266c-c3ca-4e72-9b23-2ff92ef5ff42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:58.431214 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3266c-c3ca-4e72-9b23-2ff92ef5ff42 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:58.431510 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3266c-c3ca-4e72-9b23-2ff92ef5ff42 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:58.431776 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3266c-c3ca-4e72-9b23-2ff92ef5ff42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:58.432603 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3266c-c3ca-4e72-9b23-2ff92ef5ff42 None admin] RBAC: Adding query filter params (role.id=9fdc0a5e493c44c9add5859af9d4f394, scope.project.id=e7ac8d54998946acb55e1b10e3a9c30b, user.id=1556e94463af403c940bc8181cc17065) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:58.432907 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3266c-c3ca-4e72-9b23-2ff92ef5ff42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:58.434346 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3266c-c3ca-4e72-9b23-2ff92ef5ff42 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:58.440332 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 142/294] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:42:58 2022] GET /identity/v3/role_assignments?user.id=1556e94463af403c940bc8181cc17065&scope.project.id=e7ac8d54998946acb55e1b10e3a9c30b&role.id=9fdc0a5e493c44c9add5859af9d4f394 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:59.024536 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f903f85-fa8b-4f44-b928-6deffc22d486 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:59.025224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f903f85-fa8b-4f44-b928-6deffc22d486 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:59.025724 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f903f85-fa8b-4f44-b928-6deffc22d486 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:59.027613 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 153/295] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:59.032822 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd47d8-5057-4c6b-a658-567b0f6911ac None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:59.033546 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd47d8-5057-4c6b-a658-567b0f6911ac None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:59.033671 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd47d8-5057-4c6b-a658-567b0f6911ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:59.057180 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-96bd47d8-5057-4c6b-a658-567b0f6911ac None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:59.057399 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95893808-1f46-438d-8d43-6ac88339d5a7 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:59.057840 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95893808-1f46-438d-8d43-6ac88339d5a7 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:59.058256 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95893808-1f46-438d-8d43-6ac88339d5a7 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:59.058367 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-96bd47d8-5057-4c6b-a658-567b0f6911ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:59.059966 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 154/296] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:59.065058 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74a60b-d050-4ba8-84fe-29bdf051e319 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:59.065511 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74a60b-d050-4ba8-84fe-29bdf051e319 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:59.065928 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74a60b-d050-4ba8-84fe-29bdf051e319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:59.091100 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-de74a60b-d050-4ba8-84fe-29bdf051e319 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:59.092666 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-de74a60b-d050-4ba8-84fe-29bdf051e319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:59.154160 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 143/297] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 05:42:59.155630 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df183f5a-85d3-4cf2-83cd-25a4a9713ee5 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:59.155912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df183f5a-85d3-4cf2-83cd-25a4a9713ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:59.156180 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df183f5a-85d3-4cf2-83cd-25a4a9713ee5 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:59.157449 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 144/298] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:59.158460 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff69e8-eaae-4571-836e-9b6d20013b1f None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:59.158737 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff69e8-eaae-4571-836e-9b6d20013b1f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:59.159005 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff69e8-eaae-4571-836e-9b6d20013b1f None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:59.160218 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 145/299] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:42:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:42:59.165210 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181dc90-a02f-48da-89f4-936b66491fd2 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:59.165487 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181dc90-a02f-48da-89f4-936b66491fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:59.165758 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181dc90-a02f-48da-89f4-936b66491fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:59.171278 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 155/300] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 05:42:59.172392 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610654c5-c1aa-458f-8dd0-0e2668ccaf64 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:59.172673 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610654c5-c1aa-458f-8dd0-0e2668ccaf64 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:59.172943 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610654c5-c1aa-458f-8dd0-0e2668ccaf64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:59.185318 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-5181dc90-a02f-48da-89f4-936b66491fd2 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:59.186493 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5181dc90-a02f-48da-89f4-936b66491fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:59.192508 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-610654c5-c1aa-458f-8dd0-0e2668ccaf64 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:42:59.193648 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-610654c5-c1aa-458f-8dd0-0e2668ccaf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:42:59.202942 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:59.252799 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 146/301] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:59.256075 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181dc90-a02f-48da-89f4-936b66491fd2 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:59.258947 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 156/302] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:42:59.264166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610654c5-c1aa-458f-8dd0-0e2668ccaf64 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:59.324057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:59.351885 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181dc90-a02f-48da-89f4-936b66491fd2 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:59.363620 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610654c5-c1aa-458f-8dd0-0e2668ccaf64 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:59.385293 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b9b7c-9d7f-43f3-b663-7c002c3423b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:59.386081 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b9b7c-9d7f-43f3-b663-7c002c3423b8 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:59.386367 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b9b7c-9d7f-43f3-b663-7c002c3423b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:59.386645 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b9b7c-9d7f-43f3-b663-7c002c3423b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:59.387845 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b9b7c-9d7f-43f3-b663-7c002c3423b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:59.389317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b9b7c-9d7f-43f3-b663-7c002c3423b8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:59.391144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 147/303] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:42:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:59.396048 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b9b7c-9d7f-43f3-b663-7c002c3423b8 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:59.396585 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a180f9-03b7-4578-b218-0fda556ff1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:59.397386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a180f9-03b7-4578-b218-0fda556ff1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:59.397665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a180f9-03b7-4578-b218-0fda556ff1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:59.397939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a180f9-03b7-4578-b218-0fda556ff1a3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:59.407870 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a180f9-03b7-4578-b218-0fda556ff1a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:42:59.415682 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-26a180f9-03b7-4578-b218-0fda556ff1a3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 05:42:59.415682 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:59.415682 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:59.415682 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:59.415682 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:59.415682 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:59.415682 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:59.415682 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:59.415682 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:59.415682 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:59.415682 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:59.415682 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:59.415682 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:42:59.415682 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:42:59.415682 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:42:59.415682 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:42:59.416581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:42:59.416581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:42:59.416581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:42:59.416581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:42:59.416581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:59.416581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:59.416581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:59.416581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:59.416581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:59.416581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:59.416581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:59.416581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:59.416581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:59.416581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:59.416581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:59.416581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:59.417390 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:59.417390 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:59.417390 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:59.417390 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:59.417390 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:42:59.417390 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:42:59.417390 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:42:59.417390 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:42:59.417390 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:42:59.417390 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:42:59.417390 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 05:42:59.417390 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:42:59.417390 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 157/304] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:42:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:42:59.418026 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:59.418095 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a180f9-03b7-4578-b218-0fda556ff1a3 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:59.496916 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b9b7c-9d7f-43f3-b663-7c002c3423b8 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:59.514763 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a180f9-03b7-4578-b218-0fda556ff1a3 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:59.529790 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bf340-584a-4c1e-83fa-3b70d5322696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:59.530588 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bf340-584a-4c1e-83fa-3b70d5322696 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:59.530870 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bf340-584a-4c1e-83fa-3b70d5322696 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:59.531146 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bf340-584a-4c1e-83fa-3b70d5322696 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:59.536187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:59.542812 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6bf340-584a-4c1e-83fa-3b70d5322696 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:42:59.550132 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca00bc4-ef9c-4ed8-a625-c23a7b8c4277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:59.550635 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-ec6bf340-584a-4c1e-83fa-3b70d5322696 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:42:59.550635 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:59.550635 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:59.550635 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:59.550635 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:59.550635 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:59.550635 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:59.550635 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:59.550635 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:59.550635 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:59.550635 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:59.550635 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:59.550635 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:42:59.550635 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:42:59.550635 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:42:59.550635 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:42:59.551668 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:42:59.551668 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:42:59.551668 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:42:59.551668 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:42:59.551668 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:59.551668 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:59.551668 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:59.551668 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:59.551668 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:59.551668 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:59.551668 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:59.551668 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:59.551668 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:59.551668 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:59.551668 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:59.551668 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:59.552700 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:59.552700 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:59.552700 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:59.552700 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:59.552700 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:42:59.552700 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:42:59.552700 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:42:59.552700 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:42:59.552700 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:42:59.552700 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:42:59.552700 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:42:59.552700 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:42:59.553328 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca00bc4-ef9c-4ed8-a625-c23a7b8c4277 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:59.553328 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca00bc4-ef9c-4ed8-a625-c23a7b8c4277 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:59.553328 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca00bc4-ef9c-4ed8-a625-c23a7b8c4277 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:59.556982 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 148/305] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:42:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:42:59.557634 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bf340-584a-4c1e-83fa-3b70d5322696 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:59.563305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca00bc4-ef9c-4ed8-a625-c23a7b8c4277 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:42:59.571012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-9ca00bc4-ef9c-4ed8-a625-c23a7b8c4277 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 05:42:59.571012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:42:59.571012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:42:59.571012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:42:59.571012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:42:59.571012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:42:59.571012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:42:59.571012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:42:59.571012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:42:59.571012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:42:59.571012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:42:59.571012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:42:59.571012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:42:59.571012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:42:59.571012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:42:59.571012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:42:59.571919 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:42:59.571919 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:42:59.571919 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:42:59.571919 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:42:59.571919 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:42:59.571919 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:42:59.571919 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:42:59.571919 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:42:59.571919 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:42:59.571919 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:42:59.571919 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:42:59.571919 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:42:59.571919 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:42:59.571919 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:42:59.571919 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:42:59.571919 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:42:59.572700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:42:59.572700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:42:59.572700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:42:59.572700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:42:59.572700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:42:59.572700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:42:59.572700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:42:59.572700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:42:59.572700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:42:59.572700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:42:59.572700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 05:42:59.572700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:42:59.572700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 158/306] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:42:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:42:59.573814 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca00bc4-ef9c-4ed8-a625-c23a7b8c4277 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:59.639423 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:59.658533 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bf340-584a-4c1e-83fa-3b70d5322696 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:59.671190 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca00bc4-ef9c-4ed8-a625-c23a7b8c4277 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:59.690637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fe9ec-579d-46d3-bc37-0ac383754bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:59.691321 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fe9ec-579d-46d3-bc37-0ac383754bed None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:59.691600 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fe9ec-579d-46d3-bc37-0ac383754bed None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:59.691873 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fe9ec-579d-46d3-bc37-0ac383754bed None admin] PATH_INFO: `/v3/groups` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:59.692548 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07fe9ec-579d-46d3-bc37-0ac383754bed None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:59.694012 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07fe9ec-579d-46d3-bc37-0ac383754bed None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:59.704124 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0acf6-2026-4131-997e-a59b6ce0f6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:59.704876 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0acf6-2026-4131-997e-a59b6ce0f6dd None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:59.705226 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0acf6-2026-4131-997e-a59b6ce0f6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:59.705572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0acf6-2026-4131-997e-a59b6ce0f6dd None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:59.706358 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0acf6-2026-4131-997e-a59b6ce0f6dd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:59.706668 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0acf6-2026-4131-997e-a59b6ce0f6dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:59.708065 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0acf6-2026-4131-997e-a59b6ce0f6dd None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:59.709511 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 149/307] 10.222.0.16 () {60 vars in 1134 bytes} [Mon Jul 4 05:42:59 2022] POST /identity/v3/groups => generated 229 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:42:59.710202 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fe9ec-579d-46d3-bc37-0ac383754bed None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:59.722831 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 159/308] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 4 05:42:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:59.724158 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0acf6-2026-4131-997e-a59b6ce0f6dd None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:59.774167 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:59.824786 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fe9ec-579d-46d3-bc37-0ac383754bed None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:59.838759 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0acf6-2026-4131-997e-a59b6ce0f6dd None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:59.862870 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965403e-5731-423e-a9ce-7c256cf929c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:59.863969 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965403e-5731-423e-a9ce-7c256cf929c6 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:59.863969 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965403e-5731-423e-a9ce-7c256cf929c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:59.864146 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965403e-5731-423e-a9ce-7c256cf929c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:59.864860 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965403e-5731-423e-a9ce-7c256cf929c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:59.865165 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965403e-5731-423e-a9ce-7c256cf929c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:59.866560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965403e-5731-423e-a9ce-7c256cf929c6 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:59.875501 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 150/309] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 4 05:42:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:59.876301 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965403e-5731-423e-a9ce-7c256cf929c6 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:59.878868 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:42:59.880107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0aa90a-548e-48e4-873b-fe1fb11f5b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:42:59.880851 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0aa90a-548e-48e4-873b-fe1fb11f5b92 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:42:59.881188 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0aa90a-548e-48e4-873b-fe1fb11f5b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:42:59.881305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0aa90a-548e-48e4-873b-fe1fb11f5b92 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:42:59.882233 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0aa90a-548e-48e4-873b-fe1fb11f5b92 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:42:59.882536 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0aa90a-548e-48e4-873b-fe1fb11f5b92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:42:59.883944 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0aa90a-548e-48e4-873b-fe1fb11f5b92 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:42:59.895083 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 160/310] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 4 05:42:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:42:59.895969 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0aa90a-548e-48e4-873b-fe1fb11f5b92 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:42:59.986265 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965403e-5731-423e-a9ce-7c256cf929c6 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:42:59.999588 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0aa90a-548e-48e4-873b-fe1fb11f5b92 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:00.001972 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:00.023854 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d848c-5e33-452e-b7c0-c04ffc47f061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:00.024993 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d848c-5e33-452e-b7c0-c04ffc47f061 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:00.025272 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d848c-5e33-452e-b7c0-c04ffc47f061 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:00.025532 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d848c-5e33-452e-b7c0-c04ffc47f061 None admin] PATH_INFO: `/v3/users/e87d080db2cc4c6d99dc8e33014378d4` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:00.026881 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d848c-5e33-452e-b7c0-c04ffc47f061 None admin] RBAC: Authorizing `identity:get_user(user_id=e87d080db2cc4c6d99dc8e33014378d4)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:00.028277 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d848c-5e33-452e-b7c0-c04ffc47f061 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:00.034161 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 151/311] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:42:59 2022] GET /identity/v3/users/e87d080db2cc4c6d99dc8e33014378d4 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:00.034161 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d848c-5e33-452e-b7c0-c04ffc47f061 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:00.041623 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62449334-0da6-4427-8ff5-4e8f120a9b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:00.042936 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62449334-0da6-4427-8ff5-4e8f120a9b6e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:00.043551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62449334-0da6-4427-8ff5-4e8f120a9b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:00.043844 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62449334-0da6-4427-8ff5-4e8f120a9b6e None admin] PATH_INFO: `/v3/users/de5cc4cf4b5d4fe89f20ca7073f1a2aa` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:00.045396 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62449334-0da6-4427-8ff5-4e8f120a9b6e None admin] RBAC: Authorizing `identity:get_user(user_id=de5cc4cf4b5d4fe89f20ca7073f1a2aa)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:00.047453 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62449334-0da6-4427-8ff5-4e8f120a9b6e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:00.054149 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 161/312] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:42:59 2022] GET /identity/v3/users/de5cc4cf4b5d4fe89f20ca7073f1a2aa => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:00.054149 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62449334-0da6-4427-8ff5-4e8f120a9b6e None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:00.099530 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:00.131552 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d848c-5e33-452e-b7c0-c04ffc47f061 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:00.167727 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094a6ac-3e77-48ea-b205-d67796f81f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:00.168362 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62449334-0da6-4427-8ff5-4e8f120a9b6e None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:00.168554 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094a6ac-3e77-48ea-b205-d67796f81f3b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:00.168796 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094a6ac-3e77-48ea-b205-d67796f81f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:00.169103 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094a6ac-3e77-48ea-b205-d67796f81f3b None admin] PATH_INFO: `/v3/users/4ae9479535a14fffbfde51e15bd208a7` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:00.183833 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8094a6ac-3e77-48ea-b205-d67796f81f3b None admin] RBAC: Authorizing `identity:get_user(user_id=4ae9479535a14fffbfde51e15bd208a7)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:00.185343 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8094a6ac-3e77-48ea-b205-d67796f81f3b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:00.191347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 152/313] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:43:00 2022] GET /identity/v3/users/4ae9479535a14fffbfde51e15bd208a7 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:00.191347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094a6ac-3e77-48ea-b205-d67796f81f3b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:00.208886 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118f122-538b-4d40-a963-8c28d33440ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:00.209787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118f122-538b-4d40-a963-8c28d33440ec None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:00.210071 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118f122-538b-4d40-a963-8c28d33440ec None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:00.210457 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118f122-538b-4d40-a963-8c28d33440ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:00.253294 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:00.281737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118f122-538b-4d40-a963-8c28d33440ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:00.283269 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118f122-538b-4d40-a963-8c28d33440ec None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:00.296153 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094a6ac-3e77-48ea-b205-d67796f81f3b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:00.325228 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:00.333446 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee7be3-961e-4e92-bec0-0e155cc4dd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:00.334306 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee7be3-961e-4e92-bec0-0e155cc4dd2b None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:00.334582 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee7be3-961e-4e92-bec0-0e155cc4dd2b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:00.334851 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee7be3-961e-4e92-bec0-0e155cc4dd2b None admin] PATH_INFO: `/v3/system/users/de5cc4cf4b5d4fe89f20ca7073f1a2aa/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:00.336495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee7be3-961e-4e92-bec0-0e155cc4dd2b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=de5cc4cf4b5d4fe89f20ca7073f1a2aa, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:00.337893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee7be3-961e-4e92-bec0-0e155cc4dd2b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:00.348003 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 153/314] 10.222.0.16 () {58 vars in 1334 bytes} [Mon Jul 4 05:43:00 2022] PUT /identity/v3/system/users/de5cc4cf4b5d4fe89f20ca7073f1a2aa/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:43:00.348609 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee7be3-961e-4e92-bec0-0e155cc4dd2b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:00.404114 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 162/315] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:43:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 05:43:00.410181 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118f122-538b-4d40-a963-8c28d33440ec None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:00.476628 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee7be3-961e-4e92-bec0-0e155cc4dd2b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:00.505161 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:00.514280 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2560a7e-2386-452f-b75b-56f736c17e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:00.515260 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2560a7e-2386-452f-b75b-56f736c17e59 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:00.515757 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2560a7e-2386-452f-b75b-56f736c17e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:00.516254 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2560a7e-2386-452f-b75b-56f736c17e59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:00.517274 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2560a7e-2386-452f-b75b-56f736c17e59 None admin] RBAC: Adding query filter params (role.id=5357c224d018422198be89d0268ef167, user.id=4ae9479535a14fffbfde51e15bd208a7, scope.system=all) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:00.517778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2560a7e-2386-452f-b75b-56f736c17e59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:00.519446 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2560a7e-2386-452f-b75b-56f736c17e59 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:00.525240 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 154/316] 10.222.0.16 () {56 vars in 1308 bytes} [Mon Jul 4 05:43:00 2022] GET /identity/v3/role_assignments?user.id=4ae9479535a14fffbfde51e15bd208a7&scope.system=all&role.id=5357c224d018422198be89d0268ef167 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:00.552730 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118f122-538b-4d40-a963-8c28d33440ec None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:00.591380 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db325a-2517-46a6-8982-ea32618c5841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:00.592261 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db325a-2517-46a6-8982-ea32618c5841 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:00.592541 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db325a-2517-46a6-8982-ea32618c5841 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:00.592818 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db325a-2517-46a6-8982-ea32618c5841 None admin] PATH_INFO: `/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:00.594055 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db325a-2517-46a6-8982-ea32618c5841 None admin] RBAC: Authorizing `identity:get_project(project_id=e7ac8d54998946acb55e1b10e3a9c30b)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:00.595672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db325a-2517-46a6-8982-ea32618c5841 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:00.602549 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 163/317] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:43:00 2022] GET /identity/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:43:00.604135 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2560a7e-2386-452f-b75b-56f736c17e59 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:00.670188 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:00.717042 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2560a7e-2386-452f-b75b-56f736c17e59 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:00.750578 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d350e-6d0a-421d-94e7-e7c5ee5b4cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:00.751217 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d350e-6d0a-421d-94e7-e7c5ee5b4cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:00.751516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d350e-6d0a-421d-94e7-e7c5ee5b4cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:00.751792 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d350e-6d0a-421d-94e7-e7c5ee5b4cd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:00.752659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d350e-6d0a-421d-94e7-e7c5ee5b4cd3 None admin] RBAC: Adding query filter params (role.id=5357c224d018422198be89d0268ef167, scope.project.id=e7ac8d54998946acb55e1b10e3a9c30b, user.id=e87d080db2cc4c6d99dc8e33014378d4) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:00.752973 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d350e-6d0a-421d-94e7-e7c5ee5b4cd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:00.754418 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d350e-6d0a-421d-94e7-e7c5ee5b4cd3 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:00.760651 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 155/318] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:43:00 2022] GET /identity/v3/role_assignments?user.id=e87d080db2cc4c6d99dc8e33014378d4&scope.project.id=e7ac8d54998946acb55e1b10e3a9c30b&role.id=5357c224d018422198be89d0268ef167 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:01.741890 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52e9ef-f7b5-4317-b237-815bdd9e0812 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:01.742463 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52e9ef-f7b5-4317-b237-815bdd9e0812 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:01.742463 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52e9ef-f7b5-4317-b237-815bdd9e0812 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:01.743997 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 164/319] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:01.749755 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded459e-6087-491a-bbd7-9ff1c2c0333e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:01.750299 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded459e-6087-491a-bbd7-9ff1c2c0333e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:01.750376 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded459e-6087-491a-bbd7-9ff1c2c0333e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:01.768416 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9ded459e-6087-491a-bbd7-9ff1c2c0333e None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:01.769594 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9ded459e-6087-491a-bbd7-9ff1c2c0333e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:01.840578 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 156/320] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:01.863907 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52e9ef-f7b5-4317-b237-815bdd9e0812 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:01.970061 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52e9ef-f7b5-4317-b237-815bdd9e0812 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:02.003980 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a2ebe-7325-4b77-9ab3-83e381a8c2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:02.004785 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a2ebe-7325-4b77-9ab3-83e381a8c2b8 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:02.005062 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a2ebe-7325-4b77-9ab3-83e381a8c2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:02.005335 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a2ebe-7325-4b77-9ab3-83e381a8c2b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:02.006523 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a2ebe-7325-4b77-9ab3-83e381a8c2b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:02.007998 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a2ebe-7325-4b77-9ab3-83e381a8c2b8 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:02.009785 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 165/321] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:02.015298 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded459e-6087-491a-bbd7-9ff1c2c0333e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:02.065626 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:02.117458 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded459e-6087-491a-bbd7-9ff1c2c0333e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:02.152683 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64267f44-4e99-4c03-8f79-da7904846c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:02.153377 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64267f44-4e99-4c03-8f79-da7904846c80 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:02.153665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64267f44-4e99-4c03-8f79-da7904846c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:02.153939 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64267f44-4e99-4c03-8f79-da7904846c80 None admin] PATH_INFO: `/v3/groups` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:02.154623 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64267f44-4e99-4c03-8f79-da7904846c80 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:02.156091 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64267f44-4e99-4c03-8f79-da7904846c80 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:02.178279 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 157/322] 10.222.0.16 () {60 vars in 1134 bytes} [Mon Jul 4 05:43:02 2022] POST /identity/v3/groups => generated 226 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:43:02.423440 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22dde75-77f1-4a13-8e44-3bceb0dc825f None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:02.423743 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22dde75-77f1-4a13-8e44-3bceb0dc825f None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:02.423914 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22dde75-77f1-4a13-8e44-3bceb0dc825f None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:02.425560 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 166/323] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:02.430737 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66071c-2c70-45ca-9fa6-4535ae4b3116 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:02.431017 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66071c-2c70-45ca-9fa6-4535ae4b3116 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:02.431327 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66071c-2c70-45ca-9fa6-4535ae4b3116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:02.448569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6e66071c-2c70-45ca-9fa6-4535ae4b3116 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:02.450984 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6e66071c-2c70-45ca-9fa6-4535ae4b3116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:02.522463 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 158/324] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:02.549111 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22dde75-77f1-4a13-8e44-3bceb0dc825f None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:02.555944 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31ff8e-4319-4d88-8618-92ca10962020 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:02.556218 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31ff8e-4319-4d88-8618-92ca10962020 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:02.556488 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31ff8e-4319-4d88-8618-92ca10962020 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:02.558025 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 159/325] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:02.561008 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:02.564435 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d93b9-7d26-4193-aa73-1c1e0bc2e781 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:02.564822 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d93b9-7d26-4193-aa73-1c1e0bc2e781 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:02.564993 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d93b9-7d26-4193-aa73-1c1e0bc2e781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:02.587149 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-3c4d93b9-7d26-4193-aa73-1c1e0bc2e781 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:02.588370 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3c4d93b9-7d26-4193-aa73-1c1e0bc2e781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:02.626918 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:02.676050 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 160/326] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 05:43:02.685850 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22dde75-77f1-4a13-8e44-3bceb0dc825f None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:02.697864 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d93b9-7d26-4193-aa73-1c1e0bc2e781 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:02.727324 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a538d90-4cc5-4479-b9e1-c9e2570947ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:02.728160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a538d90-4cc5-4479-b9e1-c9e2570947ad None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:02.728440 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a538d90-4cc5-4479-b9e1-c9e2570947ad None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:02.728715 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a538d90-4cc5-4479-b9e1-c9e2570947ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:02.747208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a538d90-4cc5-4479-b9e1-c9e2570947ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:02.748889 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-4a538d90-4cc5-4479-b9e1-c9e2570947ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:43:02.748889 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:02.748889 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:02.748889 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:02.748889 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:02.748889 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:02.748889 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:02.748889 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:02.748889 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:02.748889 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:02.748889 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:02.748889 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:02.748889 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:02.748889 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:02.748889 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:02.748889 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:02.749771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:02.749771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:02.749771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:02.749771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:02.749771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:02.749771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:02.749771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:02.749771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:02.749771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:02.749771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:02.749771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:02.749771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:02.749771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:02.749771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:02.749771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:02.749771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:02.751014 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:02.751014 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:02.751014 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:02.751014 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:02.751014 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:02.751014 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:02.751014 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:02.751014 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:02.751014 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:02.751014 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:02.751014 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:43:02.751014 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:02.751014 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 167/327] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:43:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:02.756455 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a538d90-4cc5-4479-b9e1-c9e2570947ad None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:02.824893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d93b9-7d26-4193-aa73-1c1e0bc2e781 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:02.845159 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:02.870491 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d808e-384c-4345-984b-ddc91a2848b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:02.871370 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d808e-384c-4345-984b-ddc91a2848b7 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:02.871625 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d808e-384c-4345-984b-ddc91a2848b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:02.871894 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d808e-384c-4345-984b-ddc91a2848b7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:02.883445 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d808e-384c-4345-984b-ddc91a2848b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:02.886341 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a538d90-4cc5-4479-b9e1-c9e2570947ad None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:02.891487 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-374d808e-384c-4345-984b-ddc91a2848b7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 05:43:02.891487 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:02.891487 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:02.891487 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:02.891487 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:02.891487 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:02.891487 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:02.891487 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:02.891487 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:02.891487 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:02.891487 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:02.891487 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:02.891487 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:02.891487 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:02.891487 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:02.891487 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:02.892373 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:02.892373 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:02.892373 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:02.892373 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:02.892373 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:02.892373 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:02.892373 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:02.892373 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:02.892373 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:02.892373 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:02.892373 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:02.892373 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:02.892373 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:02.892373 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:02.892373 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:02.892373 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:02.893581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:02.893581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:02.893581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:02.893581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:02.893581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:02.893581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:02.893581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:02.893581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:02.893581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:02.893581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:02.893581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 05:43:02.893581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:02.893581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 161/328] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:43:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:43:02.898964 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d808e-384c-4345-984b-ddc91a2848b7 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:02.928189 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ecf2c-0c8b-419d-8b94-9913edf3a6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:02.929230 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ecf2c-0c8b-419d-8b94-9913edf3a6c3 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:02.929713 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ecf2c-0c8b-419d-8b94-9913edf3a6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:02.930186 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ecf2c-0c8b-419d-8b94-9913edf3a6c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:02.931157 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ecf2c-0c8b-419d-8b94-9913edf3a6c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:02.931729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ecf2c-0c8b-419d-8b94-9913edf3a6c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:02.933349 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ecf2c-0c8b-419d-8b94-9913edf3a6c3 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:02.939554 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:02.945237 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 168/329] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 4 05:43:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:43:02.952771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ecf2c-0c8b-419d-8b94-9913edf3a6c3 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:03.019484 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d808e-384c-4345-984b-ddc91a2848b7 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:03.063586 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b5454-b9d5-43eb-a95e-3e1179bcbfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:03.064263 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b5454-b9d5-43eb-a95e-3e1179bcbfea None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:03.064541 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b5454-b9d5-43eb-a95e-3e1179bcbfea None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:03.064811 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b5454-b9d5-43eb-a95e-3e1179bcbfea None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:03.065551 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b5454-b9d5-43eb-a95e-3e1179bcbfea None admin] RBAC: Adding query filter params (name=reader) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:03.065847 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b5454-b9d5-43eb-a95e-3e1179bcbfea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:03.067502 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b5454-b9d5-43eb-a95e-3e1179bcbfea None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:03.076648 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ecf2c-0c8b-419d-8b94-9913edf3a6c3 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:03.077221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 162/330] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 4 05:43:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:43:03.084081 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b5454-b9d5-43eb-a95e-3e1179bcbfea None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:03.119049 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:03.128418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4efc1-450d-4ab1-9ec2-778a92d2f56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:03.129310 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4efc1-450d-4ab1-9ec2-778a92d2f56e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:03.129591 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4efc1-450d-4ab1-9ec2-778a92d2f56e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:03.129863 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4efc1-450d-4ab1-9ec2-778a92d2f56e None admin] PATH_INFO: `/v3/users/de5cc4cf4b5d4fe89f20ca7073f1a2aa` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:03.131321 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4efc1-450d-4ab1-9ec2-778a92d2f56e None admin] RBAC: Authorizing `identity:get_user(user_id=de5cc4cf4b5d4fe89f20ca7073f1a2aa)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:03.133669 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4efc1-450d-4ab1-9ec2-778a92d2f56e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:03.135639 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 169/331] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:43:02 2022] GET /identity/v3/users/de5cc4cf4b5d4fe89f20ca7073f1a2aa => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:03.145214 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4efc1-450d-4ab1-9ec2-778a92d2f56e None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:03.201304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:03.212056 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b5454-b9d5-43eb-a95e-3e1179bcbfea None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:03.262740 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41461e11-d063-4bc2-a1de-c5de4ca4b056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:03.264054 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41461e11-d063-4bc2-a1de-c5de4ca4b056 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:03.265200 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41461e11-d063-4bc2-a1de-c5de4ca4b056 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:03.265829 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41461e11-d063-4bc2-a1de-c5de4ca4b056 None admin] PATH_INFO: `/v3/users/4ae9479535a14fffbfde51e15bd208a7` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:03.269257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41461e11-d063-4bc2-a1de-c5de4ca4b056 None admin] RBAC: Authorizing `identity:get_user(user_id=4ae9479535a14fffbfde51e15bd208a7)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:03.270729 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41461e11-d063-4bc2-a1de-c5de4ca4b056 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:03.272723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 163/332] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:43:03 2022] GET /identity/v3/users/4ae9479535a14fffbfde51e15bd208a7 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:03.273735 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4efc1-450d-4ab1-9ec2-778a92d2f56e None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:03.278406 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41461e11-d063-4bc2-a1de-c5de4ca4b056 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:03.320619 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d0441-d619-4d3e-9bd6-aafc675abf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:03.321651 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d0441-d619-4d3e-9bd6-aafc675abf7c None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:03.322403 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d0441-d619-4d3e-9bd6-aafc675abf7c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:03.323400 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d0441-d619-4d3e-9bd6-aafc675abf7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:03.324423 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d0441-d619-4d3e-9bd6-aafc675abf7c None admin] RBAC: Adding query filter params (role.id=9fdc0a5e493c44c9add5859af9d4f394, user.id=de5cc4cf4b5d4fe89f20ca7073f1a2aa, scope.system=all) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:03.325334 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d0441-d619-4d3e-9bd6-aafc675abf7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:03.327662 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d0441-d619-4d3e-9bd6-aafc675abf7c None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:03.343748 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 170/333] 10.222.0.16 () {56 vars in 1308 bytes} [Mon Jul 4 05:43:03 2022] GET /identity/v3/role_assignments?user.id=de5cc4cf4b5d4fe89f20ca7073f1a2aa&scope.system=all&role.id=9fdc0a5e493c44c9add5859af9d4f394 => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:03.395514 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41461e11-d063-4bc2-a1de-c5de4ca4b056 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:03.438175 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d3646-27be-4f5c-85e3-404395610876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:03.439064 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d3646-27be-4f5c-85e3-404395610876 None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:03.439379 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d3646-27be-4f5c-85e3-404395610876 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:03.439711 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d3646-27be-4f5c-85e3-404395610876 None admin] PATH_INFO: `/v3/system/users/4ae9479535a14fffbfde51e15bd208a7/roles/5357c224d018422198be89d0268ef167` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:03.441520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d3646-27be-4f5c-85e3-404395610876 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4ae9479535a14fffbfde51e15bd208a7, role_id=5357c224d018422198be89d0268ef167)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:03.443005 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d3646-27be-4f5c-85e3-404395610876 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:03.465241 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 164/334] 10.222.0.16 () {58 vars in 1334 bytes} [Mon Jul 4 05:43:03 2022] PUT /identity/v3/system/users/4ae9479535a14fffbfde51e15bd208a7/roles/5357c224d018422198be89d0268ef167 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:43:04.770723 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51ff04-6592-4ad3-b78a-aeb83b623a3c None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:04.771256 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51ff04-6592-4ad3-b78a-aeb83b623a3c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:04.771332 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51ff04-6592-4ad3-b78a-aeb83b623a3c None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:04.772855 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 171/335] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:04.778405 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23369d21-22a5-4ef1-b3dd-6e5d0d09408d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:04.778839 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23369d21-22a5-4ef1-b3dd-6e5d0d09408d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:04.778912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23369d21-22a5-4ef1-b3dd-6e5d0d09408d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:04.803525 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-23369d21-22a5-4ef1-b3dd-6e5d0d09408d None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:04.804633 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-23369d21-22a5-4ef1-b3dd-6e5d0d09408d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:04.823556 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:04.884676 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 165/336] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 05:43:04.908011 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51ff04-6592-4ad3-b78a-aeb83b623a3c None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:04.967099 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a656b03-ef96-4dec-902f-bb9d19857fa4 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:04.967433 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a656b03-ef96-4dec-902f-bb9d19857fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:04.967675 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a656b03-ef96-4dec-902f-bb9d19857fa4 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:04.969076 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 166/337] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:43:04.974067 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f4be8-846c-4e65-b02b-a1bb1e704942 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:04.974352 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f4be8-846c-4e65-b02b-a1bb1e704942 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:04.974627 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f4be8-846c-4e65-b02b-a1bb1e704942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:04.986747 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:05.007525 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9b9f4be8-846c-4e65-b02b-a1bb1e704942 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:05.008745 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9b9f4be8-846c-4e65-b02b-a1bb1e704942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:05.089094 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51ff04-6592-4ad3-b78a-aeb83b623a3c None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:05.098439 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 167/338] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 05:43:05.137567 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f4be8-846c-4e65-b02b-a1bb1e704942 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:05.159492 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4c43d-3f8b-4bef-be43-46b442cd0543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:05.160332 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4c43d-3f8b-4bef-be43-46b442cd0543 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:05.160611 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4c43d-3f8b-4bef-be43-46b442cd0543 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:05.160883 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4c43d-3f8b-4bef-be43-46b442cd0543 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:05.192105 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4c43d-3f8b-4bef-be43-46b442cd0543 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:05.200420 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-89b4c43d-3f8b-4bef-be43-46b442cd0543 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 05:43:05.200420 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:05.200420 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:05.200420 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:05.200420 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:05.200420 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:05.200420 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:05.200420 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:05.200420 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:05.200420 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:05.200420 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:05.200420 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:05.200420 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:05.200420 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:05.200420 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:05.200420 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:05.201284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:05.201284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:05.201284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:05.201284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:05.201284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:05.201284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:05.201284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:05.201284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:05.201284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:05.201284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:05.201284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:05.201284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:05.201284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:05.201284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:05.201284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:05.201284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:05.202057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:05.202057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:05.202057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:05.202057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:05.202057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:05.202057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:05.202057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:05.202057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:05.202057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:05.202057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:05.202057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 05:43:05.202057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:05.207256 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 172/339] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 4 05:43:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:05.220293 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4c43d-3f8b-4bef-be43-46b442cd0543 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:05.246081 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:05.263509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f4be8-846c-4e65-b02b-a1bb1e704942 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:05.300377 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ceeaac-8303-4d9f-9d62-7c8d48d83af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:05.301341 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ceeaac-8303-4d9f-9d62-7c8d48d83af7 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:05.301624 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ceeaac-8303-4d9f-9d62-7c8d48d83af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:05.301899 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ceeaac-8303-4d9f-9d62-7c8d48d83af7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:05.313983 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ceeaac-8303-4d9f-9d62-7c8d48d83af7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:05.321937 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-11ceeaac-8303-4d9f-9d62-7c8d48d83af7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:43:05.321937 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:05.321937 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:05.321937 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:05.321937 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:05.321937 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:05.321937 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:05.321937 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:05.321937 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:05.321937 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:05.321937 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:05.321937 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:05.321937 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:05.321937 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:05.321937 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:05.321937 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:05.322773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:05.322773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:05.322773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:05.322773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:05.322773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:05.322773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:05.322773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:05.322773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:05.322773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:05.322773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:05.322773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:05.322773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:05.322773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:05.322773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:05.322773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:05.322773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:05.323573 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:05.323573 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:05.323573 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:05.323573 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:05.323573 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:05.323573 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:05.323573 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:05.323573 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:05.323573 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:05.323573 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:05.323573 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:43:05.323573 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:05.323573 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 168/340] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:43:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:05.329992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ceeaac-8303-4d9f-9d62-7c8d48d83af7 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:05.434155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4c43d-3f8b-4bef-be43-46b442cd0543 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:05.441827 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ceeaac-8303-4d9f-9d62-7c8d48d83af7 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:05.462437 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:05.476955 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bbf4a-d7a9-4a61-8008-eae5ebe9f6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:05.477628 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bbf4a-d7a9-4a61-8008-eae5ebe9f6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:05.477911 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bbf4a-d7a9-4a61-8008-eae5ebe9f6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:05.478183 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bbf4a-d7a9-4a61-8008-eae5ebe9f6a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:05.478935 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7bbf4a-d7a9-4a61-8008-eae5ebe9f6a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:05.480233 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7bbf4a-d7a9-4a61-8008-eae5ebe9f6a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:05.481775 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7bbf4a-d7a9-4a61-8008-eae5ebe9f6a3 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:05.490901 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 169/341] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 4 05:43:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:05.495893 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4295518-5179-4108-afec-c044cca4b359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:05.496579 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4295518-5179-4108-afec-c044cca4b359 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:05.496925 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4295518-5179-4108-afec-c044cca4b359 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:05.497201 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4295518-5179-4108-afec-c044cca4b359 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:05.497957 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4295518-5179-4108-afec-c044cca4b359 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:05.498576 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4295518-5179-4108-afec-c044cca4b359 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:05.499982 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4295518-5179-4108-afec-c044cca4b359 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:05.507918 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bbf4a-d7a9-4a61-8008-eae5ebe9f6a3 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:05.517456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 173/342] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:43:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:05.517965 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:05.523318 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4295518-5179-4108-afec-c044cca4b359 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:05.628854 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bbf4a-d7a9-4a61-8008-eae5ebe9f6a3 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:05.663077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb10e6-f87f-4936-837d-70f4ce80b5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:05.664070 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb10e6-f87f-4936-837d-70f4ce80b5a4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:05.664563 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb10e6-f87f-4936-837d-70f4ce80b5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:05.664973 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb10e6-f87f-4936-837d-70f4ce80b5a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:05.706398 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4295518-5179-4108-afec-c044cca4b359 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:05.741989 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb10e6-f87f-4936-837d-70f4ce80b5a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:05.743863 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb10e6-f87f-4936-837d-70f4ce80b5a4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:05.755526 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:05.775924 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc988ab-d296-4b53-81a6-a68a4ba5dd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:05.776615 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc988ab-d296-4b53-81a6-a68a4ba5dd0b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:05.776883 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc988ab-d296-4b53-81a6-a68a4ba5dd0b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:05.777213 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc988ab-d296-4b53-81a6-a68a4ba5dd0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:05.851705 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:05.855494 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 170/343] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:43:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 05:43:05.868044 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb10e6-f87f-4936-837d-70f4ce80b5a4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:05.923109 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc988ab-d296-4b53-81a6-a68a4ba5dd0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:05.924608 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc988ab-d296-4b53-81a6-a68a4ba5dd0b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:06.032945 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb10e6-f87f-4936-837d-70f4ce80b5a4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:06.046900 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:06.081152 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 174/344] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:43:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 05:43:06.089551 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5b4bf-e308-446e-91ec-dbdb31f12a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:06.090867 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5b4bf-e308-446e-91ec-dbdb31f12a70 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:06.094821 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5b4bf-e308-446e-91ec-dbdb31f12a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:06.095395 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5b4bf-e308-446e-91ec-dbdb31f12a70 None admin] PATH_INFO: `/v3/projects/3811ac7a7eab4e3e9040f45371523192` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:06.096991 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5b4bf-e308-446e-91ec-dbdb31f12a70 None admin] RBAC: Authorizing `identity:get_project(project_id=3811ac7a7eab4e3e9040f45371523192)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:06.098683 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5b4bf-e308-446e-91ec-dbdb31f12a70 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:06.100976 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 171/345] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:43:05 2022] GET /identity/v3/projects/3811ac7a7eab4e3e9040f45371523192 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:06.103592 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc988ab-d296-4b53-81a6-a68a4ba5dd0b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:06.105997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5b4bf-e308-446e-91ec-dbdb31f12a70 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:06.251545 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:06.293600 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc988ab-d296-4b53-81a6-a68a4ba5dd0b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:06.307875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5b4bf-e308-446e-91ec-dbdb31f12a70 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:06.346858 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dff443-4826-4a84-955f-15279c2831e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:06.348092 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dff443-4826-4a84-955f-15279c2831e4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:06.348591 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dff443-4826-4a84-955f-15279c2831e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:06.349076 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dff443-4826-4a84-955f-15279c2831e4 None admin] PATH_INFO: `/v3/groups/eb0b5be77d6246ec9d0b5ebcdbca517a` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:06.358502 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7bcf1-c4c3-4ed7-a8c1-97a40807345d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:06.359420 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7bcf1-c4c3-4ed7-a8c1-97a40807345d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:06.359708 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7bcf1-c4c3-4ed7-a8c1-97a40807345d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:06.359977 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7bcf1-c4c3-4ed7-a8c1-97a40807345d None admin] PATH_INFO: `/v3/projects/3811ac7a7eab4e3e9040f45371523192` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:06.360764 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dff443-4826-4a84-955f-15279c2831e4 None admin] RBAC: Authorizing `identity:get_group(group_id=eb0b5be77d6246ec9d0b5ebcdbca517a)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:06.361185 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c7bcf1-c4c3-4ed7-a8c1-97a40807345d None admin] RBAC: Authorizing `identity:get_project(project_id=3811ac7a7eab4e3e9040f45371523192)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:06.362644 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c7bcf1-c4c3-4ed7-a8c1-97a40807345d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:06.362751 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dff443-4826-4a84-955f-15279c2831e4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:06.364743 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 175/346] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:43:06 2022] GET /identity/v3/projects/3811ac7a7eab4e3e9040f45371523192 => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:06.365139 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 172/347] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 4 05:43:06 2022] GET /identity/v3/groups/eb0b5be77d6246ec9d0b5ebcdbca517a => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:06.365910 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceff887-4827-4d21-be5c-a25fb977f88e None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:06.366195 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceff887-4827-4d21-be5c-a25fb977f88e None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:06.366473 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceff887-4827-4d21-be5c-a25fb977f88e None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:06.371292 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 176/348] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:06.371435 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c20d1-2693-4330-941a-115368d26618 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:06.371435 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c20d1-2693-4330-941a-115368d26618 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:06.371435 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c20d1-2693-4330-941a-115368d26618 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:06.371435 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 173/349] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:06.374837 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c007c-27b5-45dc-bb45-4e59f2e1b608 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:06.375140 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c007c-27b5-45dc-bb45-4e59f2e1b608 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:06.375447 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c007c-27b5-45dc-bb45-4e59f2e1b608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:06.377643 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c20d1-2693-4330-941a-115368d26618 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:06.406022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-9c6c007c-27b5-45dc-bb45-4e59f2e1b608 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:06.407289 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9c6c007c-27b5-45dc-bb45-4e59f2e1b608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:06.436757 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:06.506340 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 177/350] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:06.507397 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c007c-27b5-45dc-bb45-4e59f2e1b608 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:06.532449 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c20d1-2693-4330-941a-115368d26618 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:06.582318 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4812a-1d8e-41ab-a270-a05cae6039ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:06.583784 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4812a-1d8e-41ab-a270-a05cae6039ba None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:06.584477 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4812a-1d8e-41ab-a270-a05cae6039ba None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:06.585196 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4812a-1d8e-41ab-a270-a05cae6039ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:06.587144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b4812a-1d8e-41ab-a270-a05cae6039ba None admin] RBAC: Adding query filter params (group.id=eb0b5be77d6246ec9d0b5ebcdbca517a, role.id=9fdc0a5e493c44c9add5859af9d4f394, scope.project.id=3811ac7a7eab4e3e9040f45371523192) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:06.587787 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b4812a-1d8e-41ab-a270-a05cae6039ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:06.590193 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b4812a-1d8e-41ab-a270-a05cae6039ba None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:06.597516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 174/351] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jul 4 05:43:06 2022] GET /identity/v3/role_assignments?group.id=eb0b5be77d6246ec9d0b5ebcdbca517a&scope.project.id=3811ac7a7eab4e3e9040f45371523192&role.id=9fdc0a5e493c44c9add5859af9d4f394 => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:06.599253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5f7c9-2d79-444c-99cd-bb631d434b62 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:06.599743 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5f7c9-2d79-444c-99cd-bb631d434b62 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:06.600235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5f7c9-2d79-444c-99cd-bb631d434b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:06.628183 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:06.642249 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-0fc5f7c9-2d79-444c-99cd-bb631d434b62 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:06.643512 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0fc5f7c9-2d79-444c-99cd-bb631d434b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:06.671237 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c007c-27b5-45dc-bb45-4e59f2e1b608 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:06.725655 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cebb7-8c2a-4496-8770-042033e59afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:06.726708 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cebb7-8c2a-4496-8770-042033e59afa None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:06.726992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cebb7-8c2a-4496-8770-042033e59afa None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:06.727300 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cebb7-8c2a-4496-8770-042033e59afa None admin] PATH_INFO: `/v3/groups/eb0b5be77d6246ec9d0b5ebcdbca517a` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:06.731992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40cebb7-8c2a-4496-8770-042033e59afa None admin] RBAC: Authorizing `identity:get_group(group_id=eb0b5be77d6246ec9d0b5ebcdbca517a)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:06.736386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40cebb7-8c2a-4496-8770-042033e59afa None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:06.741570 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 178/352] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 4 05:43:06 2022] GET /identity/v3/groups/eb0b5be77d6246ec9d0b5ebcdbca517a => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:06.742698 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cebb7-8c2a-4496-8770-042033e59afa None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:06.769936 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 175/353] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:06.771205 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5f7c9-2d79-444c-99cd-bb631d434b62 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:06.835876 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:06.918077 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cebb7-8c2a-4496-8770-042033e59afa None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:06.940347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5f7c9-2d79-444c-99cd-bb631d434b62 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:06.968319 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004c7e8-f761-4fb1-88b5-4a0cdae241a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:06.969139 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004c7e8-f761-4fb1-88b5-4a0cdae241a1 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:06.969422 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004c7e8-f761-4fb1-88b5-4a0cdae241a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:06.969696 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004c7e8-f761-4fb1-88b5-4a0cdae241a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:06.993404 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004c7e8-f761-4fb1-88b5-4a0cdae241a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:07.001820 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-0004c7e8-f761-4fb1-88b5-4a0cdae241a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:43:07.001820 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:07.001820 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:07.001820 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:07.001820 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:07.001820 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:07.001820 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:07.001820 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:07.001820 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:07.001820 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:07.001820 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:07.001820 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:07.001820 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:07.001820 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:07.001820 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:07.001820 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:07.002701 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:07.002701 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:07.002701 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:07.002701 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:07.002701 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:07.002701 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:07.002701 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:07.002701 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:07.002701 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:07.002701 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:07.002701 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:07.002701 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:07.002701 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:07.002701 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:07.002701 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:07.002701 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:07.003542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:07.003542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:07.003542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:07.003542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:07.003542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:07.003542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:07.003542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:07.003542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:07.003542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:07.003542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:07.003542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:43:07.003542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:07.003542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 179/354] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:43:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:07.011948 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69c198-c62e-4feb-a54c-bbae1a9ea357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:07.012656 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69c198-c62e-4feb-a54c-bbae1a9ea357 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:07.012928 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69c198-c62e-4feb-a54c-bbae1a9ea357 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:07.013200 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69c198-c62e-4feb-a54c-bbae1a9ea357 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:07.014047 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69c198-c62e-4feb-a54c-bbae1a9ea357 None admin] RBAC: Adding query filter params (group.id=eb0b5be77d6246ec9d0b5ebcdbca517a, role.id=91c119444803497dafe274cc66f05208, scope.project.id=3811ac7a7eab4e3e9040f45371523192) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:07.014355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69c198-c62e-4feb-a54c-bbae1a9ea357 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:07.015875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69c198-c62e-4feb-a54c-bbae1a9ea357 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:07.018106 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004c7e8-f761-4fb1-88b5-4a0cdae241a1 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:07.031992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 176/355] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jul 4 05:43:06 2022] GET /identity/v3/role_assignments?group.id=eb0b5be77d6246ec9d0b5ebcdbca517a&scope.project.id=3811ac7a7eab4e3e9040f45371523192&role.id=91c119444803497dafe274cc66f05208 => generated 260 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:07.032684 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:07.032956 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69c198-c62e-4feb-a54c-bbae1a9ea357 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:07.222006 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:07.227067 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004c7e8-f761-4fb1-88b5-4a0cdae241a1 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:07.234844 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69c198-c62e-4feb-a54c-bbae1a9ea357 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:07.292542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da657058-0382-4254-b96d-aa89a6dd2302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:07.294264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da657058-0382-4254-b96d-aa89a6dd2302 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:07.294547 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da657058-0382-4254-b96d-aa89a6dd2302 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:07.294825 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da657058-0382-4254-b96d-aa89a6dd2302 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:07.299228 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88181a-11ab-4826-a887-1c100a2c1b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:07.299908 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88181a-11ab-4826-a887-1c100a2c1b2c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:07.300186 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88181a-11ab-4826-a887-1c100a2c1b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:07.300458 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88181a-11ab-4826-a887-1c100a2c1b2c None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:07.301212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88181a-11ab-4826-a887-1c100a2c1b2c None admin] RBAC: Adding query filter params (name=member) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:07.301520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88181a-11ab-4826-a887-1c100a2c1b2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:07.303131 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88181a-11ab-4826-a887-1c100a2c1b2c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:07.315593 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da657058-0382-4254-b96d-aa89a6dd2302 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:07.322301 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 177/356] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 4 05:43:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:07.323754 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190f6a2-e0d1-4ea6-b801-a85a57076a64 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:07.324112 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190f6a2-e0d1-4ea6-b801-a85a57076a64 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:07.324458 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190f6a2-e0d1-4ea6-b801-a85a57076a64 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:07.325510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-da657058-0382-4254-b96d-aa89a6dd2302 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 05:43:07.325510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:07.325510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:07.325510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:07.325510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:07.325510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:07.325510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:07.325510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:07.325510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:07.325510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:07.325510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:07.325510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:07.325510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:07.325510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:07.325510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:07.325510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:07.327561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:07.327561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:07.327561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:07.327561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:07.327561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:07.327561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:07.327561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:07.327561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:07.327561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:07.327561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:07.327561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:07.327561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:07.327561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:07.327561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:07.327561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:07.327561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:07.328325 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:07.328325 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:07.328325 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:07.328325 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:07.328325 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:07.328325 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:07.328325 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:07.328325 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:07.328325 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:07.328325 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:07.328325 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 05:43:07.328325 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:07.328915 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 178/357] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:07.328915 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534833f4-ed9b-46d3-821e-9d6a985e88ca None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:07.328915 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534833f4-ed9b-46d3-821e-9d6a985e88ca None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:07.328915 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534833f4-ed9b-46d3-821e-9d6a985e88ca None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:07.330652 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 179/358] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:07.331379 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 180/359] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 4 05:43:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:07.334161 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534833f4-ed9b-46d3-821e-9d6a985e88ca None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:07.337374 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82898871-b8ea-4c54-9481-9e409de17dbb None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:07.337658 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82898871-b8ea-4c54-9481-9e409de17dbb None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:07.337932 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82898871-b8ea-4c54-9481-9e409de17dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:07.355705 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-82898871-b8ea-4c54-9481-9e409de17dbb None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:07.356978 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-82898871-b8ea-4c54-9481-9e409de17dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:07.427860 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:07.444219 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 181/360] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:07.445857 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024998a-af7a-4e33-b54c-be5d0aab68de None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:07.445966 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024998a-af7a-4e33-b54c-be5d0aab68de None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:07.446564 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024998a-af7a-4e33-b54c-be5d0aab68de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:07.453532 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534833f4-ed9b-46d3-821e-9d6a985e88ca None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:07.480606 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-6024998a-af7a-4e33-b54c-be5d0aab68de None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:07.483839 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-6024998a-af7a-4e33-b54c-be5d0aab68de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:07.497598 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671f33a-8265-4a44-9d68-21bca70b683f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:07.498935 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671f33a-8265-4a44-9d68-21bca70b683f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:07.499449 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671f33a-8265-4a44-9d68-21bca70b683f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:07.499976 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671f33a-8265-4a44-9d68-21bca70b683f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:07.533687 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:07.558337 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 182/361] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:07.559290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024998a-af7a-4e33-b54c-be5d0aab68de None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:07.581784 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671f33a-8265-4a44-9d68-21bca70b683f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:07.583848 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671f33a-8265-4a44-9d68-21bca70b683f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:07.684359 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024998a-af7a-4e33-b54c-be5d0aab68de None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:07.696095 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 180/362] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:43:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 05:43:07.697393 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671f33a-8265-4a44-9d68-21bca70b683f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:07.713625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:07.730544 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50374fd4-2f2e-480a-ade1-ce627e40a8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:07.731155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50374fd4-2f2e-480a-ade1-ce627e40a8f3 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:07.731426 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50374fd4-2f2e-480a-ade1-ce627e40a8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:07.731703 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50374fd4-2f2e-480a-ade1-ce627e40a8f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:07.732454 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50374fd4-2f2e-480a-ade1-ce627e40a8f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:07.732761 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50374fd4-2f2e-480a-ade1-ce627e40a8f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:07.734166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50374fd4-2f2e-480a-ade1-ce627e40a8f3 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:07.754711 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 183/363] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:43:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:07.754711 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50374fd4-2f2e-480a-ade1-ce627e40a8f3 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:07.766639 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:07.809099 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671f33a-8265-4a44-9d68-21bca70b683f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:07.844715 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808dd202-e8f3-49d7-a893-895e6d2d0882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:07.845891 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808dd202-e8f3-49d7-a893-895e6d2d0882 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:07.846372 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808dd202-e8f3-49d7-a893-895e6d2d0882 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:07.846863 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808dd202-e8f3-49d7-a893-895e6d2d0882 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:07.862439 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808dd202-e8f3-49d7-a893-895e6d2d0882 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:07.871742 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-808dd202-e8f3-49d7-a893-895e6d2d0882 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:43:07.871742 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:07.871742 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:07.871742 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:07.871742 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:07.871742 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:07.871742 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:07.871742 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:07.871742 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:07.871742 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:07.871742 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:07.871742 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:07.871742 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:07.871742 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:07.871742 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:07.871742 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:07.872646 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:07.872646 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:07.872646 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:07.872646 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:07.872646 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:07.872646 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:07.872646 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:07.872646 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:07.872646 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:07.872646 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:07.872646 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:07.872646 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:07.872646 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:07.872646 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:07.872646 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:07.872646 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:07.873764 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:07.873764 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:07.873764 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:07.873764 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:07.873764 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:07.873764 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:07.873764 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:07.873764 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:07.873764 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:07.873764 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:07.873764 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:43:07.873764 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:07.876230 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 181/364] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:43:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:07.877331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808dd202-e8f3-49d7-a893-895e6d2d0882 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:07.878524 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50374fd4-2f2e-480a-ade1-ce627e40a8f3 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:07.915412 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c624b35-09da-4581-9be8-a7992200d74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:07.916230 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c624b35-09da-4581-9be8-a7992200d74b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:07.917276 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c624b35-09da-4581-9be8-a7992200d74b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:07.917276 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c624b35-09da-4581-9be8-a7992200d74b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:07.929510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c624b35-09da-4581-9be8-a7992200d74b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:07.937742 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-2c624b35-09da-4581-9be8-a7992200d74b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 05:43:07.937742 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:07.937742 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:07.937742 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:07.937742 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:07.937742 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:07.937742 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:07.937742 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:07.937742 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:07.937742 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:07.937742 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:07.937742 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:07.937742 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:07.937742 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:07.937742 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:07.937742 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:07.938624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:07.938624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:07.938624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:07.938624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:07.938624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:07.938624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:07.938624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:07.938624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:07.938624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:07.938624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:07.938624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:07.938624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:07.938624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:07.938624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:07.938624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:07.938624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:07.939827 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:07.939827 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:07.939827 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:07.939827 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:07.939827 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:07.939827 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:07.939827 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:07.939827 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:07.939827 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:07.939827 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:07.939827 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 05:43:07.939827 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:07.939827 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 184/365] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:43:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:07.940503 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c624b35-09da-4581-9be8-a7992200d74b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:07.988091 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808dd202-e8f3-49d7-a893-895e6d2d0882 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:08.001763 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:08.006833 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:08.024543 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e72074-c5e3-4f93-a235-c4c2b0b0a5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:08.025714 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e72074-c5e3-4f93-a235-c4c2b0b0a5e2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:08.026131 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e72074-c5e3-4f93-a235-c4c2b0b0a5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:08.026549 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e72074-c5e3-4f93-a235-c4c2b0b0a5e2 None admin] PATH_INFO: `/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:08.027991 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e72074-c5e3-4f93-a235-c4c2b0b0a5e2 None admin] RBAC: Authorizing `identity:get_project(project_id=e7ac8d54998946acb55e1b10e3a9c30b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:08.029640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e72074-c5e3-4f93-a235-c4c2b0b0a5e2 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:08.031894 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 182/366] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:43:07 2022] GET /identity/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:08.032935 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e72074-c5e3-4f93-a235-c4c2b0b0a5e2 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:08.076199 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c624b35-09da-4581-9be8-a7992200d74b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:08.116227 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1fae2-702d-4b8d-9f44-6e6029790a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:08.116939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1fae2-702d-4b8d-9f44-6e6029790a8a None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:08.117194 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1fae2-702d-4b8d-9f44-6e6029790a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:08.117480 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1fae2-702d-4b8d-9f44-6e6029790a8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:08.167003 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e72074-c5e3-4f93-a235-c4c2b0b0a5e2 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:08.204038 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1fae2-702d-4b8d-9f44-6e6029790a8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:08.204038 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1fae2-702d-4b8d-9f44-6e6029790a8a None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:08.218514 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fe353-ae9c-4dbc-a16e-e249d2b98195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:08.220072 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fe353-ae9c-4dbc-a16e-e249d2b98195 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:08.220508 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fe353-ae9c-4dbc-a16e-e249d2b98195 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:08.221085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fe353-ae9c-4dbc-a16e-e249d2b98195 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:08.222077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770fe353-ae9c-4dbc-a16e-e249d2b98195 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:08.222786 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770fe353-ae9c-4dbc-a16e-e249d2b98195 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:08.224763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770fe353-ae9c-4dbc-a16e-e249d2b98195 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:08.237635 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 183/367] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:43:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:08.239426 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fe353-ae9c-4dbc-a16e-e249d2b98195 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:08.258923 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:08.304131 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:08.331271 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 185/368] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:43:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 05:43:08.332168 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1fae2-702d-4b8d-9f44-6e6029790a8a None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:08.372350 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fe353-ae9c-4dbc-a16e-e249d2b98195 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:08.421684 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3e01f-6337-4ace-a4f7-01998500246e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:08.423056 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3e01f-6337-4ace-a4f7-01998500246e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:08.423566 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3e01f-6337-4ace-a4f7-01998500246e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:08.424016 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3e01f-6337-4ace-a4f7-01998500246e None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:08.424932 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3e01f-6337-4ace-a4f7-01998500246e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:08.425939 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3e01f-6337-4ace-a4f7-01998500246e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:08.427798 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3e01f-6337-4ace-a4f7-01998500246e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:08.440633 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 184/369] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 4 05:43:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:08.441793 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3e01f-6337-4ace-a4f7-01998500246e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:08.488525 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1fae2-702d-4b8d-9f44-6e6029790a8a None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:08.532018 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbec22-9bfd-40da-bd31-cfc2b2936fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:08.532911 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbec22-9bfd-40da-bd31-cfc2b2936fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:08.533258 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbec22-9bfd-40da-bd31-cfc2b2936fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:08.533961 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbec22-9bfd-40da-bd31-cfc2b2936fd3 None admin] PATH_INFO: `/v3/groups/eb0b5be77d6246ec9d0b5ebcdbca517a` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:08.534798 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cbec22-9bfd-40da-bd31-cfc2b2936fd3 None admin] RBAC: Authorizing `identity:get_group(group_id=eb0b5be77d6246ec9d0b5ebcdbca517a)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:08.536413 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cbec22-9bfd-40da-bd31-cfc2b2936fd3 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:08.538446 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 186/370] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 4 05:43:08 2022] GET /identity/v3/groups/eb0b5be77d6246ec9d0b5ebcdbca517a => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:08.539363 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbec22-9bfd-40da-bd31-cfc2b2936fd3 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:08.556151 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:08.568001 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3e01f-6337-4ace-a4f7-01998500246e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:08.582523 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:08.616966 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcf875-9912-4bf2-aac1-24093f76d83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:08.617946 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcf875-9912-4bf2-aac1-24093f76d83e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:08.618626 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcf875-9912-4bf2-aac1-24093f76d83e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:08.619090 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcf875-9912-4bf2-aac1-24093f76d83e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:08.660907 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbec22-9bfd-40da-bd31-cfc2b2936fd3 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:08.693474 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bcf875-9912-4bf2-aac1-24093f76d83e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:08.695806 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bcf875-9912-4bf2-aac1-24093f76d83e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:08.697124 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbfea1a-d56f-4a29-9e41-8439061af961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:08.698156 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfea1a-d56f-4a29-9e41-8439061af961 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:08.698539 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfea1a-d56f-4a29-9e41-8439061af961 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:08.698876 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfea1a-d56f-4a29-9e41-8439061af961 None admin] PATH_INFO: `/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:08.701016 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbfea1a-d56f-4a29-9e41-8439061af961 None admin] RBAC: Authorizing `identity:get_project(project_id=e7ac8d54998946acb55e1b10e3a9c30b)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:08.702527 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbfea1a-d56f-4a29-9e41-8439061af961 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:08.707595 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 187/371] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:43:08 2022] GET /identity/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:08.708623 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbfea1a-d56f-4a29-9e41-8439061af961 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:08.799885 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:08.805059 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 185/372] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:43:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 05:43:08.806077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcf875-9912-4bf2-aac1-24093f76d83e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:08.820396 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbfea1a-d56f-4a29-9e41-8439061af961 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:08.828755 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:08.863842 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b112a88-7617-4091-8c62-13da8588f0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:08.864824 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b112a88-7617-4091-8c62-13da8588f0a4 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:08.865178 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b112a88-7617-4091-8c62-13da8588f0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:08.865522 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b112a88-7617-4091-8c62-13da8588f0a4 None admin] PATH_INFO: `/v3/users/4ae9479535a14fffbfde51e15bd208a7` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:08.866936 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b112a88-7617-4091-8c62-13da8588f0a4 None admin] RBAC: Authorizing `identity:get_user(user_id=4ae9479535a14fffbfde51e15bd208a7)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:08.868538 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b112a88-7617-4091-8c62-13da8588f0a4 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:08.870881 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 188/373] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:43:08 2022] GET /identity/v3/users/4ae9479535a14fffbfde51e15bd208a7 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:08.872000 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b112a88-7617-4091-8c62-13da8588f0a4 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:08.928104 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcf875-9912-4bf2-aac1-24093f76d83e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:08.964121 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaef390-d9dc-4439-9963-d61a16deeeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:08.965101 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaef390-d9dc-4439-9963-d61a16deeeb9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:08.965612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaef390-d9dc-4439-9963-d61a16deeeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:08.966068 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaef390-d9dc-4439-9963-d61a16deeeb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:08.967348 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaef390-d9dc-4439-9963-d61a16deeeb9 None admin] RBAC: Adding query filter params (group.id=eb0b5be77d6246ec9d0b5ebcdbca517a, role.id=9fdc0a5e493c44c9add5859af9d4f394, scope.project.id=e7ac8d54998946acb55e1b10e3a9c30b) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:08.967868 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaef390-d9dc-4439-9963-d61a16deeeb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:08.969495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaef390-d9dc-4439-9963-d61a16deeeb9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:08.976167 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 186/374] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jul 4 05:43:08 2022] GET /identity/v3/role_assignments?group.id=eb0b5be77d6246ec9d0b5ebcdbca517a&scope.project.id=e7ac8d54998946acb55e1b10e3a9c30b&role.id=9fdc0a5e493c44c9add5859af9d4f394 => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:08.977372 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaef390-d9dc-4439-9963-d61a16deeeb9 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:08.983176 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b112a88-7617-4091-8c62-13da8588f0a4 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:09.023624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84b31c-405a-477f-986d-d6c01714df7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:09.024503 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84b31c-405a-477f-986d-d6c01714df7c None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:09.024788 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84b31c-405a-477f-986d-d6c01714df7c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:09.025067 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84b31c-405a-477f-986d-d6c01714df7c None admin] PATH_INFO: `/v3/groups/eb0b5be77d6246ec9d0b5ebcdbca517a` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:09.027055 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84b31c-405a-477f-986d-d6c01714df7c None admin] RBAC: Authorizing `identity:get_group(group_id=eb0b5be77d6246ec9d0b5ebcdbca517a)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:09.028817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84b31c-405a-477f-986d-d6c01714df7c None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:09.030726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 189/375] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 4 05:43:08 2022] GET /identity/v3/groups/eb0b5be77d6246ec9d0b5ebcdbca517a => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:09.036069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84b31c-405a-477f-986d-d6c01714df7c None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:09.057802 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:09.068116 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:09.099229 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaef390-d9dc-4439-9963-d61a16deeeb9 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:09.142040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0c026-85d9-419f-98f9-a679fd81786f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:09.143032 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0c026-85d9-419f-98f9-a679fd81786f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:09.143414 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0c026-85d9-419f-98f9-a679fd81786f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:09.143838 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0c026-85d9-419f-98f9-a679fd81786f None admin] PATH_INFO: `/v3/projects/b420ef42d5dc484fb1563cbae9f104d5` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:09.145366 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0c026-85d9-419f-98f9-a679fd81786f None admin] RBAC: Authorizing `identity:get_project(project_id=b420ef42d5dc484fb1563cbae9f104d5)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:09.146902 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0c026-85d9-419f-98f9-a679fd81786f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:09.148961 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 187/376] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:43:08 2022] GET /identity/v3/projects/b420ef42d5dc484fb1563cbae9f104d5 => generated 344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:09.149805 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0c026-85d9-419f-98f9-a679fd81786f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:09.155222 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84b31c-405a-477f-986d-d6c01714df7c None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:09.193236 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeadd00e-9495-441e-88c1-c7f3850fc9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:09.194303 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadd00e-9495-441e-88c1-c7f3850fc9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:09.194787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadd00e-9495-441e-88c1-c7f3850fc9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:09.195264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadd00e-9495-441e-88c1-c7f3850fc9f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:09.196290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeadd00e-9495-441e-88c1-c7f3850fc9f3 None admin] RBAC: Adding query filter params (role.id=5357c224d018422198be89d0268ef167, user.id=4ae9479535a14fffbfde51e15bd208a7, scope.system=all) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:09.196788 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeadd00e-9495-441e-88c1-c7f3850fc9f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:09.198425 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeadd00e-9495-441e-88c1-c7f3850fc9f3 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:09.212468 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 190/377] 10.222.0.16 () {56 vars in 1308 bytes} [Mon Jul 4 05:43:09 2022] GET /identity/v3/role_assignments?user.id=4ae9479535a14fffbfde51e15bd208a7&scope.system=all&role.id=5357c224d018422198be89d0268ef167 => generated 510 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:09.213800 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeadd00e-9495-441e-88c1-c7f3850fc9f3 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:09.269682 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0c026-85d9-419f-98f9-a679fd81786f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:09.306948 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:09.310065 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afe036-de5e-4027-9dae-57c633c144f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:09.311023 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afe036-de5e-4027-9dae-57c633c144f6 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:09.311568 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afe036-de5e-4027-9dae-57c633c144f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:09.312046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afe036-de5e-4027-9dae-57c633c144f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:09.313115 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60afe036-de5e-4027-9dae-57c633c144f6 None admin] RBAC: Adding query filter params (group.id=eb0b5be77d6246ec9d0b5ebcdbca517a, role.id=91c119444803497dafe274cc66f05208, scope.project.id=e7ac8d54998946acb55e1b10e3a9c30b) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:09.313657 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60afe036-de5e-4027-9dae-57c633c144f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:09.315428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60afe036-de5e-4027-9dae-57c633c144f6 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:09.322273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 188/378] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jul 4 05:43:09 2022] GET /identity/v3/role_assignments?group.id=eb0b5be77d6246ec9d0b5ebcdbca517a&scope.project.id=e7ac8d54998946acb55e1b10e3a9c30b&role.id=91c119444803497dafe274cc66f05208 => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:09.324036 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83645932-4002-4c4c-ae7d-754da9997c24 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:09.324512 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83645932-4002-4c4c-ae7d-754da9997c24 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:09.325015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83645932-4002-4c4c-ae7d-754da9997c24 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:09.327058 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 189/379] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:09.332663 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa9552-f24c-4e52-9409-b3f27bb606b3 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:09.333254 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa9552-f24c-4e52-9409-b3f27bb606b3 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:09.333713 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa9552-f24c-4e52-9409-b3f27bb606b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:09.348526 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:09.352347 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeadd00e-9495-441e-88c1-c7f3850fc9f3 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:09.355715 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-91aa9552-f24c-4e52-9409-b3f27bb606b3 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:09.357307 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-91aa9552-f24c-4e52-9409-b3f27bb606b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:09.441079 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f78e6-a1cb-4efe-882f-68a9bad58003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:09.442187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f78e6-a1cb-4efe-882f-68a9bad58003 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:09.442541 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f78e6-a1cb-4efe-882f-68a9bad58003 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:09.442889 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f78e6-a1cb-4efe-882f-68a9bad58003 None admin] PATH_INFO: `/v3/groups/e0b42ddf4d4e44b8b09f5d8c40177532` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:09.447803 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 190/380] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:09.462507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5506903-0c47-4a59-8c5a-c291c901b432 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:09.462725 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f78e6-a1cb-4efe-882f-68a9bad58003 None admin] RBAC: Authorizing `identity:get_group(group_id=e0b42ddf4d4e44b8b09f5d8c40177532)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:09.463233 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5506903-0c47-4a59-8c5a-c291c901b432 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:09.463741 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5506903-0c47-4a59-8c5a-c291c901b432 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:09.464170 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f78e6-a1cb-4efe-882f-68a9bad58003 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:09.466051 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 191/381] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:43:09.467239 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 191/382] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 4 05:43:09 2022] GET /identity/v3/groups/e0b42ddf4d4e44b8b09f5d8c40177532 => generated 229 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:09.471851 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca56ee5-e257-4d28-9390-943c8755616d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:09.472147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca56ee5-e257-4d28-9390-943c8755616d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:09.472435 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca56ee5-e257-4d28-9390-943c8755616d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:09.472942 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f78e6-a1cb-4efe-882f-68a9bad58003 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:09.496926 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-2ca56ee5-e257-4d28-9390-943c8755616d None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:09.498487 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2ca56ee5-e257-4d28-9390-943c8755616d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:09.590658 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 192/383] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 05:43:09.591559 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca56ee5-e257-4d28-9390-943c8755616d None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:09.611196 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f78e6-a1cb-4efe-882f-68a9bad58003 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:09.665640 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f9f4c-7ab9-4d7b-bea5-983d60b77c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:09.666545 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f9f4c-7ab9-4d7b-bea5-983d60b77c39 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:09.666833 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f9f4c-7ab9-4d7b-bea5-983d60b77c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:09.667110 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f9f4c-7ab9-4d7b-bea5-983d60b77c39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:09.668729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f9f4c-7ab9-4d7b-bea5-983d60b77c39 None admin] RBAC: Adding query filter params (group.id=e0b42ddf4d4e44b8b09f5d8c40177532, role.id=6c5b161dbf33447fa1d383915d3c9382, scope.project.id=b420ef42d5dc484fb1563cbae9f104d5) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:09.669049 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f9f4c-7ab9-4d7b-bea5-983d60b77c39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:09.670516 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f9f4c-7ab9-4d7b-bea5-983d60b77c39 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:09.671243 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:09.679455 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 192/384] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jul 4 05:43:09 2022] GET /identity/v3/role_assignments?group.id=e0b42ddf4d4e44b8b09f5d8c40177532&scope.project.id=b420ef42d5dc484fb1563cbae9f104d5&role.id=6c5b161dbf33447fa1d383915d3c9382 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:09.680626 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f9f4c-7ab9-4d7b-bea5-983d60b77c39 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:09.686541 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:09.730846 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca56ee5-e257-4d28-9390-943c8755616d None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:09.782804 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83410c33-3ca5-4fbc-bf77-b788d2449046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:09.783955 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83410c33-3ca5-4fbc-bf77-b788d2449046 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:09.784239 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83410c33-3ca5-4fbc-bf77-b788d2449046 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:09.784513 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83410c33-3ca5-4fbc-bf77-b788d2449046 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:09.798673 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83410c33-3ca5-4fbc-bf77-b788d2449046 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:09.809358 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-83410c33-3ca5-4fbc-bf77-b788d2449046 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:43:09.809358 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:09.809358 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:09.809358 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:09.809358 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:09.809358 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:09.809358 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:09.809358 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:09.809358 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:09.809358 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:09.809358 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:09.809358 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:09.809358 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:09.809358 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:09.809358 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:09.809358 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:09.810569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:09.810569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:09.810569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:09.810569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:09.810569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:09.810569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:09.810569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:09.810569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:09.810569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:09.810569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:09.810569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:09.810569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:09.810569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:09.810569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:09.810569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:09.810569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:09.811628 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:09.811628 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:09.811628 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:09.811628 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:09.811628 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:09.811628 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:09.811628 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:09.811628 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:09.811628 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:09.811628 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:09.811628 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:43:09.811628 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:09.811628 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 193/385] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:43:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:09.817497 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83410c33-3ca5-4fbc-bf77-b788d2449046 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:09.836995 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f9f4c-7ab9-4d7b-bea5-983d60b77c39 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:09.885118 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef798a28-0cb4-42f1-80cd-8ff0840dde12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:09.886780 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef798a28-0cb4-42f1-80cd-8ff0840dde12 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:09.887618 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef798a28-0cb4-42f1-80cd-8ff0840dde12 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:09.888039 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef798a28-0cb4-42f1-80cd-8ff0840dde12 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:09.902470 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef798a28-0cb4-42f1-80cd-8ff0840dde12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:09.913382 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-ef798a28-0cb4-42f1-80cd-8ff0840dde12 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 05:43:09.913382 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:09.913382 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:09.913382 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:09.913382 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:09.913382 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:09.913382 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:09.913382 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:09.913382 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:09.913382 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:09.913382 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:09.913382 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:09.913382 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:09.913382 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:09.913382 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:09.913382 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:09.914558 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:09.914558 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:09.914558 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:09.914558 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:09.914558 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:09.914558 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:09.914558 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:09.914558 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:09.914558 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:09.914558 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:09.914558 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:09.914558 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:09.914558 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:09.914558 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:09.914558 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:09.914558 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:09.915506 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:09.915506 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:09.915506 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:09.915506 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:09.915506 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:09.915506 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:09.915506 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:09.915506 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:09.915506 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:09.915506 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:09.915506 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 05:43:09.915506 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:09.923085 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 193/386] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 4 05:43:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:09.923894 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef798a28-0cb4-42f1-80cd-8ff0840dde12 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:09.954473 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83410c33-3ca5-4fbc-bf77-b788d2449046 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:09.983436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:09.991406 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:09.997066 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c48dbf-bf22-4911-a8e2-1e8263d165ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:09.998426 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c48dbf-bf22-4911-a8e2-1e8263d165ce None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:09.998908 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c48dbf-bf22-4911-a8e2-1e8263d165ce None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:09.999436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c48dbf-bf22-4911-a8e2-1e8263d165ce None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:10.000405 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c48dbf-bf22-4911-a8e2-1e8263d165ce None admin] RBAC: Adding query filter params (name=member) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:10.000903 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c48dbf-bf22-4911-a8e2-1e8263d165ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:10.002579 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c48dbf-bf22-4911-a8e2-1e8263d165ce None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:10.012579 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 194/387] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 4 05:43:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:43:10.018727 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c48dbf-bf22-4911-a8e2-1e8263d165ce None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:10.033836 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef798a28-0cb4-42f1-80cd-8ff0840dde12 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:10.084176 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc96ad9-e3f2-49e8-853a-c98a2e33ad46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:10.084703 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc96ad9-e3f2-49e8-853a-c98a2e33ad46 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:10.084991 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc96ad9-e3f2-49e8-853a-c98a2e33ad46 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:10.085271 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc96ad9-e3f2-49e8-853a-c98a2e33ad46 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:10.086032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc96ad9-e3f2-49e8-853a-c98a2e33ad46 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:10.086334 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc96ad9-e3f2-49e8-853a-c98a2e33ad46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:10.087765 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc96ad9-e3f2-49e8-853a-c98a2e33ad46 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:10.105557 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 194/388] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:43:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:43:10.115855 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc96ad9-e3f2-49e8-853a-c98a2e33ad46 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:10.136114 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c48dbf-bf22-4911-a8e2-1e8263d165ce None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:10.172245 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72720c-eeb2-4067-99e3-fc0142a8d0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:10.173513 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72720c-eeb2-4067-99e3-fc0142a8d0a6 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:10.173999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72720c-eeb2-4067-99e3-fc0142a8d0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:10.174578 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72720c-eeb2-4067-99e3-fc0142a8d0a6 None admin] PATH_INFO: `/v3/groups/eb0b5be77d6246ec9d0b5ebcdbca517a` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:10.176932 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72720c-eeb2-4067-99e3-fc0142a8d0a6 None admin] RBAC: Authorizing `identity:get_group(group_id=eb0b5be77d6246ec9d0b5ebcdbca517a)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:10.180044 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72720c-eeb2-4067-99e3-fc0142a8d0a6 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:10.187535 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 195/389] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 4 05:43:10 2022] GET /identity/v3/groups/eb0b5be77d6246ec9d0b5ebcdbca517a => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:10.189286 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72720c-eeb2-4067-99e3-fc0142a8d0a6 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:10.251342 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:10.298638 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72720c-eeb2-4067-99e3-fc0142a8d0a6 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:10.334301 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64258c-a5d5-443c-8a09-d8b9e4d600e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:10.335651 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64258c-a5d5-443c-8a09-d8b9e4d600e2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:10.336132 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64258c-a5d5-443c-8a09-d8b9e4d600e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:10.336599 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64258c-a5d5-443c-8a09-d8b9e4d600e2 None admin] PATH_INFO: `/v3/projects/3811ac7a7eab4e3e9040f45371523192` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:10.338045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64258c-a5d5-443c-8a09-d8b9e4d600e2 None admin] RBAC: Authorizing `identity:get_project(project_id=3811ac7a7eab4e3e9040f45371523192)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:10.339782 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64258c-a5d5-443c-8a09-d8b9e4d600e2 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:10.342308 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 196/390] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:43:10 2022] GET /identity/v3/projects/3811ac7a7eab4e3e9040f45371523192 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:43:10.348336 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64258c-a5d5-443c-8a09-d8b9e4d600e2 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:10.401425 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc96ad9-e3f2-49e8-853a-c98a2e33ad46 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:10.463471 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64258c-a5d5-443c-8a09-d8b9e4d600e2 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:10.464904 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:10.492242 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:10.494617 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05709a3-d0d3-4f01-b22f-5c624ffd129d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:10.495544 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05709a3-d0d3-4f01-b22f-5c624ffd129d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:10.495829 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05709a3-d0d3-4f01-b22f-5c624ffd129d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:10.496428 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05709a3-d0d3-4f01-b22f-5c624ffd129d None admin] PATH_INFO: `/v3/groups/eb0b5be77d6246ec9d0b5ebcdbca517a` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:10.497797 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05709a3-d0d3-4f01-b22f-5c624ffd129d None admin] RBAC: Authorizing `identity:get_group(group_id=eb0b5be77d6246ec9d0b5ebcdbca517a)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:10.499664 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05709a3-d0d3-4f01-b22f-5c624ffd129d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:10.501402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 195/391] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 4 05:43:10 2022] GET /identity/v3/groups/eb0b5be77d6246ec9d0b5ebcdbca517a => generated 226 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:43:10.506675 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32c1fa-1466-43ce-b966-03b6a5459bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:10.507052 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05709a3-d0d3-4f01-b22f-5c624ffd129d None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:10.508151 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32c1fa-1466-43ce-b966-03b6a5459bda None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:10.508641 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32c1fa-1466-43ce-b966-03b6a5459bda None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:10.509106 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32c1fa-1466-43ce-b966-03b6a5459bda None admin] PATH_INFO: `/v3/projects/3811ac7a7eab4e3e9040f45371523192/groups/eb0b5be77d6246ec9d0b5ebcdbca517a/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:10.511321 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32c1fa-1466-43ce-b966-03b6a5459bda None admin] RBAC: Authorizing `identity:create_grant(project_id=3811ac7a7eab4e3e9040f45371523192, group_id=eb0b5be77d6246ec9d0b5ebcdbca517a, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:10.513207 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32c1fa-1466-43ce-b966-03b6a5459bda None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:10.544948 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 197/392] 10.222.0.16 () {58 vars in 1442 bytes} [Mon Jul 4 05:43:10 2022] PUT /identity/v3/projects/3811ac7a7eab4e3e9040f45371523192/groups/eb0b5be77d6246ec9d0b5ebcdbca517a/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 05:43:10.648212 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05709a3-d0d3-4f01-b22f-5c624ffd129d None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:10.685546 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a823da-7375-4e2d-90b6-8d30d6ab0f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:10.686789 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a823da-7375-4e2d-90b6-8d30d6ab0f6e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:10.687317 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a823da-7375-4e2d-90b6-8d30d6ab0f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:10.687790 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a823da-7375-4e2d-90b6-8d30d6ab0f6e None admin] PATH_INFO: `/v3/projects/3811ac7a7eab4e3e9040f45371523192` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:10.689273 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a823da-7375-4e2d-90b6-8d30d6ab0f6e None admin] RBAC: Authorizing `identity:get_project(project_id=3811ac7a7eab4e3e9040f45371523192)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:10.690992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a823da-7375-4e2d-90b6-8d30d6ab0f6e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:10.693388 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 196/393] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:43:10 2022] GET /identity/v3/projects/3811ac7a7eab4e3e9040f45371523192 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:10.699385 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32c1fa-1466-43ce-b966-03b6a5459bda None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:10.831350 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32c1fa-1466-43ce-b966-03b6a5459bda None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:10.872275 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0fc37-be74-434f-9183-907d6098f94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:10.873505 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0fc37-be74-434f-9183-907d6098f94e None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:10.873788 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0fc37-be74-434f-9183-907d6098f94e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:10.874064 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0fc37-be74-434f-9183-907d6098f94e None admin] PATH_INFO: `/v3/projects/3811ac7a7eab4e3e9040f45371523192/groups/eb0b5be77d6246ec9d0b5ebcdbca517a/roles/91c119444803497dafe274cc66f05208` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:10.881233 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d0fc37-be74-434f-9183-907d6098f94e None admin] RBAC: Authorizing `identity:create_grant(project_id=3811ac7a7eab4e3e9040f45371523192, group_id=eb0b5be77d6246ec9d0b5ebcdbca517a, role_id=91c119444803497dafe274cc66f05208)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:10.882720 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d0fc37-be74-434f-9183-907d6098f94e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:10.913256 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 198/394] 10.222.0.16 () {58 vars in 1442 bytes} [Mon Jul 4 05:43:10 2022] PUT /identity/v3/projects/3811ac7a7eab4e3e9040f45371523192/groups/eb0b5be77d6246ec9d0b5ebcdbca517a/roles/91c119444803497dafe274cc66f05208 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:43:11.865305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74ba5c-b386-4a01-9770-fcef00aebb0d None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:11.865848 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74ba5c-b386-4a01-9770-fcef00aebb0d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:11.865848 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74ba5c-b386-4a01-9770-fcef00aebb0d None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:11.867531 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 197/395] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:11.872709 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050c522-aeea-4d9c-91ce-de1d235fb72e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:11.873474 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050c522-aeea-4d9c-91ce-de1d235fb72e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:11.873908 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050c522-aeea-4d9c-91ce-de1d235fb72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:11.896358 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6050c522-aeea-4d9c-91ce-de1d235fb72e None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:11.897554 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6050c522-aeea-4d9c-91ce-de1d235fb72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:11.958791 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:11.999507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 199/396] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:12.033716 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74ba5c-b386-4a01-9770-fcef00aebb0d None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:12.062221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e3861-174d-4ce3-bcbe-0388c9e96666 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:12.062844 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e3861-174d-4ce3-bcbe-0388c9e96666 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:12.063547 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e3861-174d-4ce3-bcbe-0388c9e96666 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:12.065852 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 200/397] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:43:12.072954 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c2552-767f-4bfc-b309-3a96ae43c932 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:12.073582 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c2552-767f-4bfc-b309-3a96ae43c932 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:12.074268 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c2552-767f-4bfc-b309-3a96ae43c932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:12.104970 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9a9c2552-767f-4bfc-b309-3a96ae43c932 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:12.107878 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9a9c2552-767f-4bfc-b309-3a96ae43c932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:12.151933 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:12.207161 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74ba5c-b386-4a01-9770-fcef00aebb0d None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:12.224072 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 201/398] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 05:43:12.243649 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407bf562-7be9-4f9a-b0ba-92148b424c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:12.244605 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bf562-7be9-4f9a-b0ba-92148b424c0f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:12.245315 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bf562-7be9-4f9a-b0ba-92148b424c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:12.245694 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bf562-7be9-4f9a-b0ba-92148b424c0f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:12.260963 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407bf562-7be9-4f9a-b0ba-92148b424c0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:12.269503 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-407bf562-7be9-4f9a-b0ba-92148b424c0f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 05:43:12.269503 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:12.269503 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:12.269503 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:12.269503 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:12.269503 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:12.269503 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:12.269503 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:12.269503 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:12.269503 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:12.269503 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:12.269503 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:12.269503 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:12.269503 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:12.269503 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:12.269503 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:12.270465 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:12.270465 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:12.270465 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:12.270465 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:12.270465 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:12.270465 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:12.270465 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:12.270465 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:12.270465 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:12.270465 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:12.270465 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:12.270465 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:12.270465 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:12.270465 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:12.270465 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:12.270465 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:12.271268 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:12.271268 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:12.271268 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:12.271268 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:12.271268 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:12.271268 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:12.271268 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:12.271268 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:12.271268 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:12.271268 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:12.271268 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 05:43:12.271268 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:12.271268 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 198/399] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 4 05:43:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:12.274154 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c2552-767f-4bfc-b309-3a96ae43c932 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:12.277173 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407bf562-7be9-4f9a-b0ba-92148b424c0f None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:12.410076 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407bf562-7be9-4f9a-b0ba-92148b424c0f None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:12.446699 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:12.447221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c2552-767f-4bfc-b309-3a96ae43c932 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:12.452004 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83041b54-1fc5-441f-87b0-d7bab2cf2af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:12.453076 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83041b54-1fc5-441f-87b0-d7bab2cf2af2 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:12.453572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83041b54-1fc5-441f-87b0-d7bab2cf2af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:12.453995 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83041b54-1fc5-441f-87b0-d7bab2cf2af2 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:12.454570 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:12.455199 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83041b54-1fc5-441f-87b0-d7bab2cf2af2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:12.455715 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83041b54-1fc5-441f-87b0-d7bab2cf2af2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:12.457255 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83041b54-1fc5-441f-87b0-d7bab2cf2af2 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:12.469736 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 199/400] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:43:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:12.479170 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83041b54-1fc5-441f-87b0-d7bab2cf2af2 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:12.493759 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e7f47-33d2-42ef-89f6-0d82f82a4f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:12.495217 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e7f47-33d2-42ef-89f6-0d82f82a4f4e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:12.495217 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e7f47-33d2-42ef-89f6-0d82f82a4f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:12.495217 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e7f47-33d2-42ef-89f6-0d82f82a4f4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:12.507104 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e7f47-33d2-42ef-89f6-0d82f82a4f4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:12.514991 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-429e7f47-33d2-42ef-89f6-0d82f82a4f4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:43:12.514991 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:12.514991 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:12.514991 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:12.514991 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:12.514991 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:12.514991 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:12.514991 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:12.514991 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:12.514991 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:12.514991 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:12.514991 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:12.514991 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:12.514991 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:12.514991 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:12.514991 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:12.516117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:12.516117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:12.516117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:12.516117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:12.516117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:12.516117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:12.516117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:12.516117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:12.516117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:12.516117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:12.516117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:12.516117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:12.516117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:12.516117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:12.516117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:12.516117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:12.520790 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:12.520790 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:12.520790 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:12.520790 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:12.520790 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:12.520790 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:12.520790 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:12.520790 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:12.520790 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:12.520790 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:12.520790 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:43:12.520790 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:12.520790 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 202/401] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:43:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:43:12.522173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e7f47-33d2-42ef-89f6-0d82f82a4f4e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:12.640552 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83041b54-1fc5-441f-87b0-d7bab2cf2af2 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:12.683753 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae8c13-bee3-483d-9448-e958f6fa2557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:12.684952 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae8c13-bee3-483d-9448-e958f6fa2557 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:12.685238 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae8c13-bee3-483d-9448-e958f6fa2557 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:12.685798 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae8c13-bee3-483d-9448-e958f6fa2557 None admin] PATH_INFO: `/v3/groups/eb0b5be77d6246ec9d0b5ebcdbca517a` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:12.687073 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae8c13-bee3-483d-9448-e958f6fa2557 None admin] RBAC: Authorizing `identity:get_group(group_id=eb0b5be77d6246ec9d0b5ebcdbca517a)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:12.688573 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae8c13-bee3-483d-9448-e958f6fa2557 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:12.690751 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 200/402] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 4 05:43:12 2022] GET /identity/v3/groups/eb0b5be77d6246ec9d0b5ebcdbca517a => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:12.692021 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd477da5-f206-4e6c-9107-1eb4993a5d7b None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:12.692394 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd477da5-f206-4e6c-9107-1eb4993a5d7b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:12.692679 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd477da5-f206-4e6c-9107-1eb4993a5d7b None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:12.694234 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 201/403] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:12.699056 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd477da5-f206-4e6c-9107-1eb4993a5d7b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:12.715275 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e7f47-33d2-42ef-89f6-0d82f82a4f4e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:12.754342 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30df57-a11c-4df8-9844-cc7050e9fff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:12.755064 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30df57-a11c-4df8-9844-cc7050e9fff0 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:12.755407 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30df57-a11c-4df8-9844-cc7050e9fff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:12.755728 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30df57-a11c-4df8-9844-cc7050e9fff0 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:12.756483 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30df57-a11c-4df8-9844-cc7050e9fff0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:12.756838 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30df57-a11c-4df8-9844-cc7050e9fff0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:12.758306 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30df57-a11c-4df8-9844-cc7050e9fff0 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:12.767484 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:12.768723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 203/404] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 4 05:43:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:43:12.770061 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8200c86-7f36-4d43-a4e2-1db477e0837e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:12.770369 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8200c86-7f36-4d43-a4e2-1db477e0837e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:12.770623 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8200c86-7f36-4d43-a4e2-1db477e0837e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:12.801185 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d8200c86-7f36-4d43-a4e2-1db477e0837e None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:12.802390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d8200c86-7f36-4d43-a4e2-1db477e0837e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:12.831210 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:12.831731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd477da5-f206-4e6c-9107-1eb4993a5d7b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:12.875445 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216741fd-946d-430f-86ee-406f6fd58853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:12.876367 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216741fd-946d-430f-86ee-406f6fd58853 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:12.876825 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216741fd-946d-430f-86ee-406f6fd58853 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:12.877278 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216741fd-946d-430f-86ee-406f6fd58853 None admin] PATH_INFO: `/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:12.878596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216741fd-946d-430f-86ee-406f6fd58853 None admin] RBAC: Authorizing `identity:get_project(project_id=e7ac8d54998946acb55e1b10e3a9c30b)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:12.880323 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216741fd-946d-430f-86ee-406f6fd58853 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:12.883368 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 202/405] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:43:12 2022] GET /identity/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:12.884366 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216741fd-946d-430f-86ee-406f6fd58853 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:12.894347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 204/406] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:12.896279 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8200c86-7f36-4d43-a4e2-1db477e0837e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:13.023919 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216741fd-946d-430f-86ee-406f6fd58853 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:13.030781 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8200c86-7f36-4d43-a4e2-1db477e0837e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:13.050946 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:13.066675 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644cfd0-edaa-48a0-beaa-c55bedb667a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:13.068106 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644cfd0-edaa-48a0-beaa-c55bedb667a7 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:13.068586 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644cfd0-edaa-48a0-beaa-c55bedb667a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:13.069116 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644cfd0-edaa-48a0-beaa-c55bedb667a7 None admin] PATH_INFO: `/v3/groups/eb0b5be77d6246ec9d0b5ebcdbca517a` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:13.070519 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644cfd0-edaa-48a0-beaa-c55bedb667a7 None admin] RBAC: Authorizing `identity:get_group(group_id=eb0b5be77d6246ec9d0b5ebcdbca517a)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:13.072188 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644cfd0-edaa-48a0-beaa-c55bedb667a7 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:13.072870 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e826745-63b4-4ed2-a6cb-f253cfb44f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:13.073758 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e826745-63b4-4ed2-a6cb-f253cfb44f54 None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:13.074042 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e826745-63b4-4ed2-a6cb-f253cfb44f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:13.074319 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e826745-63b4-4ed2-a6cb-f253cfb44f54 None admin] PATH_INFO: `/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b/groups/eb0b5be77d6246ec9d0b5ebcdbca517a/roles/91c119444803497dafe274cc66f05208` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:13.075010 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 203/407] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 4 05:43:12 2022] GET /identity/v3/groups/eb0b5be77d6246ec9d0b5ebcdbca517a => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:13.076006 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644cfd0-edaa-48a0-beaa-c55bedb667a7 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:13.079677 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e826745-63b4-4ed2-a6cb-f253cfb44f54 None admin] RBAC: Authorizing `identity:create_grant(project_id=e7ac8d54998946acb55e1b10e3a9c30b, group_id=eb0b5be77d6246ec9d0b5ebcdbca517a, role_id=91c119444803497dafe274cc66f05208)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:13.081666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e826745-63b4-4ed2-a6cb-f253cfb44f54 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:13.099520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 205/408] 10.222.0.16 () {58 vars in 1442 bytes} [Mon Jul 4 05:43:12 2022] PUT /identity/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b/groups/eb0b5be77d6246ec9d0b5ebcdbca517a/roles/91c119444803497dafe274cc66f05208 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:43:13.100743 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e826745-63b4-4ed2-a6cb-f253cfb44f54 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:13.123729 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:13.238724 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644cfd0-edaa-48a0-beaa-c55bedb667a7 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:13.269165 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e826745-63b4-4ed2-a6cb-f253cfb44f54 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:13.285006 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2d3a2-fdca-4455-b0ef-016cbce3ab0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:13.285739 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2d3a2-fdca-4455-b0ef-016cbce3ab0b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:13.286019 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2d3a2-fdca-4455-b0ef-016cbce3ab0b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:13.286292 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2d3a2-fdca-4455-b0ef-016cbce3ab0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:13.300965 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2d3a2-fdca-4455-b0ef-016cbce3ab0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:13.311259 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-5da2d3a2-fdca-4455-b0ef-016cbce3ab0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:43:13.311259 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:13.311259 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:13.311259 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:13.311259 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:13.311259 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:13.311259 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:13.311259 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:13.311259 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:13.311259 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:13.311259 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:13.311259 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:13.311259 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:13.311259 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:13.311259 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:13.311259 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:13.312188 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:13.312188 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:13.312188 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:13.312188 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:13.312188 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:13.312188 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:13.312188 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:13.312188 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:13.312188 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:13.312188 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:13.312188 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:13.312188 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:13.312188 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:13.312188 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:13.312188 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:13.312188 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:13.312992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:13.312992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:13.312992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:13.312992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:13.312992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:13.312992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:13.312992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:13.312992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:13.312992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:13.312992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:13.312992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:43:13.312992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:13.312992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 204/409] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:43:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:13.314216 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e2b7c-7367-450c-9933-a6b9c4b69617 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:13.314216 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e2b7c-7367-450c-9933-a6b9c4b69617 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:13.314386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e2b7c-7367-450c-9933-a6b9c4b69617 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:13.315715 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 205/410] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:13.320021 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e2b7c-7367-450c-9933-a6b9c4b69617 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:13.321451 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7a069-fd78-40aa-bfee-f407cad92e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:13.322334 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7a069-fd78-40aa-bfee-f407cad92e5c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:13.322614 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7a069-fd78-40aa-bfee-f407cad92e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:13.322896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7a069-fd78-40aa-bfee-f407cad92e5c None admin] PATH_INFO: `/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:13.325585 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b7a069-fd78-40aa-bfee-f407cad92e5c None admin] RBAC: Authorizing `identity:get_project(project_id=e7ac8d54998946acb55e1b10e3a9c30b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:13.327038 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b7a069-fd78-40aa-bfee-f407cad92e5c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:13.328874 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 206/411] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:43:13 2022] GET /identity/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:13.330044 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1aac0a-bec3-4614-a018-84f7468784e1 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:13.330326 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1aac0a-bec3-4614-a018-84f7468784e1 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:13.330598 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1aac0a-bec3-4614-a018-84f7468784e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:13.354536 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-4c1aac0a-bec3-4614-a018-84f7468784e1 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:13.356156 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4c1aac0a-bec3-4614-a018-84f7468784e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:13.392622 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:13.431775 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 207/412] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:13.433016 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1aac0a-bec3-4614-a018-84f7468784e1 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:13.457739 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e2b7c-7367-450c-9933-a6b9c4b69617 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:13.475561 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:13.503963 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76222e01-dea8-44ed-b6ca-b212e0ccb0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:13.505370 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76222e01-dea8-44ed-b6ca-b212e0ccb0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:13.506101 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76222e01-dea8-44ed-b6ca-b212e0ccb0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:13.506624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76222e01-dea8-44ed-b6ca-b212e0ccb0e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:13.508309 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76222e01-dea8-44ed-b6ca-b212e0ccb0e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:13.508869 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76222e01-dea8-44ed-b6ca-b212e0ccb0e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:13.511159 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76222e01-dea8-44ed-b6ca-b212e0ccb0e7 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:13.523993 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 206/413] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:43:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:13.529954 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76222e01-dea8-44ed-b6ca-b212e0ccb0e7 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:13.575768 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1aac0a-bec3-4614-a018-84f7468784e1 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:13.619481 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3ffdf-2bc7-4cd8-8a84-c5e586ffb0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:13.620775 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3ffdf-2bc7-4cd8-8a84-c5e586ffb0a7 None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:13.621250 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3ffdf-2bc7-4cd8-8a84-c5e586ffb0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:13.621788 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3ffdf-2bc7-4cd8-8a84-c5e586ffb0a7 None admin] PATH_INFO: `/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b/groups/eb0b5be77d6246ec9d0b5ebcdbca517a/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:13.624937 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3ffdf-2bc7-4cd8-8a84-c5e586ffb0a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e7ac8d54998946acb55e1b10e3a9c30b, group_id=eb0b5be77d6246ec9d0b5ebcdbca517a, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:13.627531 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3ffdf-2bc7-4cd8-8a84-c5e586ffb0a7 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:13.647567 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 208/414] 10.222.0.16 () {58 vars in 1442 bytes} [Mon Jul 4 05:43:13 2022] PUT /identity/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b/groups/eb0b5be77d6246ec9d0b5ebcdbca517a/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:43:13.648704 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3ffdf-2bc7-4cd8-8a84-c5e586ffb0a7 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:13.674217 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76222e01-dea8-44ed-b6ca-b212e0ccb0e7 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:13.691949 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:13.737967 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba96bc-b536-48bf-9674-9113cf91b687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:13.739645 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba96bc-b536-48bf-9674-9113cf91b687 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:13.740119 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba96bc-b536-48bf-9674-9113cf91b687 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:13.740753 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba96bc-b536-48bf-9674-9113cf91b687 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:13.757132 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba96bc-b536-48bf-9674-9113cf91b687 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:13.767784 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-ffba96bc-b536-48bf-9674-9113cf91b687 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:43:13.767784 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:13.767784 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:13.767784 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:13.767784 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:13.767784 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:13.767784 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:13.767784 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:13.767784 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:13.767784 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:13.767784 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:13.767784 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:13.767784 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:13.767784 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:13.767784 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:13.767784 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:13.768731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:13.768731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:13.768731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:13.768731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:13.768731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:13.768731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:13.768731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:13.768731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:13.768731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:13.768731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:13.768731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:13.768731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:13.768731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:13.768731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:13.768731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:13.768731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:13.769491 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:13.769491 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:13.769491 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:13.769491 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:13.769491 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:13.769491 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:13.769491 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:13.769491 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:13.769491 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:13.769491 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:13.769491 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:43:13.769491 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:13.771098 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:13.773041 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 207/415] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:43:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:13.779286 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc71c64-2a5c-4554-b250-f1a4846c00da None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:13.779286 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc71c64-2a5c-4554-b250-f1a4846c00da None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:13.779286 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc71c64-2a5c-4554-b250-f1a4846c00da None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:13.779598 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 208/416] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:13.781172 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc71c64-2a5c-4554-b250-f1a4846c00da None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:13.811554 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3ffdf-2bc7-4cd8-8a84-c5e586ffb0a7 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:13.857103 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b332e1-494a-40d7-a387-297ae1c91eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:13.858110 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b332e1-494a-40d7-a387-297ae1c91eec None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:13.858415 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b332e1-494a-40d7-a387-297ae1c91eec None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:13.858707 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b332e1-494a-40d7-a387-297ae1c91eec None admin] PATH_INFO: `/v3/groups/e0b42ddf4d4e44b8b09f5d8c40177532` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:13.860595 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b332e1-494a-40d7-a387-297ae1c91eec None admin] RBAC: Authorizing `identity:get_group(group_id=e0b42ddf4d4e44b8b09f5d8c40177532)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:13.862386 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b332e1-494a-40d7-a387-297ae1c91eec None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:13.865467 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 209/417] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 4 05:43:13 2022] GET /identity/v3/groups/e0b42ddf4d4e44b8b09f5d8c40177532 => generated 229 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:13.866774 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c16a9-20e8-454a-8b41-1bd404c46da8 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:13.867061 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c16a9-20e8-454a-8b41-1bd404c46da8 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:13.867371 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c16a9-20e8-454a-8b41-1bd404c46da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:13.889560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-005c16a9-20e8-454a-8b41-1bd404c46da8 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:13.891140 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-005c16a9-20e8-454a-8b41-1bd404c46da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:13.916922 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc71c64-2a5c-4554-b250-f1a4846c00da None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:13.964294 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732280c-56f3-4f81-8580-9fd6f7339405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:13.964981 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732280c-56f3-4f81-8580-9fd6f7339405 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:13.965298 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732280c-56f3-4f81-8580-9fd6f7339405 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:13.965579 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732280c-56f3-4f81-8580-9fd6f7339405 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:13.966329 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732280c-56f3-4f81-8580-9fd6f7339405 None admin] RBAC: Adding query filter params (name=member) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:13.966640 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732280c-56f3-4f81-8580-9fd6f7339405 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:13.968180 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732280c-56f3-4f81-8580-9fd6f7339405 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:13.969165 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 210/418] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:13.970648 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c16a9-20e8-454a-8b41-1bd404c46da8 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:13.987680 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 209/419] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 4 05:43:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:13.996144 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732280c-56f3-4f81-8580-9fd6f7339405 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:14.030498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:14.091379 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:14.103921 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732280c-56f3-4f81-8580-9fd6f7339405 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:14.132568 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c16a9-20e8-454a-8b41-1bd404c46da8 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:14.140133 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836533a8-dc8a-4b7a-8f2d-78be7485d867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:14.140790 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836533a8-dc8a-4b7a-8f2d-78be7485d867 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:14.141171 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836533a8-dc8a-4b7a-8f2d-78be7485d867 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:14.141622 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836533a8-dc8a-4b7a-8f2d-78be7485d867 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:14.175242 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa3e2c-6be4-4f7a-b3f1-dab71e57804c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:14.176136 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa3e2c-6be4-4f7a-b3f1-dab71e57804c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:14.176414 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa3e2c-6be4-4f7a-b3f1-dab71e57804c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:14.176685 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa3e2c-6be4-4f7a-b3f1-dab71e57804c None admin] PATH_INFO: `/v3/projects/b420ef42d5dc484fb1563cbae9f104d5` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:14.177925 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa3e2c-6be4-4f7a-b3f1-dab71e57804c None admin] RBAC: Authorizing `identity:get_project(project_id=b420ef42d5dc484fb1563cbae9f104d5)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:14.179484 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa3e2c-6be4-4f7a-b3f1-dab71e57804c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:14.181496 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 211/420] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:43:13 2022] GET /identity/v3/projects/b420ef42d5dc484fb1563cbae9f104d5 => generated 344 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:14.182091 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa3e2c-6be4-4f7a-b3f1-dab71e57804c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:14.225548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836533a8-dc8a-4b7a-8f2d-78be7485d867 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:14.227893 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836533a8-dc8a-4b7a-8f2d-78be7485d867 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:14.262919 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:14.284418 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa3e2c-6be4-4f7a-b3f1-dab71e57804c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:14.320722 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a231437-aa3d-4eb7-b5d5-e087be5b305a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:14.321715 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a231437-aa3d-4eb7-b5d5-e087be5b305a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:14.322088 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a231437-aa3d-4eb7-b5d5-e087be5b305a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:14.322474 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a231437-aa3d-4eb7-b5d5-e087be5b305a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:14.330597 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:14.333583 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a231437-aa3d-4eb7-b5d5-e087be5b305a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:14.343000 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-4a231437-aa3d-4eb7-b5d5-e087be5b305a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 05:43:14.343000 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:14.343000 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:14.343000 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:14.343000 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:14.343000 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:14.343000 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:14.343000 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:14.343000 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:14.343000 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:14.343000 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:14.343000 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:14.343000 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:14.343000 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:14.343000 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:14.343000 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:14.343893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:14.343893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:14.343893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:14.343893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:14.343893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:14.343893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:14.343893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:14.343893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:14.343893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:14.343893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:14.343893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:14.343893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:14.343893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:14.343893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:14.343893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:14.343893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:14.344658 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:14.344658 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:14.344658 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:14.344658 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:14.344658 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:14.344658 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:14.344658 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:14.344658 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:14.344658 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:14.344658 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:14.344658 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 05:43:14.344658 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:14.345237 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 210/421] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:43:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 05:43:14.345237 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836533a8-dc8a-4b7a-8f2d-78be7485d867 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:14.347392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 212/422] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 4 05:43:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:14.349273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a231437-aa3d-4eb7-b5d5-e087be5b305a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:14.451672 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a231437-aa3d-4eb7-b5d5-e087be5b305a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:14.475254 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836533a8-dc8a-4b7a-8f2d-78be7485d867 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:14.486645 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729610d5-8ed7-46d9-8e7e-83c9317b129a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:14.487816 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729610d5-8ed7-46d9-8e7e-83c9317b129a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:14.488285 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729610d5-8ed7-46d9-8e7e-83c9317b129a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:14.488740 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729610d5-8ed7-46d9-8e7e-83c9317b129a None admin] PATH_INFO: `/v3/projects/3811ac7a7eab4e3e9040f45371523192` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:14.490100 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729610d5-8ed7-46d9-8e7e-83c9317b129a None admin] RBAC: Authorizing `identity:get_project(project_id=3811ac7a7eab4e3e9040f45371523192)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:14.491842 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729610d5-8ed7-46d9-8e7e-83c9317b129a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:14.498634 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 213/423] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:43:14 2022] GET /identity/v3/projects/3811ac7a7eab4e3e9040f45371523192 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:43:14.499698 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729610d5-8ed7-46d9-8e7e-83c9317b129a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:14.508828 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:14.515876 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abdd30-3304-4347-b5cc-e3ce65d01150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:14.517209 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abdd30-3304-4347-b5cc-e3ce65d01150 None admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:14.517485 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abdd30-3304-4347-b5cc-e3ce65d01150 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:14.517769 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abdd30-3304-4347-b5cc-e3ce65d01150 None admin] PATH_INFO: `/v3/projects/b420ef42d5dc484fb1563cbae9f104d5/groups/e0b42ddf4d4e44b8b09f5d8c40177532/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:14.520617 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95abdd30-3304-4347-b5cc-e3ce65d01150 None admin] RBAC: Authorizing `identity:create_grant(project_id=b420ef42d5dc484fb1563cbae9f104d5, group_id=e0b42ddf4d4e44b8b09f5d8c40177532, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:14.522546 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95abdd30-3304-4347-b5cc-e3ce65d01150 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:14.540375 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 211/424] 10.222.0.16 () {58 vars in 1442 bytes} [Mon Jul 4 05:43:14 2022] PUT /identity/v3/projects/b420ef42d5dc484fb1563cbae9f104d5/groups/e0b42ddf4d4e44b8b09f5d8c40177532/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:43:14.541084 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abdd30-3304-4347-b5cc-e3ce65d01150 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:14.663613 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abdd30-3304-4347-b5cc-e3ce65d01150 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:14.679572 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:14.706134 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84453ee8-27ec-4142-98ee-48da49ea91df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:14.707161 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84453ee8-27ec-4142-98ee-48da49ea91df None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:14.707473 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84453ee8-27ec-4142-98ee-48da49ea91df None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:14.708070 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84453ee8-27ec-4142-98ee-48da49ea91df None admin] PATH_INFO: `/v3/groups/eb0b5be77d6246ec9d0b5ebcdbca517a` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:14.709528 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84453ee8-27ec-4142-98ee-48da49ea91df None admin] RBAC: Authorizing `identity:get_group(group_id=eb0b5be77d6246ec9d0b5ebcdbca517a)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:14.711517 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84453ee8-27ec-4142-98ee-48da49ea91df None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:14.713768 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 212/425] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 4 05:43:14 2022] GET /identity/v3/groups/eb0b5be77d6246ec9d0b5ebcdbca517a => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:14.719912 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84453ee8-27ec-4142-98ee-48da49ea91df None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:14.722266 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729610d5-8ed7-46d9-8e7e-83c9317b129a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:14.757250 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1607d38-7334-494a-aaa7-d006b52a9a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:14.757976 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1607d38-7334-494a-aaa7-d006b52a9a2e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:14.758256 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1607d38-7334-494a-aaa7-d006b52a9a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:14.758567 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1607d38-7334-494a-aaa7-d006b52a9a2e None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:14.759338 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1607d38-7334-494a-aaa7-d006b52a9a2e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:14.759639 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1607d38-7334-494a-aaa7-d006b52a9a2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:14.761165 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1607d38-7334-494a-aaa7-d006b52a9a2e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:14.770047 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 214/426] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:43:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:14.775511 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1607d38-7334-494a-aaa7-d006b52a9a2e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:14.792017 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:14.846865 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84453ee8-27ec-4142-98ee-48da49ea91df None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:14.886627 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1607d38-7334-494a-aaa7-d006b52a9a2e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:14.894206 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b903a7-5289-4489-a211-e694333e1b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:14.894876 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b903a7-5289-4489-a211-e694333e1b75 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:14.895153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b903a7-5289-4489-a211-e694333e1b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:14.896237 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b903a7-5289-4489-a211-e694333e1b75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:14.901445 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b903a7-5289-4489-a211-e694333e1b75 None admin] RBAC: Adding query filter params (group.id=eb0b5be77d6246ec9d0b5ebcdbca517a, role.id=9fdc0a5e493c44c9add5859af9d4f394, scope.project.id=3811ac7a7eab4e3e9040f45371523192) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:14.901766 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b903a7-5289-4489-a211-e694333e1b75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:14.903288 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b903a7-5289-4489-a211-e694333e1b75 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:14.916574 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 213/427] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jul 4 05:43:14 2022] GET /identity/v3/role_assignments?group.id=eb0b5be77d6246ec9d0b5ebcdbca517a&scope.project.id=3811ac7a7eab4e3e9040f45371523192&role.id=9fdc0a5e493c44c9add5859af9d4f394 => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:43:14.945047 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596754b-bf1e-451f-a65b-fe44a8f10f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:14.945755 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596754b-bf1e-451f-a65b-fe44a8f10f08 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:14.946039 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596754b-bf1e-451f-a65b-fe44a8f10f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:14.950959 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596754b-bf1e-451f-a65b-fe44a8f10f08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:14.967500 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:15.049526 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596754b-bf1e-451f-a65b-fe44a8f10f08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:15.050997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596754b-bf1e-451f-a65b-fe44a8f10f08 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:15.206266 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 215/428] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:43:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 04 05:43:15.211900 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b903a7-5289-4489-a211-e694333e1b75 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:15.320569 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b903a7-5289-4489-a211-e694333e1b75 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:15.347946 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:15.360118 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867da59c-bd66-4af2-a962-be9df6e35960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:15.360995 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867da59c-bd66-4af2-a962-be9df6e35960 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:15.361272 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867da59c-bd66-4af2-a962-be9df6e35960 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:15.361542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867da59c-bd66-4af2-a962-be9df6e35960 None admin] PATH_INFO: `/v3/projects/3811ac7a7eab4e3e9040f45371523192` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:15.362772 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867da59c-bd66-4af2-a962-be9df6e35960 None admin] RBAC: Authorizing `identity:get_project(project_id=3811ac7a7eab4e3e9040f45371523192)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:15.364334 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867da59c-bd66-4af2-a962-be9df6e35960 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:15.366349 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 214/429] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:43:15 2022] GET /identity/v3/projects/3811ac7a7eab4e3e9040f45371523192 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:15.372045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596754b-bf1e-451f-a65b-fe44a8f10f08 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:15.401027 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f72ff-f818-42fe-85ec-29d56c29f904 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:15.401337 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f72ff-f818-42fe-85ec-29d56c29f904 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:15.401585 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f72ff-f818-42fe-85ec-29d56c29f904 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:15.403076 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 215/430] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:43:15.416073 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e979a8-7b20-47f1-9a4d-507aa4cd336e None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:15.416374 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e979a8-7b20-47f1-9a4d-507aa4cd336e None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:15.416630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e979a8-7b20-47f1-9a4d-507aa4cd336e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:15.418852 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:15.439972 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-41e979a8-7b20-47f1-9a4d-507aa4cd336e None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:15.441321 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-41e979a8-7b20-47f1-9a4d-507aa4cd336e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:15.505859 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596754b-bf1e-451f-a65b-fe44a8f10f08 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:15.522994 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 216/431] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 05:43:15.547907 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310da48-ba0a-4e91-afb2-9e43a97caca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:15.548773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310da48-ba0a-4e91-afb2-9e43a97caca5 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:15.549053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310da48-ba0a-4e91-afb2-9e43a97caca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:15.549324 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310da48-ba0a-4e91-afb2-9e43a97caca5 None admin] PATH_INFO: `/v3/groups/eb0b5be77d6246ec9d0b5ebcdbca517a` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:15.550504 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310da48-ba0a-4e91-afb2-9e43a97caca5 None admin] RBAC: Authorizing `identity:get_group(group_id=eb0b5be77d6246ec9d0b5ebcdbca517a)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:15.551978 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310da48-ba0a-4e91-afb2-9e43a97caca5 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:15.553903 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 216/432] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 4 05:43:15 2022] GET /identity/v3/groups/eb0b5be77d6246ec9d0b5ebcdbca517a => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:43:15.559734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e979a8-7b20-47f1-9a4d-507aa4cd336e None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:15.560774 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310da48-ba0a-4e91-afb2-9e43a97caca5 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:15.692736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310da48-ba0a-4e91-afb2-9e43a97caca5 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:15.695504 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:15.697815 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e979a8-7b20-47f1-9a4d-507aa4cd336e None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:15.732599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:15.744936 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15163a73-8df6-46f2-88d3-6792cbe99ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:15.745598 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15163a73-8df6-46f2-88d3-6792cbe99ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:15.745878 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15163a73-8df6-46f2-88d3-6792cbe99ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:15.746175 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15163a73-8df6-46f2-88d3-6792cbe99ec6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:15.747016 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15163a73-8df6-46f2-88d3-6792cbe99ec6 None admin] RBAC: Adding query filter params (group.id=eb0b5be77d6246ec9d0b5ebcdbca517a, role.id=91c119444803497dafe274cc66f05208, scope.project.id=3811ac7a7eab4e3e9040f45371523192) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:15.747358 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15163a73-8df6-46f2-88d3-6792cbe99ec6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:15.749126 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15163a73-8df6-46f2-88d3-6792cbe99ec6 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:15.756305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 217/433] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jul 4 05:43:15 2022] GET /identity/v3/role_assignments?group.id=eb0b5be77d6246ec9d0b5ebcdbca517a&scope.project.id=3811ac7a7eab4e3e9040f45371523192&role.id=91c119444803497dafe274cc66f05208 => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:15.756912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6760c95-8fa0-49ff-a5aa-0b7b3233ef93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:15.757808 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6760c95-8fa0-49ff-a5aa-0b7b3233ef93 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:15.758098 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6760c95-8fa0-49ff-a5aa-0b7b3233ef93 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:15.758369 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6760c95-8fa0-49ff-a5aa-0b7b3233ef93 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:15.780543 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6760c95-8fa0-49ff-a5aa-0b7b3233ef93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:15.790985 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-f6760c95-8fa0-49ff-a5aa-0b7b3233ef93 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 05:43:15.790985 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:15.790985 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:15.790985 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:15.790985 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:15.790985 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:15.790985 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:15.790985 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:15.790985 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:15.790985 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:15.790985 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:15.790985 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:15.790985 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:15.790985 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:15.790985 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:15.790985 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:15.791989 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:15.791989 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:15.791989 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:15.791989 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:15.791989 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:15.791989 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:15.791989 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:15.791989 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:15.791989 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:15.791989 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:15.791989 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:15.791989 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:15.791989 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:15.791989 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:15.791989 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:15.791989 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:15.792797 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:15.792797 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:15.792797 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:15.792797 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:15.792797 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:15.792797 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:15.792797 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:15.792797 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:15.792797 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:15.792797 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:15.792797 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 05:43:15.792797 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:15.795375 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 217/434] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 4 05:43:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:15.803076 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15163a73-8df6-46f2-88d3-6792cbe99ec6 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:15.923525 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ce8ba-b7aa-4a5d-ae80-62324c07bdc1 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:15.924049 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ce8ba-b7aa-4a5d-ae80-62324c07bdc1 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:15.924494 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ce8ba-b7aa-4a5d-ae80-62324c07bdc1 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:15.926066 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 218/435] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:15.932322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fc58a-07d6-4ddc-a203-ff07447a45c9 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:15.932833 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fc58a-07d6-4ddc-a203-ff07447a45c9 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:15.933235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fc58a-07d6-4ddc-a203-ff07447a45c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:15.961008 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a58fc58a-07d6-4ddc-a203-ff07447a45c9 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:15.962204 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a58fc58a-07d6-4ddc-a203-ff07447a45c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:15.974516 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15163a73-8df6-46f2-88d3-6792cbe99ec6 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:16.015992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3a4f6-db5a-49a9-8125-a8c38f6c66aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:16.016913 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3a4f6-db5a-49a9-8125-a8c38f6c66aa None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:16.017352 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3a4f6-db5a-49a9-8125-a8c38f6c66aa None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:16.017778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3a4f6-db5a-49a9-8125-a8c38f6c66aa None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:16.018679 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3a4f6-db5a-49a9-8125-a8c38f6c66aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:16.019126 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3a4f6-db5a-49a9-8125-a8c38f6c66aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:16.020697 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3a4f6-db5a-49a9-8125-a8c38f6c66aa None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:16.034367 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 218/436] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:43:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:16.039624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3a4f6-db5a-49a9-8125-a8c38f6c66aa None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:16.060108 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 219/437] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 05:43:16.083677 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fc58a-07d6-4ddc-a203-ff07447a45c9 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:16.104611 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:16.173006 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3a4f6-db5a-49a9-8125-a8c38f6c66aa None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:16.203501 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:16.219449 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fc58a-07d6-4ddc-a203-ff07447a45c9 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:16.224623 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003b193-8d7c-477f-9bfe-083609a8b655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:16.226799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003b193-8d7c-477f-9bfe-083609a8b655 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:16.227341 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003b193-8d7c-477f-9bfe-083609a8b655 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:16.228111 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003b193-8d7c-477f-9bfe-083609a8b655 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:16.270253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2dce1-e258-4e62-be44-d32038b70fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:16.272801 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2dce1-e258-4e62-be44-d32038b70fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:16.272801 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2dce1-e258-4e62-be44-d32038b70fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:16.272801 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2dce1-e258-4e62-be44-d32038b70fa9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:16.287829 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2dce1-e258-4e62-be44-d32038b70fa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:16.301183 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-0ea2dce1-e258-4e62-be44-d32038b70fa9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:43:16.301183 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:16.301183 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:16.301183 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:16.301183 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:16.301183 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:16.301183 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:16.301183 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:16.301183 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:16.301183 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:16.301183 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:16.301183 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:16.301183 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:16.301183 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:16.301183 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:16.301183 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:16.302130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:16.302130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:16.302130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:16.302130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:16.302130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:16.302130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:16.302130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:16.302130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:16.302130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:16.302130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:16.302130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:16.302130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:16.302130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:16.302130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:16.302130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:16.302130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:16.302922 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:16.302922 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:16.302922 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:16.302922 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:16.302922 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:16.302922 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:16.302922 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:16.302922 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:16.302922 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:16.302922 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:16.302922 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 05:43:16.302922 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:16.303546 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 220/438] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:43:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:43:16.311533 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2dce1-e258-4e62-be44-d32038b70fa9 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:16.318347 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003b193-8d7c-477f-9bfe-083609a8b655 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:16.320073 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003b193-8d7c-477f-9bfe-083609a8b655 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:16.378719 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:16.427209 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2dce1-e258-4e62-be44-d32038b70fa9 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:16.441559 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 219/439] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:43:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 04 05:43:16.447087 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003b193-8d7c-477f-9bfe-083609a8b655 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:16.470273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab459912-245c-4db9-a322-8b943ddb9319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:16.471805 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab459912-245c-4db9-a322-8b943ddb9319 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:16.472295 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab459912-245c-4db9-a322-8b943ddb9319 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:16.472886 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab459912-245c-4db9-a322-8b943ddb9319 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:16.474265 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab459912-245c-4db9-a322-8b943ddb9319 None admin] RBAC: Adding query filter params (name=member) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:16.474848 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab459912-245c-4db9-a322-8b943ddb9319 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:16.477034 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab459912-245c-4db9-a322-8b943ddb9319 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:16.486352 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 221/440] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 4 05:43:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:16.491893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab459912-245c-4db9-a322-8b943ddb9319 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:16.505920 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:16.556912 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003b193-8d7c-477f-9bfe-083609a8b655 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:16.594573 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22814458-de25-4be9-abd4-343d71616b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:16.595487 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22814458-de25-4be9-abd4-343d71616b60 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:16.595771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22814458-de25-4be9-abd4-343d71616b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:16.596046 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22814458-de25-4be9-abd4-343d71616b60 None admin] PATH_INFO: `/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:16.597237 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22814458-de25-4be9-abd4-343d71616b60 None admin] RBAC: Authorizing `identity:get_project(project_id=e7ac8d54998946acb55e1b10e3a9c30b)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:16.598677 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22814458-de25-4be9-abd4-343d71616b60 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:16.600441 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 220/441] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:43:16 2022] GET /identity/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:43:16.602870 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab459912-245c-4db9-a322-8b943ddb9319 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:16.605760 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22814458-de25-4be9-abd4-343d71616b60 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:16.623859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:16.640005 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138a34d-5173-48d0-b7f5-7b35bd49327e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:16.640663 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138a34d-5173-48d0-b7f5-7b35bd49327e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:16.641077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138a34d-5173-48d0-b7f5-7b35bd49327e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:16.641364 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138a34d-5173-48d0-b7f5-7b35bd49327e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:16.707057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22814458-de25-4be9-abd4-343d71616b60 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:16.711965 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138a34d-5173-48d0-b7f5-7b35bd49327e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:16.713436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138a34d-5173-48d0-b7f5-7b35bd49327e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:16.724520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:16.742339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f02ee-3822-4ef8-84fa-d4bc5c799055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:16.743226 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f02ee-3822-4ef8-84fa-d4bc5c799055 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:16.743512 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f02ee-3822-4ef8-84fa-d4bc5c799055 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:16.743783 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f02ee-3822-4ef8-84fa-d4bc5c799055 None admin] PATH_INFO: `/v3/groups/eb0b5be77d6246ec9d0b5ebcdbca517a` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:16.745095 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f02ee-3822-4ef8-84fa-d4bc5c799055 None admin] RBAC: Authorizing `identity:get_group(group_id=eb0b5be77d6246ec9d0b5ebcdbca517a)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:16.746590 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f02ee-3822-4ef8-84fa-d4bc5c799055 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:16.748771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 221/442] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 4 05:43:16 2022] GET /identity/v3/groups/eb0b5be77d6246ec9d0b5ebcdbca517a => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:43:16.754328 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f02ee-3822-4ef8-84fa-d4bc5c799055 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:16.816893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 222/443] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:43:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 05:43:16.822731 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138a34d-5173-48d0-b7f5-7b35bd49327e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:16.848325 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:16.864259 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f02ee-3822-4ef8-84fa-d4bc5c799055 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:16.898460 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ea10e-aff5-4328-a85a-76c97f4a2119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:16.899115 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ea10e-aff5-4328-a85a-76c97f4a2119 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:16.899442 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ea10e-aff5-4328-a85a-76c97f4a2119 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:16.899721 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ea10e-aff5-4328-a85a-76c97f4a2119 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:16.900557 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ea10e-aff5-4328-a85a-76c97f4a2119 None admin] RBAC: Adding query filter params (group.id=eb0b5be77d6246ec9d0b5ebcdbca517a, role.id=91c119444803497dafe274cc66f05208, scope.project.id=e7ac8d54998946acb55e1b10e3a9c30b) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:16.900875 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ea10e-aff5-4328-a85a-76c97f4a2119 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:16.902358 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ea10e-aff5-4328-a85a-76c97f4a2119 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:16.908936 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 222/444] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jul 4 05:43:16 2022] GET /identity/v3/role_assignments?group.id=eb0b5be77d6246ec9d0b5ebcdbca517a&scope.project.id=e7ac8d54998946acb55e1b10e3a9c30b&role.id=91c119444803497dafe274cc66f05208 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:43:16.915604 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136f0aa-1652-49dc-9cf0-f8ec6523610c None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:16.915888 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136f0aa-1652-49dc-9cf0-f8ec6523610c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:16.916162 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136f0aa-1652-49dc-9cf0-f8ec6523610c None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:16.917607 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 223/445] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:43:16.923401 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f8e7c-5cdc-49c1-b3e2-da19c11400b0 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:16.923697 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f8e7c-5cdc-49c1-b3e2-da19c11400b0 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:16.923960 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f8e7c-5cdc-49c1-b3e2-da19c11400b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:16.937661 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138a34d-5173-48d0-b7f5-7b35bd49327e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:16.940964 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-b17f8e7c-5cdc-49c1-b3e2-da19c11400b0 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:16.942186 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b17f8e7c-5cdc-49c1-b3e2-da19c11400b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:16.949999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:16.979092 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15e357-3327-44ea-95e5-52560fea1b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:16.979975 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15e357-3327-44ea-95e5-52560fea1b72 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:16.980258 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15e357-3327-44ea-95e5-52560fea1b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:16.980609 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15e357-3327-44ea-95e5-52560fea1b72 None admin] PATH_INFO: `/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:16.981877 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15e357-3327-44ea-95e5-52560fea1b72 None admin] RBAC: Authorizing `identity:get_project(project_id=e7ac8d54998946acb55e1b10e3a9c30b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:16.983426 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15e357-3327-44ea-95e5-52560fea1b72 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:16.985222 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 223/446] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:43:16 2022] GET /identity/v3/projects/e7ac8d54998946acb55e1b10e3a9c30b => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:16.990962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15e357-3327-44ea-95e5-52560fea1b72 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:17.027233 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 224/447] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 05:43:17.050440 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f8e7c-5cdc-49c1-b3e2-da19c11400b0 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:17.107819 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15e357-3327-44ea-95e5-52560fea1b72 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:17.140520 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:17.142241 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f708e-39ed-4683-81b3-722ce714854c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:17.143132 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f708e-39ed-4683-81b3-722ce714854c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:17.143497 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f708e-39ed-4683-81b3-722ce714854c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:17.143772 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f708e-39ed-4683-81b3-722ce714854c None admin] PATH_INFO: `/v3/groups/eb0b5be77d6246ec9d0b5ebcdbca517a` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:17.144954 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f708e-39ed-4683-81b3-722ce714854c None admin] RBAC: Authorizing `identity:get_group(group_id=eb0b5be77d6246ec9d0b5ebcdbca517a)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:17.146410 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f708e-39ed-4683-81b3-722ce714854c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:17.148268 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 224/448] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 4 05:43:16 2022] GET /identity/v3/groups/eb0b5be77d6246ec9d0b5ebcdbca517a => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:17.153856 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f708e-39ed-4683-81b3-722ce714854c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:17.164011 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f8e7c-5cdc-49c1-b3e2-da19c11400b0 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:17.196253 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81616e8b-2f87-4b49-98fd-0457f1b2a8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:17.197038 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81616e8b-2f87-4b49-98fd-0457f1b2a8a8 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:17.197318 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81616e8b-2f87-4b49-98fd-0457f1b2a8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:17.197593 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81616e8b-2f87-4b49-98fd-0457f1b2a8a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:17.198503 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:17.208489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81616e8b-2f87-4b49-98fd-0457f1b2a8a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:17.216148 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-81616e8b-2f87-4b49-98fd-0457f1b2a8a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:43:17.216148 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:17.216148 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:17.216148 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:17.216148 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:17.216148 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:17.216148 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:17.216148 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:17.216148 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:17.216148 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:17.216148 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:17.216148 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:17.216148 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:17.216148 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:17.216148 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:17.216148 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:17.217189 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:17.217189 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:17.217189 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:17.217189 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:17.217189 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:17.217189 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:17.217189 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:17.217189 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:17.217189 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:17.217189 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:17.217189 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:17.217189 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:17.217189 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:17.217189 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:17.217189 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:17.217189 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:17.217977 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:17.217977 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:17.217977 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:17.217977 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:17.217977 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:17.217977 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:17.217977 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:17.217977 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:17.217977 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:17.217977 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:17.217977 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:43:17.217977 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:17.217977 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 225/449] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:43:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:17.223016 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81616e8b-2f87-4b49-98fd-0457f1b2a8a8 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:17.263662 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f708e-39ed-4683-81b3-722ce714854c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:17.298239 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7cd7d2-dbc9-4deb-8cd6-f991900a24b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:17.298885 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7cd7d2-dbc9-4deb-8cd6-f991900a24b9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:17.299159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7cd7d2-dbc9-4deb-8cd6-f991900a24b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:17.299457 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7cd7d2-dbc9-4deb-8cd6-f991900a24b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:17.300276 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7cd7d2-dbc9-4deb-8cd6-f991900a24b9 None admin] RBAC: Adding query filter params (group.id=eb0b5be77d6246ec9d0b5ebcdbca517a, role.id=9fdc0a5e493c44c9add5859af9d4f394, scope.project.id=e7ac8d54998946acb55e1b10e3a9c30b) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:17.300582 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7cd7d2-dbc9-4deb-8cd6-f991900a24b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:17.302035 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7cd7d2-dbc9-4deb-8cd6-f991900a24b9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:17.308018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 225/450] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jul 4 05:43:17 2022] GET /identity/v3/role_assignments?group.id=eb0b5be77d6246ec9d0b5ebcdbca517a&scope.project.id=e7ac8d54998946acb55e1b10e3a9c30b&role.id=9fdc0a5e493c44c9add5859af9d4f394 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:43:17.323916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81616e8b-2f87-4b49-98fd-0457f1b2a8a8 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:17.361297 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cde17-5fa5-4fba-8cc0-ee35c6ae0f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:17.361897 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cde17-5fa5-4fba-8cc0-ee35c6ae0f7e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:17.362175 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cde17-5fa5-4fba-8cc0-ee35c6ae0f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:17.362436 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cde17-5fa5-4fba-8cc0-ee35c6ae0f7e None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:17.363286 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6cde17-5fa5-4fba-8cc0-ee35c6ae0f7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:17.363554 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6cde17-5fa5-4fba-8cc0-ee35c6ae0f7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:17.364985 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6cde17-5fa5-4fba-8cc0-ee35c6ae0f7e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:17.370906 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:17.376877 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 226/451] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:43:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:43:17.381650 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7cd7d2-dbc9-4deb-8cd6-f991900a24b9 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:17.487635 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7cd7d2-dbc9-4deb-8cd6-f991900a24b9 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:17.498470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:17.523718 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c81dc2-000d-4a04-880e-92aad37794f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:17.524701 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c81dc2-000d-4a04-880e-92aad37794f1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:17.525191 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c81dc2-000d-4a04-880e-92aad37794f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:17.525685 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c81dc2-000d-4a04-880e-92aad37794f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:17.615686 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c81dc2-000d-4a04-880e-92aad37794f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:17.617093 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c81dc2-000d-4a04-880e-92aad37794f1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:17.715235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 226/452] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:43:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 05:43:17.720505 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cde17-5fa5-4fba-8cc0-ee35c6ae0f7e None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:17.826168 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cde17-5fa5-4fba-8cc0-ee35c6ae0f7e None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:17.863977 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661a96a-cd07-433c-928a-f2b439a32556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:17.864838 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661a96a-cd07-433c-928a-f2b439a32556 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:17.865125 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661a96a-cd07-433c-928a-f2b439a32556 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:17.865413 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661a96a-cd07-433c-928a-f2b439a32556 None admin] PATH_INFO: `/v3/projects/b420ef42d5dc484fb1563cbae9f104d5` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:17.866687 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661a96a-cd07-433c-928a-f2b439a32556 None admin] RBAC: Authorizing `identity:get_project(project_id=b420ef42d5dc484fb1563cbae9f104d5)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:17.868101 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661a96a-cd07-433c-928a-f2b439a32556 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:17.869809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 227/453] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:43:17 2022] GET /identity/v3/projects/b420ef42d5dc484fb1563cbae9f104d5 => generated 344 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:17.876640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c81dc2-000d-4a04-880e-92aad37794f1 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:17.892376 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:17.986021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c81dc2-000d-4a04-880e-92aad37794f1 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:18.024175 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b79d02-e568-4611-b357-5f223cac15cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:18.025016 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b79d02-e568-4611-b357-5f223cac15cf None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:18.025292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b79d02-e568-4611-b357-5f223cac15cf None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:18.025562 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b79d02-e568-4611-b357-5f223cac15cf None admin] PATH_INFO: `/v3/groups/e0b42ddf4d4e44b8b09f5d8c40177532` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:18.026825 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b79d02-e568-4611-b357-5f223cac15cf None admin] RBAC: Authorizing `identity:get_group(group_id=e0b42ddf4d4e44b8b09f5d8c40177532)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:18.028355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b79d02-e568-4611-b357-5f223cac15cf None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:18.029983 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 227/454] 10.222.0.16 () {56 vars in 1180 bytes} [Mon Jul 4 05:43:17 2022] GET /identity/v3/groups/e0b42ddf4d4e44b8b09f5d8c40177532 => generated 229 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:18.036757 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661a96a-cd07-433c-928a-f2b439a32556 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:18.107586 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:18.144816 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661a96a-cd07-433c-928a-f2b439a32556 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:18.179645 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c704d-1114-425f-bc3e-76eaf7c3f1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:18.180273 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c704d-1114-425f-bc3e-76eaf7c3f1d7 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:18.180547 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c704d-1114-425f-bc3e-76eaf7c3f1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:18.180813 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c704d-1114-425f-bc3e-76eaf7c3f1d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:18.181632 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c704d-1114-425f-bc3e-76eaf7c3f1d7 None admin] RBAC: Adding query filter params (group.id=e0b42ddf4d4e44b8b09f5d8c40177532, role.id=6c5b161dbf33447fa1d383915d3c9382, scope.project.id=b420ef42d5dc484fb1563cbae9f104d5) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:18.181946 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c704d-1114-425f-bc3e-76eaf7c3f1d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:18.183404 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c704d-1114-425f-bc3e-76eaf7c3f1d7 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:18.189281 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 228/455] 10.222.0.16 () {56 vars in 1376 bytes} [Mon Jul 4 05:43:18 2022] GET /identity/v3/role_assignments?group.id=e0b42ddf4d4e44b8b09f5d8c40177532&scope.project.id=b420ef42d5dc484fb1563cbae9f104d5&role.id=6c5b161dbf33447fa1d383915d3c9382 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:20.560040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be10f8-9447-4d48-89cd-c9961e8f8708 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:20.561116 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be10f8-9447-4d48-89cd-c9961e8f8708 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:20.561675 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be10f8-9447-4d48-89cd-c9961e8f8708 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:20.563361 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 228/456] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:20.568609 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc0fa6-bd21-4be6-9bb7-67c60a0c85a4 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:20.569104 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc0fa6-bd21-4be6-9bb7-67c60a0c85a4 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:20.569197 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc0fa6-bd21-4be6-9bb7-67c60a0c85a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:20.597607 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-5dbc0fa6-bd21-4be6-9bb7-67c60a0c85a4 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:20.598857 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-5dbc0fa6-bd21-4be6-9bb7-67c60a0c85a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:20.698902 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 229/457] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:20.742943 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be10f8-9447-4d48-89cd-c9961e8f8708 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:20.848681 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:20.871924 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46223f9-144c-4279-a6b4-72f344dd033c None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:20.872837 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46223f9-144c-4279-a6b4-72f344dd033c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:20.873334 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46223f9-144c-4279-a6b4-72f344dd033c None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:20.875209 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 230/458] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:43:20.877488 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be10f8-9447-4d48-89cd-c9961e8f8708 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:20.880484 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b3de1-e03b-43df-8a75-cabb166f12ae None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:20.880986 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b3de1-e03b-43df-8a75-cabb166f12ae None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:20.881462 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b3de1-e03b-43df-8a75-cabb166f12ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:20.906133 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-c20b3de1-e03b-43df-8a75-cabb166f12ae None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:20.907563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c20b3de1-e03b-43df-8a75-cabb166f12ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:20.922743 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c4be5-23b2-4279-8c51-a938e2d76ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:20.923589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c4be5-23b2-4279-8c51-a938e2d76ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:20.923869 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c4be5-23b2-4279-8c51-a938e2d76ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:20.924139 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c4be5-23b2-4279-8c51-a938e2d76ce5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:20.938180 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c4be5-23b2-4279-8c51-a938e2d76ce5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:20.941461 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c4be5-23b2-4279-8c51-a938e2d76ce5 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:20.965188 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-e32c4be5-23b2-4279-8c51-a938e2d76ce5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:20.965188 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:20.965188 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:20.965188 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:20.965188 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:20.965188 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:20.965188 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:20.965188 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:20.965188 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:20.965188 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:20.965188 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:20.965188 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:20.965188 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:20.965188 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:20.965188 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:20.966107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:20.966107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:20.966107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:20.966107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:20.966107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:20.966107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:20.966107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:20.966107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:20.966107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:20.966107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:20.966107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:20.966107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:20.966107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:20.966107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:20.966107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:20.966107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:20.966107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:20.966946 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:20.966946 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:20.966946 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:20.966946 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:20.966946 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 229/459] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:20.968126 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6be429-03be-41a3-8496-1f4f11913469 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:20.968407 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6be429-03be-41a3-8496-1f4f11913469 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:20.968680 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6be429-03be-41a3-8496-1f4f11913469 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:20.970222 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 230/460] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:20.972097 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6be429-03be-41a3-8496-1f4f11913469 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:20.979063 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:20.992539 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 231/461] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:20.994159 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a426a-eeed-4ceb-8fbf-6a8673eb791a None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:20.994664 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a426a-eeed-4ceb-8fbf-6a8673eb791a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:20.995278 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a426a-eeed-4ceb-8fbf-6a8673eb791a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:21.018229 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-ef0a426a-eeed-4ceb-8fbf-6a8673eb791a None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:21.019755 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ef0a426a-eeed-4ceb-8fbf-6a8673eb791a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:21.103317 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 232/462] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:21.103317 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a426a-eeed-4ceb-8fbf-6a8673eb791a None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:21.105896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6be429-03be-41a3-8496-1f4f11913469 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:21.155616 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:21.162425 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2408f-973a-4be0-adb5-14307d99678d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:21.163704 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2408f-973a-4be0-adb5-14307d99678d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:21.164297 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2408f-973a-4be0-adb5-14307d99678d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:21.164784 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2408f-973a-4be0-adb5-14307d99678d None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:21.165718 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a2408f-973a-4be0-adb5-14307d99678d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:21.167451 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a2408f-973a-4be0-adb5-14307d99678d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:21.169173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a2408f-973a-4be0-adb5-14307d99678d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:21.188614 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 231/463] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:21.189804 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2408f-973a-4be0-adb5-14307d99678d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:21.212933 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a426a-eeed-4ceb-8fbf-6a8673eb791a None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:21.238577 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:21.254941 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82a1da-d7aa-41ac-b472-ca3f5a679fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:21.256252 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82a1da-d7aa-41ac-b472-ca3f5a679fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:21.256808 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82a1da-d7aa-41ac-b472-ca3f5a679fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:21.257363 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82a1da-d7aa-41ac-b472-ca3f5a679fe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:21.269007 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82a1da-d7aa-41ac-b472-ca3f5a679fe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:21.270820 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82a1da-d7aa-41ac-b472-ca3f5a679fe0 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:21.289790 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-6e82a1da-d7aa-41ac-b472-ca3f5a679fe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:21.289790 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:21.289790 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:21.289790 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:21.289790 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:21.289790 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:21.289790 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:21.289790 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:21.289790 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:21.289790 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:21.289790 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:21.289790 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:21.289790 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:21.289790 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:21.289790 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:21.290672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:21.290672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:21.290672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:21.290672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:21.290672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:21.290672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:21.290672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:21.290672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:21.290672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:21.290672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:21.290672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:21.290672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:21.290672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:21.290672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:21.290672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:21.290672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:21.290672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:21.291523 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:21.291523 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:21.291523 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:21.291523 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:21.293671 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 233/464] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:21.295115 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82a1da-d7aa-41ac-b472-ca3f5a679fe0 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:21.312934 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2408f-973a-4be0-adb5-14307d99678d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:21.352191 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de1e91-a7ca-4d9a-ab40-bb6a60eedf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:21.353431 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de1e91-a7ca-4d9a-ab40-bb6a60eedf77 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:21.353952 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de1e91-a7ca-4d9a-ab40-bb6a60eedf77 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:21.354419 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de1e91-a7ca-4d9a-ab40-bb6a60eedf77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:21.365476 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de1e91-a7ca-4d9a-ab40-bb6a60eedf77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:21.367256 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de1e91-a7ca-4d9a-ab40-bb6a60eedf77 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:21.384904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-39de1e91-a7ca-4d9a-ab40-bb6a60eedf77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:21.384904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:21.384904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:21.384904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:21.384904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:21.384904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:21.384904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:21.384904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:21.384904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:21.384904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:21.384904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:21.384904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:21.384904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:21.384904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:21.384904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:21.385754 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:21.385754 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:21.385754 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:21.385754 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:21.385754 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:21.385754 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:21.385754 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:21.385754 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:21.385754 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:21.385754 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:21.385754 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:21.385754 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:21.385754 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:21.385754 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:21.385754 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:21.385754 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:21.385754 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:21.386643 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:21.386643 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:21.386643 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:21.386643 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:21.393549 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 232/465] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:21.394582 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de1e91-a7ca-4d9a-ab40-bb6a60eedf77 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:21.409369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82a1da-d7aa-41ac-b472-ca3f5a679fe0 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:21.439365 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:21.455375 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2bfb4-87c3-4414-a58f-4491640acb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:21.456059 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2bfb4-87c3-4414-a58f-4491640acb67 None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:21.456340 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2bfb4-87c3-4414-a58f-4491640acb67 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:21.456615 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2bfb4-87c3-4414-a58f-4491640acb67 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:21.457590 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2bfb4-87c3-4414-a58f-4491640acb67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:21.459773 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2bfb4-87c3-4414-a58f-4491640acb67 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:21.491874 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 234/466] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 4 05:43:21 2022] POST /identity/v3/users => generated 246 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:43:21.493133 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2bfb4-87c3-4414-a58f-4491640acb67 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:21.520548 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de1e91-a7ca-4d9a-ab40-bb6a60eedf77 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:21.539990 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:21.567895 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd7504-18cc-4ac3-9a91-227a9d657037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:21.569201 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd7504-18cc-4ac3-9a91-227a9d657037 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:21.569668 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd7504-18cc-4ac3-9a91-227a9d657037 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:21.570115 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd7504-18cc-4ac3-9a91-227a9d657037 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:21.571061 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd7504-18cc-4ac3-9a91-227a9d657037 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:21.571614 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd7504-18cc-4ac3-9a91-227a9d657037 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:21.573285 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd7504-18cc-4ac3-9a91-227a9d657037 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:21.587440 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 233/467] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:21.589196 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4c2c5-f109-4e67-8db9-703e24055c77 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:21.589738 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4c2c5-f109-4e67-8db9-703e24055c77 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:21.590221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4c2c5-f109-4e67-8db9-703e24055c77 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:21.592554 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 234/468] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:21.593664 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4c2c5-f109-4e67-8db9-703e24055c77 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:21.640594 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2bfb4-87c3-4414-a58f-4491640acb67 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:21.682078 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377097ee-6fe8-4459-8ba8-dd5911ff44b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:21.683089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377097ee-6fe8-4459-8ba8-dd5911ff44b4 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:21.683704 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377097ee-6fe8-4459-8ba8-dd5911ff44b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:21.684230 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377097ee-6fe8-4459-8ba8-dd5911ff44b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:21.684997 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377097ee-6fe8-4459-8ba8-dd5911ff44b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:21.685306 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377097ee-6fe8-4459-8ba8-dd5911ff44b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:21.686695 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377097ee-6fe8-4459-8ba8-dd5911ff44b4 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:21.703481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 235/469] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:21.705310 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a9c24-6795-4485-8a8e-cdc5f6cd9bda None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:21.705918 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a9c24-6795-4485-8a8e-cdc5f6cd9bda None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:21.706784 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a9c24-6795-4485-8a8e-cdc5f6cd9bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:21.725314 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-ad7a9c24-6795-4485-8a8e-cdc5f6cd9bda None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:21.726922 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ad7a9c24-6795-4485-8a8e-cdc5f6cd9bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:21.727220 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4c2c5-f109-4e67-8db9-703e24055c77 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:21.728937 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:21.774551 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24bd34-b7c7-45bc-8901-7eb9706a0a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:21.775686 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24bd34-b7c7-45bc-8901-7eb9706a0a3a None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:21.776196 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24bd34-b7c7-45bc-8901-7eb9706a0a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:21.776666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24bd34-b7c7-45bc-8901-7eb9706a0a3a None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:21.777622 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24bd34-b7c7-45bc-8901-7eb9706a0a3a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:21.779200 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24bd34-b7c7-45bc-8901-7eb9706a0a3a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:21.803752 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 235/470] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 4 05:43:21 2022] POST /identity/v3/users => generated 248 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:43:21.804616 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24bd34-b7c7-45bc-8901-7eb9706a0a3a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:21.812098 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 236/471] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:21.839051 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a9c24-6795-4485-8a8e-cdc5f6cd9bda None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:21.866584 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:21.945377 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24bd34-b7c7-45bc-8901-7eb9706a0a3a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:21.956677 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a9c24-6795-4485-8a8e-cdc5f6cd9bda None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:21.995533 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a649814-08fb-45af-8512-c65a4bed219f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:21.996286 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4083ab-789f-4344-8e66-7471aecb7545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:21.996406 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a649814-08fb-45af-8512-c65a4bed219f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:21.996697 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a649814-08fb-45af-8512-c65a4bed219f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:21.996977 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a649814-08fb-45af-8512-c65a4bed219f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:21.998166 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4083ab-789f-4344-8e66-7471aecb7545 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:21.998673 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4083ab-789f-4344-8e66-7471aecb7545 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:21.999130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4083ab-789f-4344-8e66-7471aecb7545 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:22.000124 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4083ab-789f-4344-8e66-7471aecb7545 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:22.001875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4083ab-789f-4344-8e66-7471aecb7545 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:22.008709 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a649814-08fb-45af-8512-c65a4bed219f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:22.010187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a649814-08fb-45af-8512-c65a4bed219f None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:22.034154 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 236/472] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 4 05:43:21 2022] POST /identity/v3/users => generated 248 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:43:22.035499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-1a649814-08fb-45af-8512-c65a4bed219f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:22.035499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:22.035499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:22.035499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:22.035499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:22.035499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:22.035499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:22.035499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:22.035499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:22.035499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:22.035499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:22.035499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:22.035499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:22.035499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:22.035499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:22.036312 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:22.036312 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:22.036312 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:22.036312 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:22.036312 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:22.036312 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:22.036312 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:22.036312 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:22.036312 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:22.036312 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:22.036312 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:22.036312 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:22.036312 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:22.036312 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:22.036312 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:22.036312 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:22.036312 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:22.037134 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:22.037134 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:22.037134 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:22.037134 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:22.039133 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 237/473] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:43:22.047838 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4083ab-789f-4344-8e66-7471aecb7545 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:22.069279 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:22.135211 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac8ea7-92b3-49c5-9fa4-f51180aa35fd None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:22.135800 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac8ea7-92b3-49c5-9fa4-f51180aa35fd None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:22.136143 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac8ea7-92b3-49c5-9fa4-f51180aa35fd None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:22.137631 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 238/474] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:43:22.144985 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c6146-5653-40f5-9038-653b051a0379 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:22.145546 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c6146-5653-40f5-9038-653b051a0379 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:22.146034 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c6146-5653-40f5-9038-653b051a0379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:22.169346 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-ee5c6146-5653-40f5-9038-653b051a0379 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:22.171415 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ee5c6146-5653-40f5-9038-653b051a0379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:22.178803 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4083ab-789f-4344-8e66-7471aecb7545 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:22.232963 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d80e31-3284-4212-a395-83647f95edcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:22.233928 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d80e31-3284-4212-a395-83647f95edcf None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:22.234381 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d80e31-3284-4212-a395-83647f95edcf None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:22.234821 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d80e31-3284-4212-a395-83647f95edcf None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:22.235778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d80e31-3284-4212-a395-83647f95edcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:22.236090 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d80e31-3284-4212-a395-83647f95edcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:22.237512 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d80e31-3284-4212-a395-83647f95edcf None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:22.252414 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 237/475] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:22.257843 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d80e31-3284-4212-a395-83647f95edcf None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:22.275529 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 239/476] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 05:43:22.300213 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c6146-5653-40f5-9038-653b051a0379 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:22.302386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:22.411276 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c6146-5653-40f5-9038-653b051a0379 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:22.411976 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:22.448039 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b27f52-c446-4a18-acd2-cc0e9fb75304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:22.448709 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b27f52-c446-4a18-acd2-cc0e9fb75304 None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:22.449102 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b27f52-c446-4a18-acd2-cc0e9fb75304 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:22.449385 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b27f52-c446-4a18-acd2-cc0e9fb75304 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:22.450123 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b27f52-c446-4a18-acd2-cc0e9fb75304 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:22.451600 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b27f52-c446-4a18-acd2-cc0e9fb75304 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:22.459587 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.sql.core [None req-15b27f52-c446-4a18-acd2-cc0e9fb75304 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 04 05:43:22.459587 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 04 05:43:22.459587 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [parameters: {'id': '3d77e45ce010485db326c6299ee86495', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 04 05:43:22.459587 dv-cinder-797333-5-smb devstack@keystone.service[80212]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80212) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 04 05:43:22.477966 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-15b27f52-c446-4a18-acd2-cc0e9fb75304 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 04 05:43:22.477966 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:22.477966 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 04 05:43:22.477966 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 04 05:43:22.477966 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 04 05:43:22.477966 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 04 05:43:22.477966 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 04 05:43:22.477966 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application result = self._query(query) Jul 04 05:43:22.477966 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 04 05:43:22.477966 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application conn.query(q) Jul 04 05:43:22.477966 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 04 05:43:22.477966 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 04 05:43:22.477966 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 04 05:43:22.477966 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application result.read() Jul 04 05:43:22.477966 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 04 05:43:22.478891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 04 05:43:22.478891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 04 05:43:22.478891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 04 05:43:22.478891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 04 05:43:22.478891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 04 05:43:22.478891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 04 05:43:22.478891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 04 05:43:22.478891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 04 05:43:22.478891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:22.478891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 04 05:43:22.478891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:22.478891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:22.478891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 04 05:43:22.478891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 04 05:43:22.478891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 04 05:43:22.478891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return ref.to_dict() Jul 04 05:43:22.478891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 04 05:43:22.478891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application next(self.gen) Jul 04 05:43:22.479884 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 04 05:43:22.479884 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application yield resource Jul 04 05:43:22.479884 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 04 05:43:22.479884 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application next(self.gen) Jul 04 05:43:22.479884 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 04 05:43:22.479884 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self.session.rollback() Jul 04 05:43:22.479884 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 04 05:43:22.479884 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self.force_reraise() Jul 04 05:43:22.479884 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 04 05:43:22.479884 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise self.value Jul 04 05:43:22.479884 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 04 05:43:22.479884 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 04 05:43:22.479884 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 04 05:43:22.479884 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application session.commit() Jul 04 05:43:22.479884 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 04 05:43:22.479884 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 04 05:43:22.479884 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 04 05:43:22.480841 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._prepare_impl() Jul 04 05:43:22.480841 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 04 05:43:22.480841 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self.session.flush() Jul 04 05:43:22.480841 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 04 05:43:22.480841 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._flush(objects) Jul 04 05:43:22.480841 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 04 05:43:22.480841 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 04 05:43:22.480841 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 04 05:43:22.480841 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application compat.raise_( Jul 04 05:43:22.480841 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 04 05:43:22.480841 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception Jul 04 05:43:22.480841 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 04 05:43:22.480841 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application flush_context.execute() Jul 04 05:43:22.480841 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 04 05:43:22.480841 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rec.execute(self) Jul 04 05:43:22.480841 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 04 05:43:22.480841 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 04 05:43:22.481726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 04 05:43:22.481726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 04 05:43:22.481726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 04 05:43:22.481726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 04 05:43:22.481726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 04 05:43:22.481726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 04 05:43:22.481726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 04 05:43:22.481726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 04 05:43:22.481726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 04 05:43:22.481726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 04 05:43:22.481726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 04 05:43:22.481726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 04 05:43:22.481726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 04 05:43:22.481726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 04 05:43:22.481726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 04 05:43:22.481726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception Jul 04 05:43:22.482587 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 04 05:43:22.482587 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 04 05:43:22.482587 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 04 05:43:22.482587 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 04 05:43:22.482587 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 04 05:43:22.482587 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application result = self._query(query) Jul 04 05:43:22.482587 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 04 05:43:22.482587 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application conn.query(q) Jul 04 05:43:22.482587 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 04 05:43:22.482587 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 04 05:43:22.482587 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 04 05:43:22.482587 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application result.read() Jul 04 05:43:22.482587 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 04 05:43:22.482587 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 04 05:43:22.482587 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 04 05:43:22.482587 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 04 05:43:22.484787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 04 05:43:22.484787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 04 05:43:22.484787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 04 05:43:22.484787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 04 05:43:22.484787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 04 05:43:22.484787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 04 05:43:22.484787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [parameters: {'id': '3d77e45ce010485db326c6299ee86495', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 04 05:43:22.484787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 04 05:43:22.484787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:22.484787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 05:43:22.484787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:22.484787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:22.484787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:22.484787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:22.484787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:22.484787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:22.486817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:22.486817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:22.486817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:22.486817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:22.486817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:22.486817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:22.486817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 04 05:43:22.486817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 04 05:43:22.486817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:22.486817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:22.486817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 04 05:43:22.486817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 04 05:43:22.486817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 04 05:43:22.486817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 04 05:43:22.486817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 04 05:43:22.486817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:22.488926 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 240/477] 10.222.0.16 () {60 vars in 1131 bytes} [Mon Jul 4 05:43:22 2022] POST /identity/v3/roles => generated 144 bytes in 181 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:43:22.492821 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b27f52-c446-4a18-acd2-cc0e9fb75304 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:22.507929 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d80e31-3284-4212-a395-83647f95edcf None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:22.578027 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e276261-5fac-4da5-9a2f-c2493b7bc993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:22.578803 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e276261-5fac-4da5-9a2f-c2493b7bc993 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:22.578992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e276261-5fac-4da5-9a2f-c2493b7bc993 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:22.579290 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e276261-5fac-4da5-9a2f-c2493b7bc993 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:22.581701 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e276261-5fac-4da5-9a2f-c2493b7bc993 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:22.583208 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e276261-5fac-4da5-9a2f-c2493b7bc993 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:22.622790 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 238/478] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 4 05:43:22 2022] POST /identity/v3/users => generated 249 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 05:43:22.627966 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:22.679742 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b27f52-c446-4a18-acd2-cc0e9fb75304 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:22.739368 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e70b9-ec67-47b1-859e-aa3374c88108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:22.740536 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e70b9-ec67-47b1-859e-aa3374c88108 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:22.741016 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e70b9-ec67-47b1-859e-aa3374c88108 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:22.741497 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e70b9-ec67-47b1-859e-aa3374c88108 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:22.757927 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e70b9-ec67-47b1-859e-aa3374c88108 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:22.766716 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-4e4e70b9-ec67-47b1-859e-aa3374c88108 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 05:43:22.766716 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:22.766716 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:22.766716 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:22.766716 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:22.766716 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:22.766716 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:22.766716 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:22.766716 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:22.766716 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:22.766716 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:22.766716 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:22.766716 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:22.766716 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:22.766716 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:22.766716 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:22.767696 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:22.767696 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:22.767696 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:22.767696 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:22.767696 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:22.767696 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:22.767696 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:22.767696 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:22.767696 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:22.767696 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:22.767696 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:22.767696 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:22.767696 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:22.767696 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:22.767696 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:22.767696 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:22.768471 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:22.768471 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:22.768471 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:22.768471 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:22.768471 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:22.768471 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:22.768471 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:22.768471 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:22.768471 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:22.768471 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:22.768471 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 05:43:22.768471 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:22.770945 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 241/479] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 4 05:43:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:22.780362 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e276261-5fac-4da5-9a2f-c2493b7bc993 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:22.895097 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e276261-5fac-4da5-9a2f-c2493b7bc993 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:22.923775 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:22.930904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ceaa71-d847-4fad-8860-58097f2ee9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:22.931696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ceaa71-d847-4fad-8860-58097f2ee9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:22.932211 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ceaa71-d847-4fad-8860-58097f2ee9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:22.932557 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ceaa71-d847-4fad-8860-58097f2ee9d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:22.933476 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ceaa71-d847-4fad-8860-58097f2ee9d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:22.933985 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ceaa71-d847-4fad-8860-58097f2ee9d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:22.935455 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ceaa71-d847-4fad-8860-58097f2ee9d0 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:22.944414 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 239/480] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:43:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:24.100143 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143f9b9-807c-4c66-90f2-77db60f96861 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:24.100668 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143f9b9-807c-4c66-90f2-77db60f96861 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:24.100668 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143f9b9-807c-4c66-90f2-77db60f96861 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:24.102274 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 242/481] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:24.107585 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b7045-eec4-4962-bac6-0bbcb5abaaf2 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:24.108000 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b7045-eec4-4962-bac6-0bbcb5abaaf2 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:24.108179 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b7045-eec4-4962-bac6-0bbcb5abaaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:24.136173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-386b7045-eec4-4962-bac6-0bbcb5abaaf2 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:24.137428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-386b7045-eec4-4962-bac6-0bbcb5abaaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:24.225762 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 240/482] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:24.261058 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143f9b9-807c-4c66-90f2-77db60f96861 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:24.403311 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143f9b9-807c-4c66-90f2-77db60f96861 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:24.437482 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:24.453577 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c43440-a4fc-4a31-9f64-76bc613537d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:24.454773 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c43440-a4fc-4a31-9f64-76bc613537d2 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:24.455302 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c43440-a4fc-4a31-9f64-76bc613537d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:24.455768 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c43440-a4fc-4a31-9f64-76bc613537d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:24.466894 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409d0c9-e3b5-4f5b-acd3-e30888575636 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:24.467249 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409d0c9-e3b5-4f5b-acd3-e30888575636 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:24.467488 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409d0c9-e3b5-4f5b-acd3-e30888575636 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:24.469217 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 241/483] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:24.473697 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c43440-a4fc-4a31-9f64-76bc613537d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:24.474465 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cd9b8-68a8-4598-823b-5a68aaf7c1ad None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:24.474754 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cd9b8-68a8-4598-823b-5a68aaf7c1ad None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:24.475028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cd9b8-68a8-4598-823b-5a68aaf7c1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:24.482665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-f3c43440-a4fc-4a31-9f64-76bc613537d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:43:24.482665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:24.482665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:24.482665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:24.482665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:24.482665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:24.482665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:24.482665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:24.482665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:24.482665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:24.482665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:24.482665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:24.482665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:24.482665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:24.482665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:24.482665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:24.483567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:24.483567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:24.483567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:24.483567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:24.483567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:24.483567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:24.483567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:24.483567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:24.483567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:24.483567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:24.483567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:24.483567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:24.483567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:24.483567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:24.483567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:24.483567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:24.484336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:24.484336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:24.484336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:24.484336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:24.484336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:24.484336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:24.484336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:24.484336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:24.484336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:24.484336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:24.484336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:43:24.484336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:24.491282 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 243/484] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 4 05:43:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:24.492287 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-066cd9b8-68a8-4598-823b-5a68aaf7c1ad None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:24.492983 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c43440-a4fc-4a31-9f64-76bc613537d2 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:24.493499 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-066cd9b8-68a8-4598-823b-5a68aaf7c1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:24.576081 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 242/485] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:24.577422 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a755d-d61d-4a9c-a19a-b16567b1472f None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:24.577710 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a755d-d61d-4a9c-a19a-b16567b1472f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:24.577986 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a755d-d61d-4a9c-a19a-b16567b1472f None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:24.579367 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 243/486] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:24.586138 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679862f-045c-4677-8cf9-b697daffebef None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:24.586572 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679862f-045c-4677-8cf9-b697daffebef None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:24.586946 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679862f-045c-4677-8cf9-b697daffebef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:24.618120 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-e679862f-045c-4677-8cf9-b697daffebef None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:24.619494 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e679862f-045c-4677-8cf9-b697daffebef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:24.641365 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c43440-a4fc-4a31-9f64-76bc613537d2 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:24.669779 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:24.688831 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8976f-d643-41de-a4cb-28f479483d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:24.689710 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8976f-d643-41de-a4cb-28f479483d14 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:24.689996 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8976f-d643-41de-a4cb-28f479483d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:24.690364 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8976f-d643-41de-a4cb-28f479483d14 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:24.691119 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8976f-d643-41de-a4cb-28f479483d14 None admin] RBAC: Adding query filter params (name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:24.691454 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8976f-d643-41de-a4cb-28f479483d14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:24.692194 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 244/487] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 05:43:24.692837 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8976f-d643-41de-a4cb-28f479483d14 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:24.699541 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679862f-045c-4677-8cf9-b697daffebef None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:24.701514 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 244/488] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 4 05:43:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:43:24.711200 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8976f-d643-41de-a4cb-28f479483d14 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:24.772943 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:24.821842 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679862f-045c-4677-8cf9-b697daffebef None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:24.845984 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8976f-d643-41de-a4cb-28f479483d14 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:24.860337 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3f488-493f-4aab-8ff7-af763b8ec2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:24.861390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3f488-493f-4aab-8ff7-af763b8ec2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:24.861714 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3f488-493f-4aab-8ff7-af763b8ec2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:24.861981 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3f488-493f-4aab-8ff7-af763b8ec2a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:24.874982 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3f488-493f-4aab-8ff7-af763b8ec2a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:24.884994 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-e6c3f488-493f-4aab-8ff7-af763b8ec2a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:43:24.884994 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:24.884994 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:24.884994 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:24.884994 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:24.884994 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:24.884994 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:24.884994 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:24.884994 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:24.884994 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:24.884994 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:24.884994 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:24.884994 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:24.884994 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:24.884994 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:24.884994 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:24.887163 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:24.887163 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:24.887163 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:24.887163 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:24.887163 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:24.887163 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:24.887163 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:24.887163 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:24.887163 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:24.887163 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:24.887163 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:24.887163 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:24.887163 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:24.887163 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:24.887163 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:24.887163 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:24.889143 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:24.889143 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:24.889143 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:24.889143 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:24.889143 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:24.889143 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:24.889143 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:24.889143 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:24.889143 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:24.889143 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:24.889143 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:43:24.889143 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:24.890487 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e9f25-70dd-46e6-9d51-1b36e28bd211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:24.890656 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 245/489] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 4 05:43:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:24.890788 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e9f25-70dd-46e6-9d51-1b36e28bd211 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:24.890788 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e9f25-70dd-46e6-9d51-1b36e28bd211 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:24.890788 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e9f25-70dd-46e6-9d51-1b36e28bd211 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:24.899730 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3f488-493f-4aab-8ff7-af763b8ec2a9 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:24.900623 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e9f25-70dd-46e6-9d51-1b36e28bd211 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:24.903109 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e9f25-70dd-46e6-9d51-1b36e28bd211 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:24.925877 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-e80e9f25-70dd-46e6-9d51-1b36e28bd211 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:24.925877 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:24.925877 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:24.925877 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:24.925877 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:24.925877 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:24.925877 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:24.925877 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:24.925877 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:24.925877 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:24.925877 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:24.925877 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:24.925877 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:24.925877 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:24.925877 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:24.926907 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:24.926907 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:24.926907 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:24.926907 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:24.926907 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:24.926907 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:24.926907 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:24.926907 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:24.926907 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:24.926907 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:24.926907 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:24.926907 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:24.926907 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:24.926907 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:24.926907 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:24.926907 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:24.926907 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:24.928009 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:24.928009 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:24.928009 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:24.928009 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:24.928009 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 245/490] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:24.931992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e9f25-70dd-46e6-9d51-1b36e28bd211 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:24.946187 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:25.014586 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3f488-493f-4aab-8ff7-af763b8ec2a9 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:25.058995 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549473e1-e03e-469f-a422-059bf46e5d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:25.060587 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549473e1-e03e-469f-a422-059bf46e5d83 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:25.060958 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549473e1-e03e-469f-a422-059bf46e5d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:25.061325 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549473e1-e03e-469f-a422-059bf46e5d83 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:25.062434 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:25.069763 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e9f25-70dd-46e6-9d51-1b36e28bd211 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:25.081516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549473e1-e03e-469f-a422-059bf46e5d83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:25.092456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-549473e1-e03e-469f-a422-059bf46e5d83 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:43:25.092456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:25.092456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:25.092456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:25.092456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:25.092456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:25.092456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:25.092456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:25.092456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:25.092456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:25.092456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:25.092456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:25.092456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:25.092456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:25.092456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:25.092456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:25.093363 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:25.093363 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:25.093363 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:25.093363 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:25.093363 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:25.093363 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:25.093363 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:25.093363 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:25.093363 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:25.093363 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:25.093363 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:25.093363 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:25.093363 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:25.093363 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:25.093363 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:25.093363 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:25.094130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:25.094130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:25.094130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:25.094130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:25.094130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:25.094130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:25.094130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:25.094130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:25.094130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:25.094130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:25.094130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:43:25.094130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:25.097193 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 246/491] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 4 05:43:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:25.098202 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549473e1-e03e-469f-a422-059bf46e5d83 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:25.111068 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265b60a-f534-4253-9792-fb39bfc5b639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:25.112176 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265b60a-f534-4253-9792-fb39bfc5b639 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:25.112466 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265b60a-f534-4253-9792-fb39bfc5b639 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:25.112840 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265b60a-f534-4253-9792-fb39bfc5b639 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:25.113693 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265b60a-f534-4253-9792-fb39bfc5b639 None admin] RBAC: Adding query filter params (name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:25.114175 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265b60a-f534-4253-9792-fb39bfc5b639 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:25.115730 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265b60a-f534-4253-9792-fb39bfc5b639 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:25.125201 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 246/492] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 4 05:43:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:25.126130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265b60a-f534-4253-9792-fb39bfc5b639 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:25.225985 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549473e1-e03e-469f-a422-059bf46e5d83 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:25.227445 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265b60a-f534-4253-9792-fb39bfc5b639 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:25.228197 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:25.265588 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6dcb1f-e614-4ad8-a6d4-c9be5fac1631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:25.266476 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6dcb1f-e614-4ad8-a6d4-c9be5fac1631 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:25.266865 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6dcb1f-e614-4ad8-a6d4-c9be5fac1631 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:25.267293 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6dcb1f-e614-4ad8-a6d4-c9be5fac1631 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:25.268152 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6dcb1f-e614-4ad8-a6d4-c9be5fac1631 None admin] RBAC: Adding query filter params (name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:25.268559 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6dcb1f-e614-4ad8-a6d4-c9be5fac1631 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:25.269544 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b321a-13fa-4491-9682-fb49046f3431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:25.270172 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6dcb1f-e614-4ad8-a6d4-c9be5fac1631 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:25.270526 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b321a-13fa-4491-9682-fb49046f3431 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:25.270940 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b321a-13fa-4491-9682-fb49046f3431 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:25.271373 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b321a-13fa-4491-9682-fb49046f3431 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:25.272390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b321a-13fa-4491-9682-fb49046f3431 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:25.272853 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b321a-13fa-4491-9682-fb49046f3431 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:25.274662 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b321a-13fa-4491-9682-fb49046f3431 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:25.283334 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 247/493] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 4 05:43:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:25.284434 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6dcb1f-e614-4ad8-a6d4-c9be5fac1631 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:25.290666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 247/494] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:25.291617 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b321a-13fa-4491-9682-fb49046f3431 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:25.312166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:25.389517 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6dcb1f-e614-4ad8-a6d4-c9be5fac1631 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:25.397695 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b321a-13fa-4491-9682-fb49046f3431 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:25.423724 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0fd22-bc88-4879-9adf-61156ae80152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:25.424521 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0fd22-bc88-4879-9adf-61156ae80152 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:25.424797 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0fd22-bc88-4879-9adf-61156ae80152 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:25.425065 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0fd22-bc88-4879-9adf-61156ae80152 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:25.436327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0fd22-bc88-4879-9adf-61156ae80152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:25.437799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0fd22-bc88-4879-9adf-61156ae80152 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:25.438202 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21a15a-946b-49eb-b63f-ed89b0917d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:25.439276 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21a15a-946b-49eb-b63f-ed89b0917d1f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:25.439978 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21a15a-946b-49eb-b63f-ed89b0917d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:25.441021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21a15a-946b-49eb-b63f-ed89b0917d1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:25.454324 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e21a15a-946b-49eb-b63f-ed89b0917d1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:25.456368 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e21a15a-946b-49eb-b63f-ed89b0917d1f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:25.458429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-b7e0fd22-bc88-4879-9adf-61156ae80152 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:25.458429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:25.458429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:25.458429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:25.458429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:25.458429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:25.458429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:25.458429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:25.458429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:25.458429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:25.458429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:25.458429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:25.458429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:25.458429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:25.458429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:25.459809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:25.459809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:25.459809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:25.459809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:25.459809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:25.459809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:25.459809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:25.459809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:25.459809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:25.459809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:25.459809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:25.459809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:25.459809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:25.459809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:25.459809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:25.459809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:25.459809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:25.461644 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:25.461644 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:25.461644 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:25.461644 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:25.461644 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 248/495] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:25.461644 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0fd22-bc88-4879-9adf-61156ae80152 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:25.477551 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-2e21a15a-946b-49eb-b63f-ed89b0917d1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:25.477551 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:25.477551 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:25.477551 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:25.477551 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:25.477551 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:25.477551 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:25.477551 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:25.477551 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:25.477551 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:25.477551 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:25.477551 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:25.477551 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:25.477551 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:25.477551 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:25.478452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:25.478452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:25.478452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:25.478452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:25.478452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:25.478452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:25.478452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:25.478452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:25.478452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:25.478452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:25.478452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:25.478452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:25.478452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:25.478452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:25.478452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:25.478452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:25.478452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:25.479324 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:25.479324 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:25.479324 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:25.479324 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:25.479324 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 248/496] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:25.480281 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0690ad-2b7d-40bc-bd53-01aa1a0d7087 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:25.480558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0690ad-2b7d-40bc-bd53-01aa1a0d7087 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:25.480828 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0690ad-2b7d-40bc-bd53-01aa1a0d7087 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:25.482096 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 249/497] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:25.483355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d492a-5f84-4c6e-8f82-c939a0226240 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:25.483828 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d492a-5f84-4c6e-8f82-c939a0226240 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:25.484112 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d492a-5f84-4c6e-8f82-c939a0226240 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:25.485321 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 250/498] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:25.486147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d492a-5f84-4c6e-8f82-c939a0226240 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:25.502700 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:25.549274 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:25.572222 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0fd22-bc88-4879-9adf-61156ae80152 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:25.593550 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d492a-5f84-4c6e-8f82-c939a0226240 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:25.606452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50b9ca-b972-404e-8471-4f02091dccec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:25.607282 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50b9ca-b972-404e-8471-4f02091dccec None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:25.607565 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50b9ca-b972-404e-8471-4f02091dccec None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:25.607846 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50b9ca-b972-404e-8471-4f02091dccec None admin] PATH_INFO: `/v3/users/nova` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:25.615413 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50b9ca-b972-404e-8471-4f02091dccec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:25.616873 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50b9ca-b972-404e-8471-4f02091dccec None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:25.626570 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a833828-d51b-421e-9227-1ece4b3a2f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:25.627253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a833828-d51b-421e-9227-1ece4b3a2f9b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:25.627537 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a833828-d51b-421e-9227-1ece4b3a2f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:25.627810 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a833828-d51b-421e-9227-1ece4b3a2f9b None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:25.628527 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a833828-d51b-421e-9227-1ece4b3a2f9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:25.628828 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a833828-d51b-421e-9227-1ece4b3a2f9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:25.630201 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a833828-d51b-421e-9227-1ece4b3a2f9b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:25.632542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-ef50b9ca-b972-404e-8471-4f02091dccec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 05:43:25.632542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:25.632542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:25.632542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:25.632542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:25.632542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:25.632542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:25.632542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:25.632542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:25.632542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:25.632542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:25.632542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:25.632542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:43:25.632542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:43:25.632542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:43:25.632542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:43:25.633489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:25.633489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:25.633489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:43:25.633489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:25.633489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:43:25.633489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:25.633489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:25.633489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:25.633489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:25.633489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:25.633489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:25.633489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:25.633489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:25.633489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:25.633489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:25.633489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:25.633489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:25.633489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:25.634373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:25.634373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:25.634373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:43:25.634373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:43:25.634373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:43:25.634373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:43:25.634373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:43:25.634373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:43:25.634373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 05:43:25.634373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:25.634373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 249/499] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jul 4 05:43:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:25.635172 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50b9ca-b972-404e-8471-4f02091dccec None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:25.644584 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 251/500] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:25.645806 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a2b67-c6b5-4304-920d-d44543ce8932 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:25.646090 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a2b67-c6b5-4304-920d-d44543ce8932 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:25.646369 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a2b67-c6b5-4304-920d-d44543ce8932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:25.663247 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-702a2b67-c6b5-4304-920d-d44543ce8932 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:25.664452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-702a2b67-c6b5-4304-920d-d44543ce8932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:25.730145 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 252/501] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:25.731306 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df7780-e0cc-4931-b43c-0953c8d38fcf None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:25.731593 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df7780-e0cc-4931-b43c-0953c8d38fcf None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:25.731866 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df7780-e0cc-4931-b43c-0953c8d38fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:25.737139 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:25.748404 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-83df7780-e0cc-4931-b43c-0953c8d38fcf None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:25.749163 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50b9ca-b972-404e-8471-4f02091dccec None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:25.749564 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-83df7780-e0cc-4931-b43c-0953c8d38fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:25.786199 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c1cc9-7b24-4edb-af20-85b92b2de89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:25.786861 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c1cc9-7b24-4edb-af20-85b92b2de89b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:25.787140 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c1cc9-7b24-4edb-af20-85b92b2de89b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:25.787440 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c1cc9-7b24-4edb-af20-85b92b2de89b None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:25.788149 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c1cc9-7b24-4edb-af20-85b92b2de89b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:25.788436 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c1cc9-7b24-4edb-af20-85b92b2de89b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:25.789815 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c1cc9-7b24-4edb-af20-85b92b2de89b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:25.792104 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:25.802024 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 250/502] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:25.802868 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c1cc9-7b24-4edb-af20-85b92b2de89b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:25.819377 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 253/503] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:25.820194 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df7780-e0cc-4931-b43c-0953c8d38fcf None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:25.905369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c1cc9-7b24-4edb-af20-85b92b2de89b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:25.917598 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df7780-e0cc-4931-b43c-0953c8d38fcf None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:25.940941 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e545e-3927-41b0-92dc-6dfabce24b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:25.941634 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e545e-3927-41b0-92dc-6dfabce24b83 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:25.941919 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e545e-3927-41b0-92dc-6dfabce24b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:25.942198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e545e-3927-41b0-92dc-6dfabce24b83 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:25.943036 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e545e-3927-41b0-92dc-6dfabce24b83 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:25.943413 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e545e-3927-41b0-92dc-6dfabce24b83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:25.944872 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e545e-3927-41b0-92dc-6dfabce24b83 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:25.951750 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254314b8-2c11-4fa0-9b52-69eaa298bdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:25.952545 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254314b8-2c11-4fa0-9b52-69eaa298bdf2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:25.952825 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254314b8-2c11-4fa0-9b52-69eaa298bdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:25.953097 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254314b8-2c11-4fa0-9b52-69eaa298bdf2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:25.955125 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:25.962244 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254314b8-2c11-4fa0-9b52-69eaa298bdf2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:25.963854 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254314b8-2c11-4fa0-9b52-69eaa298bdf2 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:25.980021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-254314b8-2c11-4fa0-9b52-69eaa298bdf2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 05:43:25.980021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:25.980021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:25.980021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:25.980021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:25.980021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:25.980021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:25.980021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:25.980021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:25.980021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:25.980021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:25.980021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:25.980021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:43:25.980021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:43:25.980021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:43:25.980021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:43:25.981073 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:25.981073 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:25.981073 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:43:25.981073 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:25.981073 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:43:25.981073 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:25.981073 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:25.981073 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:25.981073 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:25.981073 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:25.981073 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:25.981073 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:25.981073 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:25.981073 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:25.981073 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:25.981073 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:25.981073 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:25.981073 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:25.982080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:25.982080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:25.982080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:43:25.982080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:43:25.982080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:43:25.982080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:43:25.982080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:43:25.982080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:43:25.982080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 05:43:25.982080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:25.982080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 254/504] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:43:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:25.982742 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 251/505] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jul 4 05:43:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:25.983377 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e545e-3927-41b0-92dc-6dfabce24b83 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:25.986294 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254314b8-2c11-4fa0-9b52-69eaa298bdf2 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:26.038034 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:26.084088 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254314b8-2c11-4fa0-9b52-69eaa298bdf2 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:26.084291 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e545e-3927-41b0-92dc-6dfabce24b83 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:26.117842 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156bd50e-18b6-452d-a0cc-04954577ad2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:26.118439 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebe19f-413f-4e43-a425-5389e112677b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:26.118728 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bd50e-18b6-452d-a0cc-04954577ad2f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:26.118886 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebe19f-413f-4e43-a425-5389e112677b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:26.119011 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bd50e-18b6-452d-a0cc-04954577ad2f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:26.119173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebe19f-413f-4e43-a425-5389e112677b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:26.119299 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bd50e-18b6-452d-a0cc-04954577ad2f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:26.119480 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebe19f-413f-4e43-a425-5389e112677b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:26.126698 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156bd50e-18b6-452d-a0cc-04954577ad2f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:26.128193 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156bd50e-18b6-452d-a0cc-04954577ad2f None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:26.131152 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bebe19f-413f-4e43-a425-5389e112677b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:26.138996 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-4bebe19f-413f-4e43-a425-5389e112677b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:43:26.138996 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:26.138996 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:26.138996 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:26.138996 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:26.138996 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:26.138996 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:26.138996 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:26.138996 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:26.138996 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:26.138996 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:26.138996 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:26.138996 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:26.138996 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:26.138996 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:26.138996 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:26.139885 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:26.139885 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:26.139885 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:26.139885 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:26.139885 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:26.139885 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:26.139885 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:26.139885 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:26.139885 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:26.139885 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:26.139885 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:26.139885 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:26.139885 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:26.139885 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:26.139885 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:26.139885 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:26.140651 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:26.140651 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:26.140651 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:26.140651 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:26.140651 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:26.140651 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:26.140651 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:26.140651 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:26.140651 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:26.140651 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:26.140651 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:43:26.140651 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:26.140651 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 255/506] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 4 05:43:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:26.141901 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebe19f-413f-4e43-a425-5389e112677b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:26.142551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-156bd50e-18b6-452d-a0cc-04954577ad2f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 04 05:43:26.142551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:26.142551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:26.142551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:26.142551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:26.142551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:26.142551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:26.142551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:26.142551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:26.142551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:26.142551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:26.142551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:26.142551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:43:26.142551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:43:26.142551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:43:26.142551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:43:26.143581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:26.143581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:26.143581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:43:26.143581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:26.143581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:43:26.143581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:26.143581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:26.143581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:26.143581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:26.143581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:26.143581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:26.143581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:26.143581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:26.143581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:26.143581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:26.143581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:26.143581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:26.143581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:26.144509 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:26.144509 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:26.144509 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:43:26.144509 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:43:26.144509 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:43:26.144509 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:43:26.144509 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:43:26.144509 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:43:26.144509 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 04 05:43:26.144509 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:26.147318 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 252/507] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:43:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:26.148586 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156bd50e-18b6-452d-a0cc-04954577ad2f None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:26.196738 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:26.242122 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebe19f-413f-4e43-a425-5389e112677b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:26.244540 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156bd50e-18b6-452d-a0cc-04954577ad2f None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:26.258413 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:26.276295 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fbb85-1877-4b14-9fd8-e46664e5ff00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:26.277118 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fbb85-1877-4b14-9fd8-e46664e5ff00 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:26.277402 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fbb85-1877-4b14-9fd8-e46664e5ff00 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:26.277669 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fbb85-1877-4b14-9fd8-e46664e5ff00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:26.279244 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9e879-ab6c-4dfe-9476-b46439b28ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:26.279907 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9e879-ab6c-4dfe-9476-b46439b28ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:26.280423 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9e879-ab6c-4dfe-9476-b46439b28ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:26.280423 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9e879-ab6c-4dfe-9476-b46439b28ca5 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:26.281278 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9e879-ab6c-4dfe-9476-b46439b28ca5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:26.281579 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9e879-ab6c-4dfe-9476-b46439b28ca5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:26.283027 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9e879-ab6c-4dfe-9476-b46439b28ca5 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:26.287879 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fbb85-1877-4b14-9fd8-e46664e5ff00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:26.289333 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fbb85-1877-4b14-9fd8-e46664e5ff00 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:26.300040 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 253/508] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Jul 4 05:43:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:26.300808 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9e879-ab6c-4dfe-9476-b46439b28ca5 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:26.305832 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-800fbb85-1877-4b14-9fd8-e46664e5ff00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:26.305832 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:26.305832 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:26.305832 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:26.305832 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:26.305832 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:26.305832 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:26.305832 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:26.305832 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:26.305832 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:26.305832 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:26.305832 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:26.305832 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:26.305832 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:26.305832 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:26.306696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:26.306696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:26.306696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:26.306696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:26.306696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:26.306696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:26.306696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:26.306696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:26.306696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:26.306696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:26.306696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:26.306696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:26.306696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:26.306696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:26.306696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:26.306696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:26.306696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:26.307836 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:26.307836 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:26.307836 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:26.307836 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:26.307836 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 256/509] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:26.308145 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fbb85-1877-4b14-9fd8-e46664e5ff00 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:26.402992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9e879-ab6c-4dfe-9476-b46439b28ca5 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:26.407615 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fbb85-1877-4b14-9fd8-e46664e5ff00 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:26.414313 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:26.436427 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454864c6-7ab0-434b-8519-d8b26be0ca37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:26.437374 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454864c6-7ab0-434b-8519-d8b26be0ca37 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:26.437660 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454864c6-7ab0-434b-8519-d8b26be0ca37 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:26.437945 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454864c6-7ab0-434b-8519-d8b26be0ca37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:26.441303 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af4502-7912-4af4-b768-ef6f28e83283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:26.441959 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af4502-7912-4af4-b768-ef6f28e83283 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:26.442241 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af4502-7912-4af4-b768-ef6f28e83283 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:26.442515 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af4502-7912-4af4-b768-ef6f28e83283 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:26.443290 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af4502-7912-4af4-b768-ef6f28e83283 None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:26.443599 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af4502-7912-4af4-b768-ef6f28e83283 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:26.445010 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af4502-7912-4af4-b768-ef6f28e83283 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:26.453192 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 257/510] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 4 05:43:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:26.453995 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af4502-7912-4af4-b768-ef6f28e83283 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:26.481705 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:26.515862 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454864c6-7ab0-434b-8519-d8b26be0ca37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:26.517348 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454864c6-7ab0-434b-8519-d8b26be0ca37 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:26.555558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af4502-7912-4af4-b768-ef6f28e83283 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:26.588956 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cffc182-923c-40ec-b0fb-e8a677cf3b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:26.589668 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffc182-923c-40ec-b0fb-e8a677cf3b92 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:26.589950 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffc182-923c-40ec-b0fb-e8a677cf3b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:26.590225 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffc182-923c-40ec-b0fb-e8a677cf3b92 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:26.591057 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cffc182-923c-40ec-b0fb-e8a677cf3b92 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:26.591392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cffc182-923c-40ec-b0fb-e8a677cf3b92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:26.592851 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cffc182-923c-40ec-b0fb-e8a677cf3b92 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:26.612946 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 254/511] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:43:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 05:43:26.613787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454864c6-7ab0-434b-8519-d8b26be0ca37 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:26.629486 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 258/512] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Jul 4 05:43:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:26.630299 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cffc182-923c-40ec-b0fb-e8a677cf3b92 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:26.657477 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:26.682734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:26.712084 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454864c6-7ab0-434b-8519-d8b26be0ca37 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:26.727410 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cffc182-923c-40ec-b0fb-e8a677cf3b92 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:26.745265 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208e426-6238-4c2c-98e7-4fc77dd9599f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:26.748604 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208e426-6238-4c2c-98e7-4fc77dd9599f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:26.748887 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208e426-6238-4c2c-98e7-4fc77dd9599f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:26.749160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208e426-6238-4c2c-98e7-4fc77dd9599f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:26.760838 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133dd055-639d-4814-bda6-3d75c167fd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:26.761735 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133dd055-639d-4814-bda6-3d75c167fd6e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:26.762034 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133dd055-639d-4814-bda6-3d75c167fd6e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:26.762307 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133dd055-639d-4814-bda6-3d75c167fd6e None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:26.763022 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133dd055-639d-4814-bda6-3d75c167fd6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:26.763346 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133dd055-639d-4814-bda6-3d75c167fd6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:26.764752 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133dd055-639d-4814-bda6-3d75c167fd6e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:26.775673 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 259/513] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:26.776381 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133dd055-639d-4814-bda6-3d75c167fd6e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:26.818079 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208e426-6238-4c2c-98e7-4fc77dd9599f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:26.819576 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208e426-6238-4c2c-98e7-4fc77dd9599f None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:26.861156 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:26.875917 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133dd055-639d-4814-bda6-3d75c167fd6e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:26.884812 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:26.909963 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf08fdf-e1a5-4010-a5d0-76838ec01bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:26.910752 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf08fdf-e1a5-4010-a5d0-76838ec01bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:26.911034 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf08fdf-e1a5-4010-a5d0-76838ec01bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:26.911339 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf08fdf-e1a5-4010-a5d0-76838ec01bf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:26.916033 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 255/514] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:43:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 05:43:26.916848 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208e426-6238-4c2c-98e7-4fc77dd9599f None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:26.924622 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf08fdf-e1a5-4010-a5d0-76838ec01bf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:26.926092 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf08fdf-e1a5-4010-a5d0-76838ec01bf0 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:26.943406 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-baf08fdf-e1a5-4010-a5d0-76838ec01bf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:26.943406 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:26.943406 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:26.943406 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:26.943406 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:26.943406 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:26.943406 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:26.943406 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:26.943406 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:26.943406 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:26.943406 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:26.943406 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:26.943406 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:26.943406 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:26.943406 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:26.944428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:26.944428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:26.944428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:26.944428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:26.944428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:26.944428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:26.944428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:26.944428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:26.944428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:26.944428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:26.944428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:26.944428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:26.944428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:26.944428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:26.944428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:26.944428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:26.944428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:26.945457 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:26.945457 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:26.945457 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:26.945457 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:26.945457 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 260/515] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:26.945457 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf08fdf-e1a5-4010-a5d0-76838ec01bf0 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:27.013353 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208e426-6238-4c2c-98e7-4fc77dd9599f None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:27.045453 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf08fdf-e1a5-4010-a5d0-76838ec01bf0 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:27.047477 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93063fef-a792-4fec-affe-4097e7a1f849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:27.048277 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93063fef-a792-4fec-affe-4097e7a1f849 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:27.048588 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93063fef-a792-4fec-affe-4097e7a1f849 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:27.048866 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93063fef-a792-4fec-affe-4097e7a1f849 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:27.059261 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93063fef-a792-4fec-affe-4097e7a1f849 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:27.060804 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93063fef-a792-4fec-affe-4097e7a1f849 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:27.078407 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a5fde-1e1a-4ac4-a49c-7cd80d34da4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:27.079043 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a5fde-1e1a-4ac4-a49c-7cd80d34da4b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:27.079363 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a5fde-1e1a-4ac4-a49c-7cd80d34da4b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:27.079640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a5fde-1e1a-4ac4-a49c-7cd80d34da4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:27.079731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-93063fef-a792-4fec-affe-4097e7a1f849 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:27.079731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:27.079731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:27.079731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:27.079731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:27.079731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:27.079731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:27.079731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:27.079731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:27.079731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:27.079731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:27.079731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:27.079731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:27.079731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:27.079731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:27.080510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:27.080510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:27.080510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:27.080510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:27.080510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:27.080510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:27.080510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:27.080510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:27.080510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:27.080510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:27.080510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:27.080510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:27.080510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:27.080510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:27.080510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:27.080510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:27.080510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:27.081341 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:27.081341 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:27.081341 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:27.081341 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:27.086184 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 256/516] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:27.086959 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93063fef-a792-4fec-affe-4097e7a1f849 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:27.090076 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:27.111913 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:27.150463 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a5fde-1e1a-4ac4-a49c-7cd80d34da4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:27.152047 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a5fde-1e1a-4ac4-a49c-7cd80d34da4b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:27.184225 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93063fef-a792-4fec-affe-4097e7a1f849 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:27.217086 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9234d-b4ba-4c14-8c32-1963555363ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:27.217771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9234d-b4ba-4c14-8c32-1963555363ae None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:27.218044 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9234d-b4ba-4c14-8c32-1963555363ae None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:27.218310 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9234d-b4ba-4c14-8c32-1963555363ae None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:27.219011 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9234d-b4ba-4c14-8c32-1963555363ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:27.220488 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9234d-b4ba-4c14-8c32-1963555363ae None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:27.240556 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 257/517] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 4 05:43:27 2022] POST /identity/v3/users => generated 247 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:43:27.241344 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9234d-b4ba-4c14-8c32-1963555363ae None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:27.248356 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 261/518] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:43:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 05:43:27.249239 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a5fde-1e1a-4ac4-a49c-7cd80d34da4b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:27.298148 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:27.344881 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:27.366080 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9234d-b4ba-4c14-8c32-1963555363ae None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:27.366808 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a5fde-1e1a-4ac4-a49c-7cd80d34da4b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:27.406625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7b304-8c2f-4356-aef9-f982cb1e66f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:27.407458 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7b304-8c2f-4356-aef9-f982cb1e66f8 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:27.407743 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7b304-8c2f-4356-aef9-f982cb1e66f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:27.408016 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7b304-8c2f-4356-aef9-f982cb1e66f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:27.408622 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ade48-2f81-45d8-ad15-2d3bc1189bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:27.409284 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ade48-2f81-45d8-ad15-2d3bc1189bcf None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:27.409558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ade48-2f81-45d8-ad15-2d3bc1189bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:27.410430 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ade48-2f81-45d8-ad15-2d3bc1189bcf None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:27.410539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ade48-2f81-45d8-ad15-2d3bc1189bcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:27.410832 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ade48-2f81-45d8-ad15-2d3bc1189bcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:27.412960 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ade48-2f81-45d8-ad15-2d3bc1189bcf None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:27.421171 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7b304-8c2f-4356-aef9-f982cb1e66f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:27.423829 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7b304-8c2f-4356-aef9-f982cb1e66f8 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:27.425531 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 262/519] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:27.427704 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ade48-2f81-45d8-ad15-2d3bc1189bcf None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:27.443298 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-0cc7b304-8c2f-4356-aef9-f982cb1e66f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:27.443298 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:27.443298 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:27.443298 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:27.443298 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:27.443298 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:27.443298 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:27.443298 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:27.443298 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:27.443298 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:27.443298 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:27.443298 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:27.443298 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:27.443298 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:27.443298 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:27.444336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:27.444336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:27.444336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:27.444336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:27.444336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:27.444336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:27.444336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:27.444336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:27.444336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:27.444336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:27.444336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:27.444336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:27.444336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:27.444336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:27.444336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:27.444336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:27.444336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:27.445358 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:27.445358 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:27.445358 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:27.445358 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:27.445358 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 258/520] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:27.445358 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7b304-8c2f-4356-aef9-f982cb1e66f8 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:27.532423 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:27.541852 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ade48-2f81-45d8-ad15-2d3bc1189bcf None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:27.552815 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7b304-8c2f-4356-aef9-f982cb1e66f8 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:27.579719 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbca00-290f-4b6a-bd0b-7e628176af84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:27.580521 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbca00-290f-4b6a-bd0b-7e628176af84 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:27.580900 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbca00-290f-4b6a-bd0b-7e628176af84 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:27.581274 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbca00-290f-4b6a-bd0b-7e628176af84 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:27.582063 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bbca00-290f-4b6a-bd0b-7e628176af84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:27.582458 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bbca00-290f-4b6a-bd0b-7e628176af84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:27.582936 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:27.584156 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bbca00-290f-4b6a-bd0b-7e628176af84 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:27.588680 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d7eab-630c-4385-9b08-e351c3121417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:27.589520 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d7eab-630c-4385-9b08-e351c3121417 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:27.589806 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d7eab-630c-4385-9b08-e351c3121417 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:27.590081 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d7eab-630c-4385-9b08-e351c3121417 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:27.601000 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 263/521] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:27.601000 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbca00-290f-4b6a-bd0b-7e628176af84 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:27.602009 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d7eab-630c-4385-9b08-e351c3121417 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:27.603784 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d7eab-630c-4385-9b08-e351c3121417 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:27.624578 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-783d7eab-630c-4385-9b08-e351c3121417 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:27.624578 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:27.624578 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:27.624578 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:27.624578 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:27.624578 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:27.624578 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:27.624578 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:27.624578 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:27.624578 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:27.624578 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:27.624578 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:27.624578 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:27.624578 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:27.624578 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:27.625630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:27.625630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:27.625630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:27.625630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:27.625630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:27.625630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:27.625630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:27.625630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:27.625630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:27.625630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:27.625630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:27.625630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:27.625630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:27.625630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:27.625630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:27.625630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:27.625630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:27.626669 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:27.626669 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:27.626669 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:27.626669 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:27.631520 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 259/522] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:27.631520 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d7eab-630c-4385-9b08-e351c3121417 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:27.714098 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbca00-290f-4b6a-bd0b-7e628176af84 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:27.738778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d7eab-630c-4385-9b08-e351c3121417 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:27.759369 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae66c28-31ab-4000-b3c2-980ffd35a99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:27.760162 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae66c28-31ab-4000-b3c2-980ffd35a99c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:27.760447 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae66c28-31ab-4000-b3c2-980ffd35a99c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:27.760722 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae66c28-31ab-4000-b3c2-980ffd35a99c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:27.768054 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae66c28-31ab-4000-b3c2-980ffd35a99c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:27.769530 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae66c28-31ab-4000-b3c2-980ffd35a99c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:27.775600 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef04f65-c81c-4d06-b267-a29d93f5de04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:27.776719 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef04f65-c81c-4d06-b267-a29d93f5de04 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:27.777142 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef04f65-c81c-4d06-b267-a29d93f5de04 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:27.777575 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef04f65-c81c-4d06-b267-a29d93f5de04 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:27.778438 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef04f65-c81c-4d06-b267-a29d93f5de04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:27.778882 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef04f65-c81c-4d06-b267-a29d93f5de04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:27.780418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef04f65-c81c-4d06-b267-a29d93f5de04 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:27.784147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-aae66c28-31ab-4000-b3c2-980ffd35a99c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 04 05:43:27.784147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:27.784147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:27.784147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:27.784147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:27.784147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:27.784147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:27.784147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:27.784147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:27.784147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:27.784147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:27.784147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:27.784147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:43:27.784147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:43:27.784147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:43:27.784147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:43:27.785221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:27.785221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:27.785221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:43:27.785221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:27.785221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:43:27.785221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:27.785221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:27.785221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:27.785221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:27.785221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:27.785221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:27.785221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:27.785221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:27.785221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:27.785221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:27.785221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:27.785221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:27.785221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:27.786271 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:27.786271 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:27.786271 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:43:27.786271 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:43:27.786271 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:43:27.786271 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:43:27.786271 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:43:27.786271 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:43:27.786271 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 04 05:43:27.786271 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:27.786271 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 264/523] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 4 05:43:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:27.786271 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae66c28-31ab-4000-b3c2-980ffd35a99c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:27.800775 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 260/524] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:27.800775 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef04f65-c81c-4d06-b267-a29d93f5de04 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:27.813010 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:27.847216 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:27.904640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae66c28-31ab-4000-b3c2-980ffd35a99c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:27.911202 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef04f65-c81c-4d06-b267-a29d93f5de04 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:27.943475 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ede0e-dfc4-49af-ab55-f6619c36dd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:27.944274 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ede0e-dfc4-49af-ab55-f6619c36dd02 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:27.944555 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ede0e-dfc4-49af-ab55-f6619c36dd02 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:27.944831 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ede0e-dfc4-49af-ab55-f6619c36dd02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:27.949178 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0040442-fc55-4f47-a963-1b7466bf2542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:27.949914 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0040442-fc55-4f47-a963-1b7466bf2542 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:27.950260 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0040442-fc55-4f47-a963-1b7466bf2542 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:27.950597 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0040442-fc55-4f47-a963-1b7466bf2542 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:27.951646 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0040442-fc55-4f47-a963-1b7466bf2542 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:27.951752 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ede0e-dfc4-49af-ab55-f6619c36dd02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:27.952057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0040442-fc55-4f47-a963-1b7466bf2542 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:27.953157 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ede0e-dfc4-49af-ab55-f6619c36dd02 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:27.953611 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0040442-fc55-4f47-a963-1b7466bf2542 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:27.970695 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 261/525] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:27.970695 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0040442-fc55-4f47-a963-1b7466bf2542 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:27.970930 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-e29ede0e-dfc4-49af-ab55-f6619c36dd02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:27.970930 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:27.970930 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:27.970930 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:27.970930 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:27.970930 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:27.970930 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:27.970930 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:27.970930 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:27.970930 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:27.970930 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:27.970930 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:27.970930 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:43:27.970930 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:43:27.970930 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:43:27.971825 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:43:27.971825 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:27.971825 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:27.971825 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:27.971825 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:27.971825 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:27.971825 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:27.971825 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:27.971825 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:27.971825 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:27.971825 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:27.971825 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:27.971825 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:27.971825 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:27.971825 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:27.971825 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:27.971825 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:27.972946 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:43:27.972946 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:43:27.972946 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:43:27.972946 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:43:27.972946 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:43:27.972946 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:43:27.972946 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:27.972946 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:27.972946 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 265/526] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:43:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:27.972946 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ede0e-dfc4-49af-ab55-f6619c36dd02 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:28.056925 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:28.078088 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0040442-fc55-4f47-a963-1b7466bf2542 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:28.081224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:28.081419 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ede0e-dfc4-49af-ab55-f6619c36dd02 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:28.114972 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e8ea7-3407-4a46-a517-30e278c5fd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:28.115872 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e8ea7-3407-4a46-a517-30e278c5fd7a None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:28.116064 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873bcce-4662-4194-abb0-0bad6611dee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:28.116290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e8ea7-3407-4a46-a517-30e278c5fd7a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:28.116631 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e8ea7-3407-4a46-a517-30e278c5fd7a None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:28.117041 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873bcce-4662-4194-abb0-0bad6611dee2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:28.117390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873bcce-4662-4194-abb0-0bad6611dee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:28.117661 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e8ea7-3407-4a46-a517-30e278c5fd7a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:28.117748 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873bcce-4662-4194-abb0-0bad6611dee2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:28.118094 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e8ea7-3407-4a46-a517-30e278c5fd7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:28.119676 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e8ea7-3407-4a46-a517-30e278c5fd7a None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:28.125628 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873bcce-4662-4194-abb0-0bad6611dee2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:28.127146 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873bcce-4662-4194-abb0-0bad6611dee2 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:28.141759 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 262/527] 10.222.0.16 () {56 vars in 1139 bytes} [Mon Jul 4 05:43:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:28.141759 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e8ea7-3407-4a46-a517-30e278c5fd7a None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:28.142467 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-c873bcce-4662-4194-abb0-0bad6611dee2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:28.142467 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:28.142467 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:28.142467 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:28.142467 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:28.142467 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:28.142467 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:28.142467 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:28.142467 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:28.142467 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:28.142467 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:28.142467 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:28.142467 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:43:28.142467 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:43:28.142467 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:43:28.143355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:43:28.143355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:28.143355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:28.143355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:28.143355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:28.143355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:28.143355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:28.143355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:28.143355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:28.143355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:28.143355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:28.143355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:28.143355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:28.143355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:28.143355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:28.143355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:28.143355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:28.144286 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:43:28.144286 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:43:28.144286 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:43:28.144286 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:43:28.144286 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:43:28.144286 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:43:28.144286 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:28.144286 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:28.144286 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 266/528] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:43:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:28.144758 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873bcce-4662-4194-abb0-0bad6611dee2 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:28.244072 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873bcce-4662-4194-abb0-0bad6611dee2 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:28.246873 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e8ea7-3407-4a46-a517-30e278c5fd7a None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:28.280428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83303856-3a0a-46f5-9bb0-d32bf461d2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:28.281099 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83303856-3a0a-46f5-9bb0-d32bf461d2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:28.281386 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83303856-3a0a-46f5-9bb0-d32bf461d2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:28.281666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83303856-3a0a-46f5-9bb0-d32bf461d2e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:28.282487 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83303856-3a0a-46f5-9bb0-d32bf461d2e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:28.282800 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83303856-3a0a-46f5-9bb0-d32bf461d2e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:28.284122 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25a061-ded0-420d-81ce-a12b8a8938d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:28.284337 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83303856-3a0a-46f5-9bb0-d32bf461d2e6 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:28.284925 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25a061-ded0-420d-81ce-a12b8a8938d8 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:28.285203 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25a061-ded0-420d-81ce-a12b8a8938d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:28.285483 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25a061-ded0-420d-81ce-a12b8a8938d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:28.292270 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf25a061-ded0-420d-81ce-a12b8a8938d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:28.293780 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf25a061-ded0-420d-81ce-a12b8a8938d8 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:28.294975 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:28.308377 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 267/529] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:43:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:28.308377 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83303856-3a0a-46f5-9bb0-d32bf461d2e6 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:28.309305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-cf25a061-ded0-420d-81ce-a12b8a8938d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:28.309305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:28.309305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:28.309305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:28.309305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:28.309305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:28.309305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:28.309305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:28.309305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:28.309305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:28.309305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:28.309305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:28.309305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:43:28.309305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:43:28.309305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:43:28.310130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:43:28.310130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:28.310130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:28.310130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:28.310130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:28.310130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:28.310130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:28.310130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:28.310130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:28.310130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:28.310130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:28.310130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:28.310130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:28.310130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:28.310130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:28.310130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:28.310130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:28.310971 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:43:28.310971 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:43:28.310971 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:43:28.310971 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:43:28.310971 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:43:28.310971 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:43:28.310971 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:28.310971 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:28.310971 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 263/530] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:43:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:28.312048 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25a061-ded0-420d-81ce-a12b8a8938d8 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:28.338320 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:28.416118 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25a061-ded0-420d-81ce-a12b8a8938d8 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:28.420468 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83303856-3a0a-46f5-9bb0-d32bf461d2e6 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:28.453931 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238bf9fc-bce2-4d09-99b5-8812e2eadb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:28.454762 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238bf9fc-bce2-4d09-99b5-8812e2eadb9b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:28.454896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb312c00-4f9c-453b-b6c7-9439df737f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:28.455246 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238bf9fc-bce2-4d09-99b5-8812e2eadb9b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:28.455449 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb312c00-4f9c-453b-b6c7-9439df737f4f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:28.455715 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238bf9fc-bce2-4d09-99b5-8812e2eadb9b None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:28.455805 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb312c00-4f9c-453b-b6c7-9439df737f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:28.455999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb312c00-4f9c-453b-b6c7-9439df737f4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:28.456755 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238bf9fc-bce2-4d09-99b5-8812e2eadb9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:28.457158 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238bf9fc-bce2-4d09-99b5-8812e2eadb9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:28.458701 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238bf9fc-bce2-4d09-99b5-8812e2eadb9b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:28.481433 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 264/531] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:43:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:28.481433 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238bf9fc-bce2-4d09-99b5-8812e2eadb9b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:28.530626 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:28.535156 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb312c00-4f9c-453b-b6c7-9439df737f4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:28.537388 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb312c00-4f9c-453b-b6c7-9439df737f4f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:28.565994 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:28.584833 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238bf9fc-bce2-4d09-99b5-8812e2eadb9b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:28.621536 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e949af-2885-424c-b82c-582c14cb07f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:28.622118 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e949af-2885-424c-b82c-582c14cb07f8 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:28.622734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e949af-2885-424c-b82c-582c14cb07f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:28.623011 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e949af-2885-424c-b82c-582c14cb07f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:28.623872 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e949af-2885-424c-b82c-582c14cb07f8 None admin] RBAC: Adding query filter params (role.id=d775f350758d4eb8bfceeeb91e54351f, scope.project.id=4bc610fb6724419dac99f2483089c783, user.id=6f638cc70c994a529a48cb2c92b70384) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:28.624186 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e949af-2885-424c-b82c-582c14cb07f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:28.625634 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e949af-2885-424c-b82c-582c14cb07f8 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:28.631155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 265/532] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:43:28 2022] GET /identity/v3/role_assignments?user.id=6f638cc70c994a529a48cb2c92b70384&scope.project.id=4bc610fb6724419dac99f2483089c783&role.id=d775f350758d4eb8bfceeeb91e54351f => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:28.631946 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e949af-2885-424c-b82c-582c14cb07f8 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:28.657685 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 268/533] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:43:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 05:43:28.658860 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb312c00-4f9c-453b-b6c7-9439df737f4f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:28.779387 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e949af-2885-424c-b82c-582c14cb07f8 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:28.782389 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:28.788596 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb312c00-4f9c-453b-b6c7-9439df737f4f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:28.823522 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43431ef-78f7-4695-bf9c-07f1dd3385b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:28.824364 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43431ef-78f7-4695-bf9c-07f1dd3385b4 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:28.824746 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43431ef-78f7-4695-bf9c-07f1dd3385b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:28.825141 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43431ef-78f7-4695-bf9c-07f1dd3385b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:28.826046 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43431ef-78f7-4695-bf9c-07f1dd3385b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:28.826457 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43431ef-78f7-4695-bf9c-07f1dd3385b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:28.828074 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43431ef-78f7-4695-bf9c-07f1dd3385b4 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:28.841087 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 266/534] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:43:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:28.841308 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d345b-088e-4b24-92aa-718a59bc13e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:28.842169 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43431ef-78f7-4695-bf9c-07f1dd3385b4 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:28.842297 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d345b-088e-4b24-92aa-718a59bc13e8 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:28.842592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d345b-088e-4b24-92aa-718a59bc13e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:28.842996 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d345b-088e-4b24-92aa-718a59bc13e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:28.843931 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d345b-088e-4b24-92aa-718a59bc13e8 None admin] RBAC: Adding query filter params (role.id=d775f350758d4eb8bfceeeb91e54351f, scope.project.id=4bc610fb6724419dac99f2483089c783, user.id=8103fdfbdcf449a49e770750876bbee3) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:28.844304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d345b-088e-4b24-92aa-718a59bc13e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:28.847158 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d345b-088e-4b24-92aa-718a59bc13e8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:28.852109 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:28.859272 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 269/535] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:43:28 2022] GET /identity/v3/role_assignments?user.id=8103fdfbdcf449a49e770750876bbee3&scope.project.id=4bc610fb6724419dac99f2483089c783&role.id=d775f350758d4eb8bfceeeb91e54351f => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:28.860225 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d345b-088e-4b24-92aa-718a59bc13e8 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:29.005991 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43431ef-78f7-4695-bf9c-07f1dd3385b4 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:29.048780 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d345b-088e-4b24-92aa-718a59bc13e8 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:29.066906 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d42829-8f41-487f-bd46-f61dab2d943d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:29.068035 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d42829-8f41-487f-bd46-f61dab2d943d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:29.068460 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d42829-8f41-487f-bd46-f61dab2d943d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:29.068872 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d42829-8f41-487f-bd46-f61dab2d943d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:29.081859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d42829-8f41-487f-bd46-f61dab2d943d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:29.083551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d42829-8f41-487f-bd46-f61dab2d943d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:29.084065 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ee674-9bde-4f44-8f5f-61632a963dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:29.084777 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ee674-9bde-4f44-8f5f-61632a963dfa None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:29.085064 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ee674-9bde-4f44-8f5f-61632a963dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:29.085342 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ee674-9bde-4f44-8f5f-61632a963dfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:29.086228 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ee674-9bde-4f44-8f5f-61632a963dfa None admin] RBAC: Adding query filter params (role.id=d775f350758d4eb8bfceeeb91e54351f, scope.project.id=4bc610fb6724419dac99f2483089c783, user.id=77f0477631724d7f9c8ba752ba27866d) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:29.086543 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ee674-9bde-4f44-8f5f-61632a963dfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:29.088003 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ee674-9bde-4f44-8f5f-61632a963dfa None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:29.094316 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 270/536] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:43:28 2022] GET /identity/v3/role_assignments?user.id=77f0477631724d7f9c8ba752ba27866d&scope.project.id=4bc610fb6724419dac99f2483089c783&role.id=d775f350758d4eb8bfceeeb91e54351f => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:29.105043 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-71d42829-8f41-487f-bd46-f61dab2d943d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:29.105043 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:29.105043 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:29.105043 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:29.105043 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:29.105043 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:29.105043 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:29.105043 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:29.105043 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:29.105043 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:29.105043 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:29.105043 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:29.105043 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:29.105043 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:29.105043 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:29.106155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:29.106155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:29.106155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:29.106155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:29.106155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:29.106155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:29.106155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:29.106155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:29.106155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:29.106155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:29.106155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:29.106155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:29.106155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:29.106155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:29.106155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:29.106155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:29.106155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:29.107223 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:29.107223 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:29.107223 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:29.107223 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:29.109288 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 267/537] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:29.114497 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ee674-9bde-4f44-8f5f-61632a963dfa None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:29.145537 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:29.241514 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ee674-9bde-4f44-8f5f-61632a963dfa None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:29.282950 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eea325-da5b-406f-9cd3-25f1d6e4ae59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:29.283602 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eea325-da5b-406f-9cd3-25f1d6e4ae59 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:29.283842 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eea325-da5b-406f-9cd3-25f1d6e4ae59 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:29.284118 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eea325-da5b-406f-9cd3-25f1d6e4ae59 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:29.284854 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eea325-da5b-406f-9cd3-25f1d6e4ae59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:29.285161 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eea325-da5b-406f-9cd3-25f1d6e4ae59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:29.286552 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eea325-da5b-406f-9cd3-25f1d6e4ae59 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:29.305304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 271/538] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:43:29.310871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d42829-8f41-487f-bd46-f61dab2d943d None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:29.371597 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc6b72-6a20-4bbb-bbbd-8729089ba15b None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:29.371908 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc6b72-6a20-4bbb-bbbd-8729089ba15b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:29.372187 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc6b72-6a20-4bbb-bbbd-8729089ba15b None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:29.374147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 272/539] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:43:29.380213 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee0b27-2b93-4450-b861-0538075027f2 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:29.380514 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee0b27-2b93-4450-b861-0538075027f2 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:29.380788 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee0b27-2b93-4450-b861-0538075027f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:29.397294 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:29.402611 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-b1ee0b27-2b93-4450-b861-0538075027f2 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:29.403879 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b1ee0b27-2b93-4450-b861-0538075027f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:29.460379 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d42829-8f41-487f-bd46-f61dab2d943d None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:29.472119 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 273/540] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 05:43:29.495990 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155fb63-8f61-486e-872c-ec493471b7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:29.496803 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155fb63-8f61-486e-872c-ec493471b7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:29.497083 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155fb63-8f61-486e-872c-ec493471b7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:29.497670 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155fb63-8f61-486e-872c-ec493471b7c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:29.505006 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155fb63-8f61-486e-872c-ec493471b7c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:29.506892 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155fb63-8f61-486e-872c-ec493471b7c1 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:29.512255 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee0b27-2b93-4450-b861-0538075027f2 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:29.522873 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-1155fb63-8f61-486e-872c-ec493471b7c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:29.522873 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:29.522873 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:29.522873 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:29.522873 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:29.522873 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:29.522873 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:29.522873 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:29.522873 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:29.522873 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:29.522873 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:29.522873 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:29.522873 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:43:29.522873 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:43:29.522873 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:43:29.523778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:43:29.523778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:29.523778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:29.523778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:29.523778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:29.523778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:29.523778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:29.523778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:29.523778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:29.523778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:29.523778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:29.523778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:29.523778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:29.523778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:29.523778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:29.523778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:29.523778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:29.524596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:43:29.524596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:43:29.524596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:43:29.524596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:43:29.524596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:43:29.524596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:43:29.524596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:29.524596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:29.524596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 268/541] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:43:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:29.537312 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155fb63-8f61-486e-872c-ec493471b7c1 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:29.557241 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:29.640955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155fb63-8f61-486e-872c-ec493471b7c1 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:29.659531 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:29.676990 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769a3d5-adc1-4825-bb18-3d4c1450088c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:29.677666 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769a3d5-adc1-4825-bb18-3d4c1450088c None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:29.677949 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769a3d5-adc1-4825-bb18-3d4c1450088c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:29.678227 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769a3d5-adc1-4825-bb18-3d4c1450088c None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:29.679018 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769a3d5-adc1-4825-bb18-3d4c1450088c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:29.679356 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769a3d5-adc1-4825-bb18-3d4c1450088c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:29.680949 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769a3d5-adc1-4825-bb18-3d4c1450088c None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:29.693879 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 269/542] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:43:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:29.701062 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769a3d5-adc1-4825-bb18-3d4c1450088c None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:29.780619 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee0b27-2b93-4450-b861-0538075027f2 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:29.843882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad359d-e9d7-458e-b4d7-327b36c095f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:29.844718 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad359d-e9d7-458e-b4d7-327b36c095f3 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:29.844999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad359d-e9d7-458e-b4d7-327b36c095f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:29.845271 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad359d-e9d7-458e-b4d7-327b36c095f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:29.847677 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769a3d5-adc1-4825-bb18-3d4c1450088c None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:29.880073 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad359d-e9d7-458e-b4d7-327b36c095f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:29.882092 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6344455-0502-4c17-94f5-6b7f48fc2ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:29.882800 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6344455-0502-4c17-94f5-6b7f48fc2ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:29.883096 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6344455-0502-4c17-94f5-6b7f48fc2ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:29.883405 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6344455-0502-4c17-94f5-6b7f48fc2ca6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:29.884286 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6344455-0502-4c17-94f5-6b7f48fc2ca6 None admin] RBAC: Adding query filter params (role.id=d775f350758d4eb8bfceeeb91e54351f, scope.project.id=4bc610fb6724419dac99f2483089c783, user.id=5e5be3de52e945d3af1b2cad1c84c755) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:29.884606 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6344455-0502-4c17-94f5-6b7f48fc2ca6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:29.886141 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6344455-0502-4c17-94f5-6b7f48fc2ca6 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:29.892056 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 270/543] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:43:29 2022] GET /identity/v3/role_assignments?user.id=5e5be3de52e945d3af1b2cad1c84c755&scope.project.id=4bc610fb6724419dac99f2483089c783&role.id=d775f350758d4eb8bfceeeb91e54351f => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:29.892912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-06ad359d-e9d7-458e-b4d7-327b36c095f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:43:29.892912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:29.892912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:29.892912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:29.892912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:29.892912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:29.892912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:29.892912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:29.892912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:29.892912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:29.892912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:29.892912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:29.892912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:29.892912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:29.892912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:29.892912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:29.893757 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:29.893757 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:29.893757 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:29.893757 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:29.893757 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:29.893757 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:29.893757 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:29.893757 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:29.893757 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:29.893757 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:29.893757 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:29.893757 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:29.893757 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:29.893757 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:29.893757 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:29.893757 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:29.894533 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:29.894533 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:29.894533 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:29.894533 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:29.894533 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:29.894533 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:29.894533 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:29.894533 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:29.894533 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:29.894533 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:29.894533 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:43:29.894533 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:29.901075 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 274/544] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 4 05:43:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:29.906637 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6344455-0502-4c17-94f5-6b7f48fc2ca6 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:29.971515 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:30.045439 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6344455-0502-4c17-94f5-6b7f48fc2ca6 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:30.091786 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de37e4-5158-4cf0-81cb-7e35666c796b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:30.092837 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de37e4-5158-4cf0-81cb-7e35666c796b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:30.093316 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de37e4-5158-4cf0-81cb-7e35666c796b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:30.093813 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de37e4-5158-4cf0-81cb-7e35666c796b None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:30.094833 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de37e4-5158-4cf0-81cb-7e35666c796b None admin] RBAC: Adding query filter params (name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:30.095378 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de37e4-5158-4cf0-81cb-7e35666c796b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:30.096962 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de37e4-5158-4cf0-81cb-7e35666c796b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:30.107577 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 271/545] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 4 05:43:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:30.112904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad359d-e9d7-458e-b4d7-327b36c095f3 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:30.200099 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:30.231027 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad359d-e9d7-458e-b4d7-327b36c095f3 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:30.278790 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065d440-570f-468b-85ce-24adca0d55d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:30.279659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065d440-570f-468b-85ce-24adca0d55d9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:30.279940 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065d440-570f-468b-85ce-24adca0d55d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:30.280214 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065d440-570f-468b-85ce-24adca0d55d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:30.291441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065d440-570f-468b-85ce-24adca0d55d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:30.292953 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065d440-570f-468b-85ce-24adca0d55d9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:30.317184 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-b065d440-570f-468b-85ce-24adca0d55d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:30.317184 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:30.317184 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:30.317184 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:30.317184 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:30.317184 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:30.317184 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:30.317184 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:30.317184 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:30.317184 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:30.317184 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:30.317184 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:30.317184 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:30.317184 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:30.317184 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:30.318046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:30.318046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:30.318046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:30.318046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:30.318046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:30.318046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:30.318046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:30.318046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:30.318046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:30.318046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:30.318046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:30.318046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:30.318046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:30.318046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:30.318046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:30.318046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:30.318046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:30.318902 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:30.318902 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:30.318902 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:30.318902 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:30.318902 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 275/546] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:30.325333 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de37e4-5158-4cf0-81cb-7e35666c796b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:30.449548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de37e4-5158-4cf0-81cb-7e35666c796b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:30.456128 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:30.492308 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca4b98-3381-4237-8cf3-5395cc43aab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:30.493331 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca4b98-3381-4237-8cf3-5395cc43aab6 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:30.493815 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca4b98-3381-4237-8cf3-5395cc43aab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:30.494308 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca4b98-3381-4237-8cf3-5395cc43aab6 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:30.495257 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca4b98-3381-4237-8cf3-5395cc43aab6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:30.495835 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca4b98-3381-4237-8cf3-5395cc43aab6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:30.497729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca4b98-3381-4237-8cf3-5395cc43aab6 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:30.509912 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 272/547] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:30.515677 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065d440-570f-468b-85ce-24adca0d55d9 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:30.651646 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065d440-570f-468b-85ce-24adca0d55d9 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:30.691848 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:30.700053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8fe387-9d83-4a1f-aade-8f0c5fea26cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:30.704111 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fe387-9d83-4a1f-aade-8f0c5fea26cb None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:30.704783 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fe387-9d83-4a1f-aade-8f0c5fea26cb None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:30.705343 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fe387-9d83-4a1f-aade-8f0c5fea26cb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:30.714104 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8fe387-9d83-4a1f-aade-8f0c5fea26cb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:30.715598 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8fe387-9d83-4a1f-aade-8f0c5fea26cb None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:30.730002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-fb8fe387-9d83-4a1f-aade-8f0c5fea26cb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 04 05:43:30.730002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:30.730002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:30.730002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:30.730002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:30.730002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:30.730002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:30.730002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:30.730002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:30.730002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:30.730002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:30.730002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:30.730002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:43:30.730002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:43:30.730002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:43:30.730002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:43:30.731009 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:30.731009 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:30.731009 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:43:30.731009 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:30.731009 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:43:30.731009 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:30.731009 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:30.731009 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:30.731009 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:30.731009 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:30.731009 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:30.731009 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:30.731009 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:30.731009 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:30.731009 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:30.731009 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:30.731009 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:30.731009 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:30.732413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:30.732413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:30.732413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:43:30.732413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:43:30.732413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:43:30.732413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:43:30.732413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:43:30.732413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:43:30.732413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 04 05:43:30.732413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:30.732413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 276/548] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:43:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:30.739390 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca4b98-3381-4237-8cf3-5395cc43aab6 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:30.866403 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca4b98-3381-4237-8cf3-5395cc43aab6 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:30.900371 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0722d-99e7-4ab5-8b48-bc19904d9bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:30.901371 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0722d-99e7-4ab5-8b48-bc19904d9bbf None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:30.901913 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0722d-99e7-4ab5-8b48-bc19904d9bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:30.902412 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0722d-99e7-4ab5-8b48-bc19904d9bbf None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:30.903491 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0722d-99e7-4ab5-8b48-bc19904d9bbf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:30.904020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0722d-99e7-4ab5-8b48-bc19904d9bbf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:30.905656 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0722d-99e7-4ab5-8b48-bc19904d9bbf None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:30.923778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 273/549] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Jul 4 05:43:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:30.929684 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8fe387-9d83-4a1f-aade-8f0c5fea26cb None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:31.066936 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8fe387-9d83-4a1f-aade-8f0c5fea26cb None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:31.100293 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e727f-c3b7-463e-a7e8-c9fdf70c62ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:31.100935 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e727f-c3b7-463e-a7e8-c9fdf70c62ff None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:31.101210 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e727f-c3b7-463e-a7e8-c9fdf70c62ff None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:31.101479 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e727f-c3b7-463e-a7e8-c9fdf70c62ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:31.129085 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee57129-9243-4c1e-81e0-a560c9847c0e None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:31.129814 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee57129-9243-4c1e-81e0-a560c9847c0e None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:31.130301 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee57129-9243-4c1e-81e0-a560c9847c0e None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:31.132263 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 274/550] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:43:31.138560 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f791c90-ec9f-46f3-92f2-a2700ae00217 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:31.139126 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f791c90-ec9f-46f3-92f2-a2700ae00217 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:31.139765 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f791c90-ec9f-46f3-92f2-a2700ae00217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:31.163576 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:31.172174 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-2f791c90-ec9f-46f3-92f2-a2700ae00217 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:31.173475 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-2f791c90-ec9f-46f3-92f2-a2700ae00217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:31.176254 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e727f-c3b7-463e-a7e8-c9fdf70c62ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:31.177938 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e727f-c3b7-463e-a7e8-c9fdf70c62ff None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:31.203075 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:31.275740 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 275/551] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:31.300287 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f791c90-ec9f-46f3-92f2-a2700ae00217 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:31.373330 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 277/552] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:43:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 05:43:31.380185 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e727f-c3b7-463e-a7e8-c9fdf70c62ff None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:31.439823 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f791c90-ec9f-46f3-92f2-a2700ae00217 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:31.475866 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462ae19-cb09-4132-8e05-117f0d9e1c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:31.476664 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462ae19-cb09-4132-8e05-117f0d9e1c3b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:31.476947 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462ae19-cb09-4132-8e05-117f0d9e1c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:31.477222 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462ae19-cb09-4132-8e05-117f0d9e1c3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:31.496217 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462ae19-cb09-4132-8e05-117f0d9e1c3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:31.505944 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-3462ae19-cb09-4132-8e05-117f0d9e1c3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:43:31.505944 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:31.505944 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:31.505944 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:31.505944 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:31.505944 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:31.505944 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:31.505944 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:31.505944 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:31.505944 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:31.505944 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:31.505944 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:31.505944 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:31.505944 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:31.505944 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:31.505944 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:31.506915 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:31.506915 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:31.506915 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:31.506915 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:31.506915 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:31.506915 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:31.506915 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:31.506915 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:31.506915 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:31.506915 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:31.506915 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:31.506915 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:31.506915 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:31.506915 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:31.506915 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:31.506915 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:31.507753 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:31.507753 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:31.507753 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:31.507753 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:31.507753 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:31.507753 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:31.507753 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:31.507753 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:31.507753 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:31.507753 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:31.507753 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:43:31.507753 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:31.508366 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 276/553] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 4 05:43:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:43:31.512400 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6acfeb-05d1-49d2-9178-011112f60279 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:31.512689 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6acfeb-05d1-49d2-9178-011112f60279 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:31.512969 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6acfeb-05d1-49d2-9178-011112f60279 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:31.514397 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 277/554] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:31.515087 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6acfeb-05d1-49d2-9178-011112f60279 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:31.518878 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:31.536716 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:31.546151 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e727f-c3b7-463e-a7e8-c9fdf70c62ff None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:31.586998 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13a231-257d-4128-8294-479e82649391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:31.588209 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13a231-257d-4128-8294-479e82649391 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:31.588730 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13a231-257d-4128-8294-479e82649391 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:31.589351 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13a231-257d-4128-8294-479e82649391 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:31.600775 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13a231-257d-4128-8294-479e82649391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:31.602740 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13a231-257d-4128-8294-479e82649391 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:31.623123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-6d13a231-257d-4128-8294-479e82649391 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:31.623123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:31.623123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:31.623123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:31.623123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:31.623123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:31.623123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:31.623123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:31.623123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:31.623123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:31.623123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:31.623123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:31.623123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:31.623123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:31.623123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:31.624201 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:31.624201 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:31.624201 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:31.624201 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:31.624201 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:31.624201 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:31.624201 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:31.624201 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:31.624201 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:31.624201 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:31.624201 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:31.624201 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:31.624201 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:31.624201 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:31.624201 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:31.624201 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:31.624201 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:31.625116 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:31.625116 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:31.625116 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:31.625116 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:31.627476 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 278/555] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:31.629033 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e19317-a695-4201-86a6-22430eab9847 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:31.629622 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e19317-a695-4201-86a6-22430eab9847 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:31.630183 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e19317-a695-4201-86a6-22430eab9847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:31.641149 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6acfeb-05d1-49d2-9178-011112f60279 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:31.648459 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-e2e19317-a695-4201-86a6-22430eab9847 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:31.649990 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e2e19317-a695-4201-86a6-22430eab9847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:31.683565 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00793f99-3aac-4497-bbe1-52753f33cec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:31.684289 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00793f99-3aac-4497-bbe1-52753f33cec4 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:31.684577 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00793f99-3aac-4497-bbe1-52753f33cec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:31.684931 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00793f99-3aac-4497-bbe1-52753f33cec4 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:31.685801 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00793f99-3aac-4497-bbe1-52753f33cec4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:31.686107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00793f99-3aac-4497-bbe1-52753f33cec4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:31.687507 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00793f99-3aac-4497-bbe1-52753f33cec4 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:31.700494 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 278/556] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 4 05:43:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:31.702203 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00793f99-3aac-4497-bbe1-52753f33cec4 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:31.755213 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 279/557] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:31.755213 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e19317-a695-4201-86a6-22430eab9847 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:31.859761 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:31.865686 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:31.887665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00793f99-3aac-4497-bbe1-52753f33cec4 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:31.898973 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e19317-a695-4201-86a6-22430eab9847 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:31.922316 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6ce25-c092-4299-ae94-360baba2c357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:31.922990 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6ce25-c092-4299-ae94-360baba2c357 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:31.923318 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6ce25-c092-4299-ae94-360baba2c357 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:31.923602 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6ce25-c092-4299-ae94-360baba2c357 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:31.924326 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d6ce25-c092-4299-ae94-360baba2c357 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:31.924634 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d6ce25-c092-4299-ae94-360baba2c357 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:31.926017 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d6ce25-c092-4299-ae94-360baba2c357 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:31.933877 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36122d53-fe49-4dd5-ba6f-ec7f70a58a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:31.934947 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36122d53-fe49-4dd5-ba6f-ec7f70a58a29 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:31.934947 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36122d53-fe49-4dd5-ba6f-ec7f70a58a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:31.935247 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36122d53-fe49-4dd5-ba6f-ec7f70a58a29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:31.938481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 279/558] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:31.939224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6ce25-c092-4299-ae94-360baba2c357 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:31.950555 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36122d53-fe49-4dd5-ba6f-ec7f70a58a29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:31.952360 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36122d53-fe49-4dd5-ba6f-ec7f70a58a29 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:31.970198 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-36122d53-fe49-4dd5-ba6f-ec7f70a58a29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:31.970198 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:31.970198 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:31.970198 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:31.970198 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:31.970198 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:31.970198 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:31.970198 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:31.970198 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:31.970198 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:31.970198 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:31.970198 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:31.970198 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:31.970198 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:31.970198 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:31.971612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:31.971612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:31.971612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:31.971612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:31.971612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:31.971612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:31.971612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:31.971612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:31.971612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:31.971612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:31.971612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:31.971612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:31.971612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:31.971612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:31.971612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:31.971612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:31.971612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:31.972474 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:31.972474 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:31.972474 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:31.972474 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:31.976181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 280/559] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:31.977482 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76d171-b39e-41a2-91c0-47d16346f384 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:31.977771 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76d171-b39e-41a2-91c0-47d16346f384 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:31.978048 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76d171-b39e-41a2-91c0-47d16346f384 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:31.983396 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 281/560] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:31.983396 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76d171-b39e-41a2-91c0-47d16346f384 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:32.055002 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6ce25-c092-4299-ae94-360baba2c357 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:32.090215 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7bbda-ffdd-451c-a794-1b998862999a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:32.091026 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7bbda-ffdd-451c-a794-1b998862999a None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:32.091342 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7bbda-ffdd-451c-a794-1b998862999a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:32.091623 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7bbda-ffdd-451c-a794-1b998862999a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:32.093613 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:32.095313 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76d171-b39e-41a2-91c0-47d16346f384 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:32.104437 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af7bbda-ffdd-451c-a794-1b998862999a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:32.113197 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-4af7bbda-ffdd-451c-a794-1b998862999a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:43:32.113197 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:32.113197 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:32.113197 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:32.113197 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:32.113197 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:32.113197 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:32.113197 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:32.113197 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:32.113197 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:32.113197 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:32.113197 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:32.113197 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:32.113197 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:32.113197 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:32.113197 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:32.114206 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:32.114206 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:32.114206 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:32.114206 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:32.114206 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:32.114206 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:32.114206 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:32.114206 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:32.114206 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:32.114206 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:32.114206 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:32.114206 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:32.114206 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:32.114206 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:32.114206 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:32.114206 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:32.115031 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:32.115031 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:32.115031 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:32.115031 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:32.115031 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:32.115031 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:32.115031 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:32.115031 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:32.115031 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:32.115031 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:32.115031 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:43:32.115031 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:32.115031 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 280/561] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 4 05:43:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:32.116812 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7bbda-ffdd-451c-a794-1b998862999a None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:32.119106 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:32.131838 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d9054-67e6-4661-8ea9-be397cc15d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:32.132699 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d9054-67e6-4661-8ea9-be397cc15d08 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:32.132985 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d9054-67e6-4661-8ea9-be397cc15d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:32.133262 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d9054-67e6-4661-8ea9-be397cc15d08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:32.140735 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d9054-67e6-4661-8ea9-be397cc15d08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:32.142305 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d9054-67e6-4661-8ea9-be397cc15d08 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:32.155999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-3a9d9054-67e6-4661-8ea9-be397cc15d08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:32.155999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:32.155999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:32.155999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:32.155999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:32.155999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:32.155999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:32.155999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:32.155999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:32.155999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:32.155999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:32.155999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:32.155999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:43:32.155999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:43:32.155999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:43:32.157122 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:43:32.157122 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:32.157122 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:32.157122 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:32.157122 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:32.157122 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:32.157122 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:32.157122 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:32.157122 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:32.157122 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:32.157122 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:32.157122 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:32.157122 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:32.157122 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:32.157122 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:32.157122 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:32.157122 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:32.158273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:43:32.158273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:43:32.158273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:43:32.158273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:43:32.158273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:43:32.158273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:43:32.158273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:32.158273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:32.158273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 282/562] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:43:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:32.158766 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a88d63-1574-4d9c-8a85-a81bede0611b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:32.158901 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a88d63-1574-4d9c-8a85-a81bede0611b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:32.159198 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a88d63-1574-4d9c-8a85-a81bede0611b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:32.175342 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-c1a88d63-1574-4d9c-8a85-a81bede0611b None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:32.176504 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c1a88d63-1574-4d9c-8a85-a81bede0611b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:32.226787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7bbda-ffdd-451c-a794-1b998862999a None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:32.239788 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 283/563] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:32.240605 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a88d63-1574-4d9c-8a85-a81bede0611b None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:32.261334 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592121e-9c2b-4c45-a436-2ca5e155e0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:32.262150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592121e-9c2b-4c45-a436-2ca5e155e0cf None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:32.262509 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592121e-9c2b-4c45-a436-2ca5e155e0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:32.262802 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592121e-9c2b-4c45-a436-2ca5e155e0cf None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:32.263547 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592121e-9c2b-4c45-a436-2ca5e155e0cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:32.263854 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592121e-9c2b-4c45-a436-2ca5e155e0cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:32.265235 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592121e-9c2b-4c45-a436-2ca5e155e0cf None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:32.278167 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 281/564] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:32.278938 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592121e-9c2b-4c45-a436-2ca5e155e0cf None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:32.331685 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:32.337557 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a88d63-1574-4d9c-8a85-a81bede0611b None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:32.350200 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:32.370467 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54958a-7388-4eaf-9b38-2541bc6493f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:32.371127 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54958a-7388-4eaf-9b38-2541bc6493f5 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:32.371436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54958a-7388-4eaf-9b38-2541bc6493f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:32.371705 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54958a-7388-4eaf-9b38-2541bc6493f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:32.372785 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54958a-7388-4eaf-9b38-2541bc6493f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:32.373083 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54958a-7388-4eaf-9b38-2541bc6493f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:32.374470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54958a-7388-4eaf-9b38-2541bc6493f5 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:32.376015 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592121e-9c2b-4c45-a436-2ca5e155e0cf None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:32.382131 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 284/565] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 4 05:43:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:32.383350 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabfb12-8852-4b4a-9e21-de1bf7e5dd5f None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:32.383633 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabfb12-8852-4b4a-9e21-de1bf7e5dd5f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:32.383904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabfb12-8852-4b4a-9e21-de1bf7e5dd5f None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:32.385114 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 285/566] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:32.385785 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabfb12-8852-4b4a-9e21-de1bf7e5dd5f None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:32.414956 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7e08b-e66a-4558-a7c1-ee5de2514a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:32.415606 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7e08b-e66a-4558-a7c1-ee5de2514a1e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:32.415862 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7e08b-e66a-4558-a7c1-ee5de2514a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:32.416146 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7e08b-e66a-4558-a7c1-ee5de2514a1e None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:32.416936 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7e08b-e66a-4558-a7c1-ee5de2514a1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:32.417275 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7e08b-e66a-4558-a7c1-ee5de2514a1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:32.418720 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7e08b-e66a-4558-a7c1-ee5de2514a1e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:32.430184 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 282/567] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:43:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:32.431070 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7e08b-e66a-4558-a7c1-ee5de2514a1e None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:32.486118 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabfb12-8852-4b4a-9e21-de1bf7e5dd5f None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:32.519061 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32c96c-5e9e-4377-a480-857087dad7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:32.519876 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32c96c-5e9e-4377-a480-857087dad7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:32.520154 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32c96c-5e9e-4377-a480-857087dad7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:32.520423 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32c96c-5e9e-4377-a480-857087dad7f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:32.531131 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe32c96c-5e9e-4377-a480-857087dad7f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:32.531954 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7e08b-e66a-4558-a7c1-ee5de2514a1e None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:32.539068 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-fe32c96c-5e9e-4377-a480-857087dad7f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:43:32.539068 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:32.539068 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:32.539068 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:32.539068 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:32.539068 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:32.539068 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:32.539068 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:32.539068 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:32.539068 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:32.539068 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:32.539068 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:32.539068 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:32.539068 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:32.539068 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:32.539068 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:32.540105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:32.540105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:32.540105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:32.540105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:32.540105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:32.540105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:32.540105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:32.540105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:32.540105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:32.540105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:32.540105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:32.540105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:32.540105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:32.540105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:32.540105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:32.540105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:32.541056 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:32.541056 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:32.541056 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:32.541056 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:32.541056 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:32.541056 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:32.541056 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:32.541056 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:32.541056 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:32.541056 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:32.541056 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:43:32.541056 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:32.541056 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 286/568] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 4 05:43:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:32.541975 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32c96c-5e9e-4377-a480-857087dad7f1 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:32.550040 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:32.570539 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133863ca-503c-4ddd-8599-d5b6550bf3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:32.571378 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133863ca-503c-4ddd-8599-d5b6550bf3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:32.571664 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133863ca-503c-4ddd-8599-d5b6550bf3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:32.571947 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133863ca-503c-4ddd-8599-d5b6550bf3a0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:32.574967 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:32.579440 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133863ca-503c-4ddd-8599-d5b6550bf3a0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:32.580891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133863ca-503c-4ddd-8599-d5b6550bf3a0 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:32.595354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-133863ca-503c-4ddd-8599-d5b6550bf3a0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 05:43:32.595354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:32.595354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:32.595354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:32.595354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:32.595354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:32.595354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:32.595354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:32.595354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:32.595354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:32.595354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:32.595354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:32.595354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:43:32.595354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:43:32.595354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:43:32.595354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:43:32.596290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:32.596290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:32.596290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:43:32.596290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:32.596290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:43:32.596290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:32.596290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:32.596290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:32.596290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:32.596290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:32.596290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:32.596290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:32.596290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:32.596290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:32.596290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:32.596290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:32.596290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:32.596290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:32.597294 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:32.597294 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:32.597294 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:43:32.597294 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:43:32.597294 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:43:32.597294 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:43:32.597294 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:43:32.597294 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:43:32.597294 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 05:43:32.597294 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:32.597294 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 283/569] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jul 4 05:43:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:32.597906 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad034ea-445c-4677-ac03-3d435487ca18 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:32.597987 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad034ea-445c-4677-ac03-3d435487ca18 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:32.598250 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad034ea-445c-4677-ac03-3d435487ca18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:32.614644 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-2ad034ea-445c-4677-ac03-3d435487ca18 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:32.615921 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-2ad034ea-445c-4677-ac03-3d435487ca18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:32.645919 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32c96c-5e9e-4377-a480-857087dad7f1 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:32.679115 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad62355-5a17-49fd-b757-df58869e9b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:32.679882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad62355-5a17-49fd-b757-df58869e9b5a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:32.680156 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad62355-5a17-49fd-b757-df58869e9b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:32.680426 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad62355-5a17-49fd-b757-df58869e9b5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:32.681116 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 284/570] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:32.681921 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad034ea-445c-4677-ac03-3d435487ca18 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:32.691376 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad62355-5a17-49fd-b757-df58869e9b5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:32.692818 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad62355-5a17-49fd-b757-df58869e9b5a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:32.710117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-bad62355-5a17-49fd-b757-df58869e9b5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:32.710117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:32.710117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:32.710117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:32.710117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:32.710117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:32.710117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:32.710117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:32.710117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:32.710117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:32.710117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:32.710117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:32.710117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:32.710117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:32.710117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:32.711053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:32.711053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:32.711053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:32.711053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:32.711053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:32.711053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:32.711053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:32.711053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:32.711053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:32.711053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:32.711053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:32.711053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:32.711053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:32.711053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:32.711053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:32.711053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:32.711053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:32.711974 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:32.711974 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:32.711974 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:32.711974 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:32.715902 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 287/571] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:32.716533 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad62355-5a17-49fd-b757-df58869e9b5a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:32.789655 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad034ea-445c-4677-ac03-3d435487ca18 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:32.791932 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:32.798511 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:32.813242 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad62355-5a17-49fd-b757-df58869e9b5a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:32.823360 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43034576-98ef-4c50-b701-39642428a500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:32.824028 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43034576-98ef-4c50-b701-39642428a500 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:32.824309 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43034576-98ef-4c50-b701-39642428a500 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:32.824585 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43034576-98ef-4c50-b701-39642428a500 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:32.825416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43034576-98ef-4c50-b701-39642428a500 None admin] RBAC: Adding query filter params (role.id=d775f350758d4eb8bfceeeb91e54351f, scope.project.id=4bc610fb6724419dac99f2483089c783, user.id=e55a1c343c60428db2d9e5e6ed865e21) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:32.825732 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43034576-98ef-4c50-b701-39642428a500 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:32.827225 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43034576-98ef-4c50-b701-39642428a500 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:32.832546 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 285/572] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:43:32 2022] GET /identity/v3/role_assignments?user.id=e55a1c343c60428db2d9e5e6ed865e21&scope.project.id=4bc610fb6724419dac99f2483089c783&role.id=d775f350758d4eb8bfceeeb91e54351f => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:32.833308 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43034576-98ef-4c50-b701-39642428a500 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:32.846887 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7ae37-a00f-4c70-bf70-7d00c6f0d412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:32.847696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7ae37-a00f-4c70-bf70-7d00c6f0d412 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:32.847979 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7ae37-a00f-4c70-bf70-7d00c6f0d412 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:32.848260 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7ae37-a00f-4c70-bf70-7d00c6f0d412 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:32.849036 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7ae37-a00f-4c70-bf70-7d00c6f0d412 None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:32.849345 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7ae37-a00f-4c70-bf70-7d00c6f0d412 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:32.850846 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7ae37-a00f-4c70-bf70-7d00c6f0d412 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:32.860315 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 288/573] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 4 05:43:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:32.861910 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7ae37-a00f-4c70-bf70-7d00c6f0d412 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:32.966395 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43034576-98ef-4c50-b701-39642428a500 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:32.982207 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7ae37-a00f-4c70-bf70-7d00c6f0d412 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:33.004596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7d64c-c75b-4d25-a227-743bf2e7a765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:33.005266 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7d64c-c75b-4d25-a227-743bf2e7a765 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:33.005549 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7d64c-c75b-4d25-a227-743bf2e7a765 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:33.005823 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7d64c-c75b-4d25-a227-743bf2e7a765 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:33.006661 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc7d64c-c75b-4d25-a227-743bf2e7a765 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:33.006970 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc7d64c-c75b-4d25-a227-743bf2e7a765 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:33.008446 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc7d64c-c75b-4d25-a227-743bf2e7a765 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:33.026459 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cca256-6395-4be4-863c-9e7198cda0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:33.031308 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 286/574] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jul 4 05:43:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:33.031437 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cca256-6395-4be4-863c-9e7198cda0fc None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:33.031437 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cca256-6395-4be4-863c-9e7198cda0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:33.031599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7d64c-c75b-4d25-a227-743bf2e7a765 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:33.031708 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cca256-6395-4be4-863c-9e7198cda0fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:33.042103 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cca256-6395-4be4-863c-9e7198cda0fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:33.050181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-f2cca256-6395-4be4-863c-9e7198cda0fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:43:33.050181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:33.050181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:33.050181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:33.050181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:33.050181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:33.050181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:33.050181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:33.050181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:33.050181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:33.050181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:33.050181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:33.050181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:33.050181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:33.050181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:33.050181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:33.051094 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:33.051094 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:33.051094 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:33.051094 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:33.051094 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:33.051094 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:33.051094 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:33.051094 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:33.051094 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:33.051094 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:33.051094 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:33.051094 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:33.051094 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:33.051094 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:33.051094 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:33.051094 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:33.052107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:33.052107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:33.052107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:33.052107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:33.052107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:33.052107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:33.052107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:33.052107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:33.052107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:33.052107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:33.052107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:43:33.052107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:33.052107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 289/575] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 4 05:43:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:33.053689 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cca256-6395-4be4-863c-9e7198cda0fc None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:33.059724 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:33.064229 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:33.139729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7d64c-c75b-4d25-a227-743bf2e7a765 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:33.163687 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cca256-6395-4be4-863c-9e7198cda0fc None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:33.176994 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb027e-715f-486d-b575-bb7768881ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:33.177667 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb027e-715f-486d-b575-bb7768881ffc None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:33.178047 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb027e-715f-486d-b575-bb7768881ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:33.178320 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb027e-715f-486d-b575-bb7768881ffc None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:33.179162 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb027e-715f-486d-b575-bb7768881ffc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:33.179490 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb027e-715f-486d-b575-bb7768881ffc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:33.180888 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb027e-715f-486d-b575-bb7768881ffc None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:33.198299 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 287/576] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:33.198299 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb027e-715f-486d-b575-bb7768881ffc None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:33.206018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f4540-a51d-479b-b81f-c672221fb027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:33.207293 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f4540-a51d-479b-b81f-c672221fb027 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:33.207759 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f4540-a51d-479b-b81f-c672221fb027 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:33.208204 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f4540-a51d-479b-b81f-c672221fb027 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:33.221126 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f4540-a51d-479b-b81f-c672221fb027 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:33.222643 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f4540-a51d-479b-b81f-c672221fb027 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:33.245282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-cf5f4540-a51d-479b-b81f-c672221fb027 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:33.245282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:33.245282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:33.245282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:33.245282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:33.245282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:33.245282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:33.245282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:33.245282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:33.245282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:33.245282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:33.245282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:33.245282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:33.245282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:33.245282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:33.246380 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:33.246380 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:33.246380 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:33.246380 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:33.246380 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:33.246380 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:33.246380 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:33.246380 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:33.246380 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:33.246380 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:33.246380 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:33.246380 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:33.246380 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:33.246380 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:33.246380 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:33.246380 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:33.246380 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:33.247863 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:33.247863 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:33.247863 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:33.247863 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:33.248470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 290/577] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:33.248470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f4540-a51d-479b-b81f-c672221fb027 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:33.292618 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:33.308952 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb027e-715f-486d-b575-bb7768881ffc None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:33.313603 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:33.344014 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e5abc-c7b9-4284-9e2d-c8c5903c0486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:33.344832 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e5abc-c7b9-4284-9e2d-c8c5903c0486 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:33.345115 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e5abc-c7b9-4284-9e2d-c8c5903c0486 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:33.345389 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e5abc-c7b9-4284-9e2d-c8c5903c0486 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:33.357039 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e5abc-c7b9-4284-9e2d-c8c5903c0486 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:33.358495 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e5abc-c7b9-4284-9e2d-c8c5903c0486 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:33.359547 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f4540-a51d-479b-b81f-c672221fb027 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:33.376151 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-6a7e5abc-c7b9-4284-9e2d-c8c5903c0486 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:33.376151 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:33.376151 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:33.376151 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:33.376151 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:33.376151 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:33.376151 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:33.376151 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:33.376151 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:33.376151 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:33.376151 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:33.376151 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:33.376151 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:33.376151 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:33.376151 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:33.377055 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:33.377055 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:33.377055 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:33.377055 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:33.377055 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:33.377055 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:33.377055 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:33.377055 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:33.377055 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:33.377055 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:33.377055 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:33.377055 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:33.377055 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:33.377055 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:33.377055 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:33.377055 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:33.377055 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:33.377911 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:33.377911 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:33.377911 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:33.377911 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:33.377911 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 288/578] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:33.382609 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e5abc-c7b9-4284-9e2d-c8c5903c0486 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:33.396848 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59234826-aa7d-4da4-a4f7-14540f298396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:33.398137 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59234826-aa7d-4da4-a4f7-14540f298396 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:33.398629 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59234826-aa7d-4da4-a4f7-14540f298396 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:33.399096 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59234826-aa7d-4da4-a4f7-14540f298396 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:33.400062 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59234826-aa7d-4da4-a4f7-14540f298396 None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:33.400561 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59234826-aa7d-4da4-a4f7-14540f298396 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:33.402490 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59234826-aa7d-4da4-a4f7-14540f298396 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:33.416842 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 291/579] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 4 05:43:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:33.417963 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59234826-aa7d-4da4-a4f7-14540f298396 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:33.484795 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e5abc-c7b9-4284-9e2d-c8c5903c0486 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:33.517454 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59234826-aa7d-4da4-a4f7-14540f298396 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:33.519747 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2ab6f-89a7-46b6-ac47-847e40d23dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:33.520561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2ab6f-89a7-46b6-ac47-847e40d23dae None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:33.520849 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2ab6f-89a7-46b6-ac47-847e40d23dae None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:33.521129 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2ab6f-89a7-46b6-ac47-847e40d23dae None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:33.532473 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2ab6f-89a7-46b6-ac47-847e40d23dae None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:33.536244 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2ab6f-89a7-46b6-ac47-847e40d23dae None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:33.538277 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:33.551247 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:33.552284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-aeb2ab6f-89a7-46b6-ac47-847e40d23dae None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 05:43:33.552284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:33.552284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:33.552284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:33.552284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:33.552284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:33.552284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:33.552284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:33.552284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:33.552284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:33.552284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:33.552284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:33.552284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:43:33.552284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:43:33.552284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:43:33.552284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:43:33.553184 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:33.553184 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:33.553184 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:43:33.553184 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:33.553184 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:43:33.553184 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:33.553184 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:33.553184 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:33.553184 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:33.553184 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:33.553184 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:33.553184 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:33.553184 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:33.553184 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:33.553184 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:33.553184 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:33.553184 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:33.553184 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:33.554158 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:33.554158 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:33.554158 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:43:33.554158 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:43:33.554158 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:43:33.554158 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:43:33.554158 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:43:33.554158 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:43:33.554158 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 05:43:33.554158 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:33.554158 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 289/580] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:43:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:33.555333 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2ab6f-89a7-46b6-ac47-847e40d23dae None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:33.570058 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273aca3-6457-4391-922e-26570d2ccb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:33.570733 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273aca3-6457-4391-922e-26570d2ccb79 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:33.571015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273aca3-6457-4391-922e-26570d2ccb79 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:33.571316 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273aca3-6457-4391-922e-26570d2ccb79 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:33.572032 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273aca3-6457-4391-922e-26570d2ccb79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:33.572335 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273aca3-6457-4391-922e-26570d2ccb79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:33.573797 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273aca3-6457-4391-922e-26570d2ccb79 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:33.585912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 292/581] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:33.586613 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273aca3-6457-4391-922e-26570d2ccb79 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:33.666173 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2ab6f-89a7-46b6-ac47-847e40d23dae None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:33.692054 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273aca3-6457-4391-922e-26570d2ccb79 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:33.699899 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a28899-3818-4b78-877c-47049ecd0a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:33.700568 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a28899-3818-4b78-877c-47049ecd0a5a None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:33.700854 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a28899-3818-4b78-877c-47049ecd0a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:33.701132 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a28899-3818-4b78-877c-47049ecd0a5a None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:33.701851 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a28899-3818-4b78-877c-47049ecd0a5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:33.702157 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a28899-3818-4b78-877c-47049ecd0a5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:33.703581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a28899-3818-4b78-877c-47049ecd0a5a None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:33.715092 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 290/582] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:33.716540 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a28899-3818-4b78-877c-47049ecd0a5a None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:33.732586 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabc57b-9c72-4e5c-ac67-2518c9ca49f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:33.733382 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabc57b-9c72-4e5c-ac67-2518c9ca49f9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:33.733674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabc57b-9c72-4e5c-ac67-2518c9ca49f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:33.733942 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabc57b-9c72-4e5c-ac67-2518c9ca49f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:33.744478 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabc57b-9c72-4e5c-ac67-2518c9ca49f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:33.746414 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabc57b-9c72-4e5c-ac67-2518c9ca49f9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:33.765520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-adabc57b-9c72-4e5c-ac67-2518c9ca49f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:33.765520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:33.765520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:33.765520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:33.765520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:33.765520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:33.765520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:33.765520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:33.765520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:33.765520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:33.765520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:33.765520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:33.765520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:33.765520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:33.765520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:33.766481 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:33.766481 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:33.766481 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:33.766481 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:33.766481 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:33.766481 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:33.766481 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:33.766481 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:33.766481 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:33.766481 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:33.766481 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:33.766481 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:33.766481 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:33.766481 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:33.766481 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:33.766481 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:33.766481 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:33.767440 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:33.767440 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:33.767440 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:33.767440 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:33.767440 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 293/583] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:33.767734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabc57b-9c72-4e5c-ac67-2518c9ca49f9 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:33.787557 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:33.803777 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:33.831574 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a28899-3818-4b78-877c-47049ecd0a5a None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:33.866032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb413a93-51e2-43f6-bd4d-1143c8ac7846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:33.866848 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb413a93-51e2-43f6-bd4d-1143c8ac7846 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:33.867255 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb413a93-51e2-43f6-bd4d-1143c8ac7846 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:33.867635 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb413a93-51e2-43f6-bd4d-1143c8ac7846 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:33.868480 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb413a93-51e2-43f6-bd4d-1143c8ac7846 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:33.868788 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb413a93-51e2-43f6-bd4d-1143c8ac7846 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:33.870317 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb413a93-51e2-43f6-bd4d-1143c8ac7846 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:33.875668 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabc57b-9c72-4e5c-ac67-2518c9ca49f9 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:33.888194 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 291/584] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Jul 4 05:43:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:33.893321 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb413a93-51e2-43f6-bd4d-1143c8ac7846 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:33.914780 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0009870-5384-4fd2-bbfa-474bc02924d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:33.916316 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0009870-5384-4fd2-bbfa-474bc02924d3 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:33.916862 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0009870-5384-4fd2-bbfa-474bc02924d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:33.917254 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0009870-5384-4fd2-bbfa-474bc02924d3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:33.928132 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0009870-5384-4fd2-bbfa-474bc02924d3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:33.930576 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0009870-5384-4fd2-bbfa-474bc02924d3 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:33.949597 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-f0009870-5384-4fd2-bbfa-474bc02924d3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 04 05:43:33.949597 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:33.949597 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:33.949597 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:33.949597 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:33.949597 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:33.949597 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:33.949597 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:33.949597 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:33.949597 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:33.949597 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:33.949597 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:33.949597 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:43:33.949597 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:43:33.949597 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:43:33.949597 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:43:33.950818 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:33.950818 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:33.950818 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:43:33.950818 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:33.950818 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:43:33.950818 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:33.950818 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:33.950818 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:33.950818 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:33.950818 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:33.950818 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:33.950818 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:33.950818 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:33.950818 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:33.950818 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:33.950818 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:33.950818 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:33.950818 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:33.956581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:33.956581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:33.956581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:43:33.956581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:43:33.956581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:43:33.956581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:43:33.956581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:43:33.956581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:43:33.956581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 04 05:43:33.956581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:33.956581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 294/585] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:43:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:33.956581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0009870-5384-4fd2-bbfa-474bc02924d3 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:33.999882 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb413a93-51e2-43f6-bd4d-1143c8ac7846 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:34.017673 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:34.038167 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee01be-daf2-4bcc-b935-e9a12557b5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:34.039097 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee01be-daf2-4bcc-b935-e9a12557b5a6 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:34.039506 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee01be-daf2-4bcc-b935-e9a12557b5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:34.039875 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee01be-daf2-4bcc-b935-e9a12557b5a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:34.046561 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:34.047056 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee01be-daf2-4bcc-b935-e9a12557b5a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:34.048695 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee01be-daf2-4bcc-b935-e9a12557b5a6 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:34.053914 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0009870-5384-4fd2-bbfa-474bc02924d3 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:34.062832 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-07ee01be-daf2-4bcc-b935-e9a12557b5a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:34.062832 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:34.062832 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:34.062832 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:34.062832 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:34.062832 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:34.062832 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:34.062832 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:34.062832 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:34.062832 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:34.062832 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:34.062832 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:34.062832 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:43:34.062832 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:43:34.062832 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:43:34.063948 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:43:34.063948 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:34.063948 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:34.063948 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:34.063948 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:34.063948 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:34.063948 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:34.063948 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:34.063948 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:34.063948 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:34.063948 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:34.063948 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:34.063948 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:34.063948 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:34.063948 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:34.063948 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:34.063948 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:34.065057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:43:34.065057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:43:34.065057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:43:34.065057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:43:34.065057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:43:34.065057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:43:34.065057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:34.065057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:34.065966 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 292/586] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:43:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:34.066644 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee01be-daf2-4bcc-b935-e9a12557b5a6 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:34.095504 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ca139-708d-4feb-ac73-e1fb45b7f85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:34.096165 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ca139-708d-4feb-ac73-e1fb45b7f85c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:34.096449 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ca139-708d-4feb-ac73-e1fb45b7f85c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:34.096723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ca139-708d-4feb-ac73-e1fb45b7f85c None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:34.097440 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ca139-708d-4feb-ac73-e1fb45b7f85c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:34.097744 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ca139-708d-4feb-ac73-e1fb45b7f85c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:34.099424 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ca139-708d-4feb-ac73-e1fb45b7f85c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:34.112170 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 295/587] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:34.112961 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ca139-708d-4feb-ac73-e1fb45b7f85c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:34.184826 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee01be-daf2-4bcc-b935-e9a12557b5a6 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:34.215752 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ca139-708d-4feb-ac73-e1fb45b7f85c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:34.218038 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a534a-2d94-446e-9cdb-5255e2e9a6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:34.218838 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a534a-2d94-446e-9cdb-5255e2e9a6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:34.219114 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a534a-2d94-446e-9cdb-5255e2e9a6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:34.219414 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a534a-2d94-446e-9cdb-5255e2e9a6f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:34.230523 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646a534a-2d94-446e-9cdb-5255e2e9a6f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:34.232005 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646a534a-2d94-446e-9cdb-5255e2e9a6f1 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:34.249421 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-646a534a-2d94-446e-9cdb-5255e2e9a6f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:34.249421 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:34.249421 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:34.249421 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:34.249421 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:34.249421 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:34.249421 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:34.249421 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:34.249421 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:34.249421 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:34.249421 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:34.249421 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:34.249421 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:34.249421 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:34.249421 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:34.250357 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:34.250357 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:34.250357 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:34.250357 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:34.250357 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:34.250357 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:34.250357 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:34.250357 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:34.250357 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:34.250357 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:34.250357 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:34.250357 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:34.250357 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:34.250357 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:34.250357 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:34.250357 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:34.250357 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:34.251740 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:34.251740 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:34.251740 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:34.251740 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:34.251962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df96c55-1f57-4539-ae04-07e0d132837b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:34.251962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df96c55-1f57-4539-ae04-07e0d132837b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:34.251962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df96c55-1f57-4539-ae04-07e0d132837b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:34.251962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df96c55-1f57-4539-ae04-07e0d132837b None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:34.252231 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df96c55-1f57-4539-ae04-07e0d132837b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:34.252231 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df96c55-1f57-4539-ae04-07e0d132837b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:34.253837 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df96c55-1f57-4539-ae04-07e0d132837b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:34.255489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 293/588] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:34.256463 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a534a-2d94-446e-9cdb-5255e2e9a6f1 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:34.276524 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 296/589] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Jul 4 05:43:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:34.276524 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df96c55-1f57-4539-ae04-07e0d132837b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:34.289549 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:34.293221 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:34.366696 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a534a-2d94-446e-9cdb-5255e2e9a6f1 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:34.376823 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df96c55-1f57-4539-ae04-07e0d132837b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:34.405962 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e76473-3e55-4c66-8352-6e1d755dbbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:34.406641 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e76473-3e55-4c66-8352-6e1d755dbbad None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:34.406920 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e76473-3e55-4c66-8352-6e1d755dbbad None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:34.407207 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e76473-3e55-4c66-8352-6e1d755dbbad None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:34.408018 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e76473-3e55-4c66-8352-6e1d755dbbad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:34.408328 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e76473-3e55-4c66-8352-6e1d755dbbad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:34.409768 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e76473-3e55-4c66-8352-6e1d755dbbad None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:34.411505 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7c793-e989-4a26-8aa7-0dfa6306958d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:34.412658 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7c793-e989-4a26-8aa7-0dfa6306958d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:34.412947 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7c793-e989-4a26-8aa7-0dfa6306958d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:34.413224 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7c793-e989-4a26-8aa7-0dfa6306958d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:34.421530 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7c793-e989-4a26-8aa7-0dfa6306958d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:34.427128 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 294/590] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:43:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:34.427293 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7c793-e989-4a26-8aa7-0dfa6306958d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:34.427376 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e76473-3e55-4c66-8352-6e1d755dbbad None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:34.443631 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-72b7c793-e989-4a26-8aa7-0dfa6306958d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 04 05:43:34.443631 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:34.443631 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:34.443631 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:34.443631 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:34.443631 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:34.443631 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:34.443631 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:34.443631 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:34.443631 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:34.443631 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:34.443631 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:34.443631 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:43:34.443631 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:43:34.443631 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:43:34.443631 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:43:34.444606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:34.444606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:34.444606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:43:34.444606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:34.444606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:43:34.444606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:34.444606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:34.444606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:34.444606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:34.444606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:34.444606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:34.444606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:34.444606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:34.444606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:34.444606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:34.444606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:34.444606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:34.444606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:34.445520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:34.445520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:34.445520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:43:34.445520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:43:34.445520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:43:34.445520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:43:34.445520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:43:34.445520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:43:34.445520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 04 05:43:34.445520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:34.445520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 297/591] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 4 05:43:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:34.446095 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7c793-e989-4a26-8aa7-0dfa6306958d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:34.521077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:34.526544 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:34.549052 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e76473-3e55-4c66-8352-6e1d755dbbad None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:34.554266 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7c793-e989-4a26-8aa7-0dfa6306958d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:34.587331 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77fa11-4ef3-4d87-9049-f81a233b8d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:34.588271 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77fa11-4ef3-4d87-9049-f81a233b8d7b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:34.588549 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77fa11-4ef3-4d87-9049-f81a233b8d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:34.588844 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77fa11-4ef3-4d87-9049-f81a233b8d7b None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:34.589601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77fa11-4ef3-4d87-9049-f81a233b8d7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:34.589906 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77fa11-4ef3-4d87-9049-f81a233b8d7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:34.591307 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77fa11-4ef3-4d87-9049-f81a233b8d7b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:34.591685 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909de6d-c31e-474e-a351-d14845000c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:34.592476 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909de6d-c31e-474e-a351-d14845000c50 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:34.592757 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909de6d-c31e-474e-a351-d14845000c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:34.593033 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909de6d-c31e-474e-a351-d14845000c50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:34.603074 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909de6d-c31e-474e-a351-d14845000c50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:34.608773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909de6d-c31e-474e-a351-d14845000c50 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:34.608911 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 295/592] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:34.608911 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77fa11-4ef3-4d87-9049-f81a233b8d7b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:34.622826 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-8909de6d-c31e-474e-a351-d14845000c50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:34.622826 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:34.622826 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:34.622826 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:34.622826 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:34.622826 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:34.622826 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:34.622826 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:34.622826 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:34.622826 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:34.622826 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:34.622826 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:34.622826 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:34.622826 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:34.622826 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:34.623771 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:34.623771 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:34.623771 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:34.623771 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:34.623771 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:34.623771 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:34.623771 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:34.623771 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:34.623771 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:34.623771 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:34.623771 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:34.623771 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:34.623771 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:34.623771 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:34.623771 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:34.623771 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:34.623771 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:34.624653 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:34.624653 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:34.624653 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:34.624653 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:34.627597 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 298/593] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:34.628896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909de6d-c31e-474e-a351-d14845000c50 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:34.715980 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77fa11-4ef3-4d87-9049-f81a233b8d7b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:34.734724 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909de6d-c31e-474e-a351-d14845000c50 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:34.750280 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8d404-9286-4305-93bc-8eb0c5e1b773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:34.751200 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8d404-9286-4305-93bc-8eb0c5e1b773 None admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:34.751498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8d404-9286-4305-93bc-8eb0c5e1b773 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:34.751778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8d404-9286-4305-93bc-8eb0c5e1b773 None admin] PATH_INFO: `/v3/projects/4bc610fb6724419dac99f2483089c783/users/6f638cc70c994a529a48cb2c92b70384/roles/d775f350758d4eb8bfceeeb91e54351f` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:34.760696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:34.767616 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8d404-9286-4305-93bc-8eb0c5e1b773 None admin] RBAC: Authorizing `identity:create_grant(project_id=4bc610fb6724419dac99f2483089c783, user_id=6f638cc70c994a529a48cb2c92b70384, role_id=d775f350758d4eb8bfceeeb91e54351f)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:34.769095 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8d404-9286-4305-93bc-8eb0c5e1b773 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:34.773520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec289d14-3006-4689-8dac-b86985616140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:34.774270 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec289d14-3006-4689-8dac-b86985616140 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:34.774576 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec289d14-3006-4689-8dac-b86985616140 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:34.774910 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec289d14-3006-4689-8dac-b86985616140 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:34.775818 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec289d14-3006-4689-8dac-b86985616140 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:34.776216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec289d14-3006-4689-8dac-b86985616140 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:34.777315 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:34.778511 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec289d14-3006-4689-8dac-b86985616140 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:34.782738 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 296/594] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 4 05:43:34 2022] PUT /identity/v3/projects/4bc610fb6724419dac99f2483089c783/users/6f638cc70c994a529a48cb2c92b70384/roles/d775f350758d4eb8bfceeeb91e54351f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:43:34.788587 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8d404-9286-4305-93bc-8eb0c5e1b773 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:34.800207 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 299/595] 10.222.0.16 () {56 vars in 1139 bytes} [Mon Jul 4 05:43:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:34.800207 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec289d14-3006-4689-8dac-b86985616140 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:34.911549 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8d404-9286-4305-93bc-8eb0c5e1b773 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:34.927010 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec289d14-3006-4689-8dac-b86985616140 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:34.955575 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d6aa5-bd3c-4e21-9150-e906d7b295e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:34.956387 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d6aa5-bd3c-4e21-9150-e906d7b295e4 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:34.956661 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d6aa5-bd3c-4e21-9150-e906d7b295e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:34.956931 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d6aa5-bd3c-4e21-9150-e906d7b295e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:34.964132 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d6aa5-bd3c-4e21-9150-e906d7b295e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:34.965665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d6aa5-bd3c-4e21-9150-e906d7b295e4 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:34.969515 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff5bb2-f365-48a9-a269-bcb839254a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:34.970184 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff5bb2-f365-48a9-a269-bcb839254a23 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:34.970472 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff5bb2-f365-48a9-a269-bcb839254a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:34.970749 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff5bb2-f365-48a9-a269-bcb839254a23 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:34.971569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff5bb2-f365-48a9-a269-bcb839254a23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:34.971865 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff5bb2-f365-48a9-a269-bcb839254a23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:34.973239 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff5bb2-f365-48a9-a269-bcb839254a23 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:34.980086 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-e48d6aa5-bd3c-4e21-9150-e906d7b295e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:34.980086 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:34.980086 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:34.980086 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:34.980086 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:34.980086 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:34.980086 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:34.980086 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:34.980086 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:34.980086 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:34.980086 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:34.980086 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:34.980086 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:43:34.980086 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:43:34.980086 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:43:34.981249 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:43:34.981249 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:34.981249 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:34.981249 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:34.981249 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:34.981249 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:34.981249 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:34.981249 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:34.981249 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:34.981249 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:34.981249 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:34.981249 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:34.981249 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:34.981249 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:34.981249 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:34.981249 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:34.981249 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:34.982327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:43:34.982327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:43:34.982327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:43:34.982327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:43:34.982327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:43:34.982327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:43:34.982327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:34.982327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:34.982327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 297/596] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:43:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:34.982811 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d6aa5-bd3c-4e21-9150-e906d7b295e4 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:34.989450 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 300/597] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:34.990976 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ef6a1-22ba-4af4-ab00-3c56d8e34ecc None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:34.991549 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ef6a1-22ba-4af4-ab00-3c56d8e34ecc None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:34.991980 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ef6a1-22ba-4af4-ab00-3c56d8e34ecc None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:34.993625 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 301/598] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:34.994608 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ef6a1-22ba-4af4-ab00-3c56d8e34ecc None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:35.044160 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:35.048095 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:35.093483 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d6aa5-bd3c-4e21-9150-e906d7b295e4 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:35.104500 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ef6a1-22ba-4af4-ab00-3c56d8e34ecc None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:35.128735 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc9112-4314-4a48-bc3b-91798a9c20c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:35.129535 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc9112-4314-4a48-bc3b-91798a9c20c9 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:35.129817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc9112-4314-4a48-bc3b-91798a9c20c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:35.130090 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc9112-4314-4a48-bc3b-91798a9c20c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:35.140359 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503951a-3408-481b-a3e1-e4689466b036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:35.141130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503951a-3408-481b-a3e1-e4689466b036 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:35.141410 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503951a-3408-481b-a3e1-e4689466b036 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:35.141677 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503951a-3408-481b-a3e1-e4689466b036 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:35.142469 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503951a-3408-481b-a3e1-e4689466b036 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:35.142869 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503951a-3408-481b-a3e1-e4689466b036 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:35.144241 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503951a-3408-481b-a3e1-e4689466b036 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:35.147130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc9112-4314-4a48-bc3b-91798a9c20c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:35.149327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc9112-4314-4a48-bc3b-91798a9c20c9 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:35.164503 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 302/599] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:43:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:35.164503 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503951a-3408-481b-a3e1-e4689466b036 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:35.175327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-d8bc9112-4314-4a48-bc3b-91798a9c20c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:35.175327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:35.175327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:35.175327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:35.175327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:35.175327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:35.175327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:35.175327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:35.175327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:35.175327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:35.175327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:35.175327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:35.175327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:35.175327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:35.175327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:35.176383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:35.176383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:35.176383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:35.176383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:35.176383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:35.176383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:35.176383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:35.176383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:35.176383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:35.176383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:35.176383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:35.176383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:35.176383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:35.176383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:35.176383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:35.176383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:35.176383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:35.182088 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:35.182088 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:35.182088 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:35.182088 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:35.182088 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 298/600] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:35.182088 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83015a-d6b3-4a00-953b-dd8915edf9a0 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:35.182088 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83015a-d6b3-4a00-953b-dd8915edf9a0 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:35.182088 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83015a-d6b3-4a00-953b-dd8915edf9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:35.195820 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-0d83015a-d6b3-4a00-953b-dd8915edf9a0 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:35.197000 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-0d83015a-d6b3-4a00-953b-dd8915edf9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:35.270017 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 299/601] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:35.270949 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83015a-d6b3-4a00-953b-dd8915edf9a0 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:35.277961 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503951a-3408-481b-a3e1-e4689466b036 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:35.280169 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:35.316170 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:35.317692 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa6285-b37a-47b4-8eb4-3d033a57432f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:35.318500 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa6285-b37a-47b4-8eb4-3d033a57432f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:35.318777 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa6285-b37a-47b4-8eb4-3d033a57432f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:35.319099 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa6285-b37a-47b4-8eb4-3d033a57432f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:35.326562 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa6285-b37a-47b4-8eb4-3d033a57432f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:35.328036 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa6285-b37a-47b4-8eb4-3d033a57432f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:35.341815 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-d1fa6285-b37a-47b4-8eb4-3d033a57432f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:35.341815 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:35.341815 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:35.341815 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:35.341815 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:35.341815 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:35.341815 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:35.341815 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:35.341815 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:35.341815 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:35.341815 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:35.341815 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:35.341815 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:43:35.341815 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:43:35.341815 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:43:35.342891 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:43:35.342891 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:35.342891 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:35.342891 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:35.342891 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:35.342891 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:35.342891 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:35.342891 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:35.342891 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:35.342891 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:35.342891 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:35.342891 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:35.342891 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:35.342891 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:35.342891 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:35.342891 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:35.342891 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:35.344235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:43:35.344235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:43:35.344235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:43:35.344235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:43:35.344235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:43:35.344235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:43:35.344235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:35.344235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:35.344235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 303/602] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:43:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:35.344235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa6285-b37a-47b4-8eb4-3d033a57432f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:35.383739 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83015a-d6b3-4a00-953b-dd8915edf9a0 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:35.419932 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11c3e3-d275-4418-9546-f59e19ee779d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:35.420828 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11c3e3-d275-4418-9546-f59e19ee779d None admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:35.421109 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11c3e3-d275-4418-9546-f59e19ee779d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:35.421384 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11c3e3-d275-4418-9546-f59e19ee779d None admin] PATH_INFO: `/v3/projects/4bc610fb6724419dac99f2483089c783/users/8103fdfbdcf449a49e770750876bbee3/roles/d775f350758d4eb8bfceeeb91e54351f` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:35.437720 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11c3e3-d275-4418-9546-f59e19ee779d None admin] RBAC: Authorizing `identity:create_grant(project_id=4bc610fb6724419dac99f2483089c783, user_id=8103fdfbdcf449a49e770750876bbee3, role_id=d775f350758d4eb8bfceeeb91e54351f)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:35.439174 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11c3e3-d275-4418-9546-f59e19ee779d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:35.445558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa6285-b37a-47b4-8eb4-3d033a57432f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:35.457020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 300/603] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 4 05:43:35 2022] PUT /identity/v3/projects/4bc610fb6724419dac99f2483089c783/users/8103fdfbdcf449a49e770750876bbee3/roles/d775f350758d4eb8bfceeeb91e54351f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:43:35.468550 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11c3e3-d275-4418-9546-f59e19ee779d None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:35.483937 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78aec9e-1b0e-4209-b7fa-5a643afb5a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:35.485153 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78aec9e-1b0e-4209-b7fa-5a643afb5a33 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:35.485436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78aec9e-1b0e-4209-b7fa-5a643afb5a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:35.485803 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78aec9e-1b0e-4209-b7fa-5a643afb5a33 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:35.486692 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78aec9e-1b0e-4209-b7fa-5a643afb5a33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:35.487105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78aec9e-1b0e-4209-b7fa-5a643afb5a33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:35.488798 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78aec9e-1b0e-4209-b7fa-5a643afb5a33 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:35.508443 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 304/604] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:35.509706 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78aec9e-1b0e-4209-b7fa-5a643afb5a33 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:35.550955 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:35.606654 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:35.619571 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11c3e3-d275-4418-9546-f59e19ee779d None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:35.657327 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78aec9e-1b0e-4209-b7fa-5a643afb5a33 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:35.661293 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce64de0-d9b0-4634-90ed-76cecc7b24a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:35.662109 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce64de0-d9b0-4634-90ed-76cecc7b24a6 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:35.662388 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce64de0-d9b0-4634-90ed-76cecc7b24a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:35.662658 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce64de0-d9b0-4634-90ed-76cecc7b24a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:35.674672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce64de0-d9b0-4634-90ed-76cecc7b24a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:35.684603 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-fce64de0-d9b0-4634-90ed-76cecc7b24a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:43:35.684603 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:35.684603 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:35.684603 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:35.684603 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:35.684603 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:35.684603 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:35.684603 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:35.684603 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:35.684603 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:35.684603 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:35.684603 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:35.684603 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:35.684603 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:35.684603 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:35.684603 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:35.685719 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:35.685719 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:35.685719 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:35.685719 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:35.685719 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:35.685719 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:35.685719 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:35.685719 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:35.685719 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:35.685719 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:35.685719 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:35.685719 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:35.685719 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:35.685719 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:35.685719 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:35.685719 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:35.686817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:35.686817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:35.686817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:35.686817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:35.686817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:35.686817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:35.686817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:35.686817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:35.686817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:35.686817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:35.686817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:43:35.686817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:35.686817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 301/605] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 4 05:43:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:35.687671 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce64de0-d9b0-4634-90ed-76cecc7b24a6 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:35.700519 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b55ba-bf5b-4c64-881a-9a401cc7adf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:35.701374 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b55ba-bf5b-4c64-881a-9a401cc7adf8 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:35.702065 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b55ba-bf5b-4c64-881a-9a401cc7adf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:35.702345 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b55ba-bf5b-4c64-881a-9a401cc7adf8 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:35.703441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b55ba-bf5b-4c64-881a-9a401cc7adf8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:35.703758 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b55ba-bf5b-4c64-881a-9a401cc7adf8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:35.705931 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b55ba-bf5b-4c64-881a-9a401cc7adf8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:35.721629 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 305/606] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:43:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:35.723871 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b55ba-bf5b-4c64-881a-9a401cc7adf8 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:35.812406 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:35.814598 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce64de0-d9b0-4634-90ed-76cecc7b24a6 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:35.832261 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b55ba-bf5b-4c64-881a-9a401cc7adf8 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:35.849952 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfaa75-2f25-404a-a44d-3fe81a82e445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:35.850929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfaa75-2f25-404a-a44d-3fe81a82e445 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:35.851340 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfaa75-2f25-404a-a44d-3fe81a82e445 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:35.851713 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfaa75-2f25-404a-a44d-3fe81a82e445 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:35.864990 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bfaa75-2f25-404a-a44d-3fe81a82e445 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:35.866486 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bfaa75-2f25-404a-a44d-3fe81a82e445 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:35.867033 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13134af-3fa6-4a3d-895e-ee3af53fae7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:35.867921 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13134af-3fa6-4a3d-895e-ee3af53fae7b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:35.868356 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13134af-3fa6-4a3d-895e-ee3af53fae7b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:35.868771 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13134af-3fa6-4a3d-895e-ee3af53fae7b None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:35.869644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13134af-3fa6-4a3d-895e-ee3af53fae7b None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:35.870117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13134af-3fa6-4a3d-895e-ee3af53fae7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:35.871663 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13134af-3fa6-4a3d-895e-ee3af53fae7b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:35.880743 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 306/607] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 4 05:43:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:35.881754 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13134af-3fa6-4a3d-895e-ee3af53fae7b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:35.882861 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-68bfaa75-2f25-404a-a44d-3fe81a82e445 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:35.882861 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:35.882861 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:35.882861 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:35.882861 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:35.882861 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:35.882861 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:35.882861 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:35.882861 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:35.882861 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:35.882861 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:35.882861 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:35.882861 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:43:35.882861 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:43:35.882861 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:43:35.883917 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:43:35.883917 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:35.883917 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:35.883917 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:35.883917 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:35.883917 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:35.883917 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:35.883917 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:35.883917 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:35.883917 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:35.883917 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:35.883917 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:35.883917 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:35.883917 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:35.883917 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:35.883917 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:35.883917 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:35.884981 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:43:35.884981 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:43:35.884981 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:43:35.884981 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:43:35.884981 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:43:35.884981 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:43:35.884981 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:35.884981 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:35.884981 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 302/608] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:43:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:35.886277 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfaa75-2f25-404a-a44d-3fe81a82e445 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:35.902486 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:36.003381 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfaa75-2f25-404a-a44d-3fe81a82e445 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:36.005046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13134af-3fa6-4a3d-895e-ee3af53fae7b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:36.042294 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3b756-201c-43b1-ab06-8905d7623ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:36.043248 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3b756-201c-43b1-ab06-8905d7623ffe None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:36.043536 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3b756-201c-43b1-ab06-8905d7623ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:36.043809 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3b756-201c-43b1-ab06-8905d7623ffe None admin] PATH_INFO: `/v3/projects/4bc610fb6724419dac99f2483089c783/users/77f0477631724d7f9c8ba752ba27866d/roles/d775f350758d4eb8bfceeeb91e54351f` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:36.049086 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2665d-314b-4422-a802-24b6aca4e9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:36.049895 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2665d-314b-4422-a802-24b6aca4e9be None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:36.050175 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2665d-314b-4422-a802-24b6aca4e9be None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:36.050447 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2665d-314b-4422-a802-24b6aca4e9be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:36.059031 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3b756-201c-43b1-ab06-8905d7623ffe None admin] RBAC: Authorizing `identity:create_grant(project_id=4bc610fb6724419dac99f2483089c783, user_id=77f0477631724d7f9c8ba752ba27866d, role_id=d775f350758d4eb8bfceeeb91e54351f)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:36.060704 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3b756-201c-43b1-ab06-8905d7623ffe None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:36.062985 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:36.063319 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2665d-314b-4422-a802-24b6aca4e9be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:36.066109 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2665d-314b-4422-a802-24b6aca4e9be None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:36.083441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 307/609] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 4 05:43:35 2022] PUT /identity/v3/projects/4bc610fb6724419dac99f2483089c783/users/77f0477631724d7f9c8ba752ba27866d/roles/d775f350758d4eb8bfceeeb91e54351f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:43:36.084852 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3b756-201c-43b1-ab06-8905d7623ffe None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:36.087103 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-b8c2665d-314b-4422-a802-24b6aca4e9be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:36.087103 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:36.087103 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:36.087103 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:36.087103 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:36.087103 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:36.087103 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:36.087103 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:36.087103 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:36.087103 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:36.087103 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:36.087103 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:36.087103 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:36.087103 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:36.087103 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:36.088137 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:36.088137 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:36.088137 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:36.088137 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:36.088137 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:36.088137 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:36.088137 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:36.088137 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:36.088137 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:36.088137 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:36.088137 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:36.088137 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:36.088137 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:36.088137 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:36.088137 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:36.088137 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:36.088137 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:36.089269 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:36.089269 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:36.089269 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:36.089269 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:36.093377 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 303/610] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:36.095286 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2665d-314b-4422-a802-24b6aca4e9be None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:36.177243 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:36.239682 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2665d-314b-4422-a802-24b6aca4e9be None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:36.308869 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3b756-201c-43b1-ab06-8905d7623ffe None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:36.321264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f28279-20a2-4685-9459-14507b9cc238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:36.321947 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f28279-20a2-4685-9459-14507b9cc238 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:36.322230 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f28279-20a2-4685-9459-14507b9cc238 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:36.322505 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f28279-20a2-4685-9459-14507b9cc238 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:36.323307 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f28279-20a2-4685-9459-14507b9cc238 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:36.323617 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f28279-20a2-4685-9459-14507b9cc238 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:36.325016 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f28279-20a2-4685-9459-14507b9cc238 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:36.343495 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 304/611] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:43:36.346712 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f28279-20a2-4685-9459-14507b9cc238 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:36.355024 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783951b-7bcc-44b7-8968-722c5496ec27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:36.355723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783951b-7bcc-44b7-8968-722c5496ec27 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:36.356007 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783951b-7bcc-44b7-8968-722c5496ec27 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:36.356282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783951b-7bcc-44b7-8968-722c5496ec27 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:36.357106 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783951b-7bcc-44b7-8968-722c5496ec27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:36.357649 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783951b-7bcc-44b7-8968-722c5496ec27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:36.358836 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783951b-7bcc-44b7-8968-722c5496ec27 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:36.371071 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 308/612] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:43:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:36.377615 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783951b-7bcc-44b7-8968-722c5496ec27 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:36.437294 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:36.477345 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f28279-20a2-4685-9459-14507b9cc238 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:36.504528 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:36.505404 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783951b-7bcc-44b7-8968-722c5496ec27 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:36.523527 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e05e13-21cd-40db-bdb8-cefaf94db679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:36.524585 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e05e13-21cd-40db-bdb8-cefaf94db679 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:36.526045 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e05e13-21cd-40db-bdb8-cefaf94db679 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:36.527873 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e05e13-21cd-40db-bdb8-cefaf94db679 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:36.544708 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e05e13-21cd-40db-bdb8-cefaf94db679 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:36.546364 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e05e13-21cd-40db-bdb8-cefaf94db679 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:36.571149 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-55e05e13-21cd-40db-bdb8-cefaf94db679 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 04 05:43:36.571149 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:36.571149 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:36.571149 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:36.571149 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:36.571149 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:36.571149 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:36.571149 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:36.571149 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:36.571149 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:36.571149 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:36.571149 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:36.571149 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:43:36.571149 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:43:36.571149 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:43:36.571149 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:43:36.572347 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:36.572347 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:36.572347 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:43:36.572347 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:36.572347 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:43:36.572347 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:36.572347 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:36.572347 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:36.572347 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:36.572347 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:36.572347 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:36.572347 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:36.572347 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:36.572347 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:36.572347 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:36.572347 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:36.572347 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:36.572347 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:36.573655 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:36.573655 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:36.573655 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:43:36.573655 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:43:36.573655 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:43:36.573655 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:43:36.573655 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:43:36.573655 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:43:36.573655 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 04 05:43:36.573655 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:36.574300 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe42d1-1e80-4c76-ae3f-30f381583666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:36.574300 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe42d1-1e80-4c76-ae3f-30f381583666 None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:36.574300 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe42d1-1e80-4c76-ae3f-30f381583666 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:36.574300 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe42d1-1e80-4c76-ae3f-30f381583666 None admin] PATH_INFO: `/v3/projects/4bc610fb6724419dac99f2483089c783/users/5e5be3de52e945d3af1b2cad1c84c755/roles/d775f350758d4eb8bfceeeb91e54351f` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:36.577023 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 305/613] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:43:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:36.589017 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e05e13-21cd-40db-bdb8-cefaf94db679 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:36.599231 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe42d1-1e80-4c76-ae3f-30f381583666 None admin] RBAC: Authorizing `identity:create_grant(project_id=4bc610fb6724419dac99f2483089c783, user_id=5e5be3de52e945d3af1b2cad1c84c755, role_id=d775f350758d4eb8bfceeeb91e54351f)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:36.599231 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe42d1-1e80-4c76-ae3f-30f381583666 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:36.614792 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 309/614] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 4 05:43:36 2022] PUT /identity/v3/projects/4bc610fb6724419dac99f2483089c783/users/5e5be3de52e945d3af1b2cad1c84c755/roles/d775f350758d4eb8bfceeeb91e54351f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:43:36.745974 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e05e13-21cd-40db-bdb8-cefaf94db679 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:36.788969 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf1b7a-3e40-4cc4-ad64-7288f5bac9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:36.789655 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf1b7a-3e40-4cc4-ad64-7288f5bac9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:36.790015 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf1b7a-3e40-4cc4-ad64-7288f5bac9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:36.790212 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf1b7a-3e40-4cc4-ad64-7288f5bac9f9 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:36.791061 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf1b7a-3e40-4cc4-ad64-7288f5bac9f9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:36.791390 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf1b7a-3e40-4cc4-ad64-7288f5bac9f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:36.793332 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf1b7a-3e40-4cc4-ad64-7288f5bac9f9 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:36.823423 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 306/615] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Jul 4 05:43:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:36.828962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe42d1-1e80-4c76-ae3f-30f381583666 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:36.946787 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe42d1-1e80-4c76-ae3f-30f381583666 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:36.949800 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:36.985252 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf80c33-425f-42c1-8593-4374cb024d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:36.986390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf80c33-425f-42c1-8593-4374cb024d13 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:36.987841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf80c33-425f-42c1-8593-4374cb024d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:36.988260 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf80c33-425f-42c1-8593-4374cb024d13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:37.001815 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf80c33-425f-42c1-8593-4374cb024d13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:37.003511 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf80c33-425f-42c1-8593-4374cb024d13 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:37.021398 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-cbf80c33-425f-42c1-8593-4374cb024d13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:37.021398 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:37.021398 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:37.021398 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:37.021398 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:37.021398 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:37.021398 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:37.021398 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:37.021398 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:37.021398 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:37.021398 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:37.021398 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:37.021398 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:37.021398 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:37.021398 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:37.022470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:37.022470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:37.022470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:37.022470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:37.022470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:37.022470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:37.022470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:37.022470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:37.022470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:37.022470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:37.022470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:37.022470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:37.022470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:37.022470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:37.022470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:37.022470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:37.022470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:37.023589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:37.023589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:37.023589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:37.023589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:37.025439 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 310/616] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:37.031083 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf1b7a-3e40-4cc4-ad64-7288f5bac9f9 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:37.037452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ad6b8-4e67-447d-bb38-6f0ebbceeb33 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:37.038105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ad6b8-4e67-447d-bb38-6f0ebbceeb33 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:37.038387 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ad6b8-4e67-447d-bb38-6f0ebbceeb33 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:37.040967 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 311/617] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:43:37.048399 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbb3ef-6aeb-45b6-8511-334ab1efc0e4 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:37.048680 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbb3ef-6aeb-45b6-8511-334ab1efc0e4 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:37.048971 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbb3ef-6aeb-45b6-8511-334ab1efc0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:37.081801 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-50dbb3ef-6aeb-45b6-8511-334ab1efc0e4 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:37.086200 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-50dbb3ef-6aeb-45b6-8511-334ab1efc0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:37.111839 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:37.211590 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 312/618] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 05:43:37.232296 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf1b7a-3e40-4cc4-ad64-7288f5bac9f9 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:37.264081 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dbb3ef-6aeb-45b6-8511-334ab1efc0e4 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:37.293676 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31c80a-46b7-40be-aa1b-9abbdcbe3cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:37.294779 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31c80a-46b7-40be-aa1b-9abbdcbe3cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:37.295409 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31c80a-46b7-40be-aa1b-9abbdcbe3cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:37.295889 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31c80a-46b7-40be-aa1b-9abbdcbe3cc5 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:37.296997 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd31c80a-46b7-40be-aa1b-9abbdcbe3cc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:37.297502 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd31c80a-46b7-40be-aa1b-9abbdcbe3cc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:37.300608 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd31c80a-46b7-40be-aa1b-9abbdcbe3cc5 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:37.330413 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 307/619] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:37.335755 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31c80a-46b7-40be-aa1b-9abbdcbe3cc5 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:37.356725 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:37.379230 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dbb3ef-6aeb-45b6-8511-334ab1efc0e4 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:37.415130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0bb19-60ac-4c74-9887-8b2dd4071a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:37.415130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0bb19-60ac-4c74-9887-8b2dd4071a79 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:37.415130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0bb19-60ac-4c74-9887-8b2dd4071a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:37.415130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0bb19-60ac-4c74-9887-8b2dd4071a79 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:37.419146 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0bb19-60ac-4c74-9887-8b2dd4071a79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:37.427141 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-0fc0bb19-60ac-4c74-9887-8b2dd4071a79 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:43:37.427141 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:37.427141 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:37.427141 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:37.427141 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:37.427141 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:37.427141 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:37.427141 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:37.427141 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:37.427141 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:37.427141 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:37.427141 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:37.427141 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:37.427141 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:37.427141 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:37.427141 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:37.428216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:37.428216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:37.428216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:37.428216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:37.428216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:37.428216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:37.428216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:37.428216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:37.428216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:37.428216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:37.428216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:37.428216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:37.428216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:37.428216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:37.428216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:37.428216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:37.429074 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:37.429074 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:37.429074 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:37.429074 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:37.429074 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:37.429074 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:37.429074 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:37.429074 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:37.429074 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:37.429074 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:37.429074 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:43:37.429074 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:37.429074 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 313/620] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 4 05:43:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:43:37.434411 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0bb19-60ac-4c74-9887-8b2dd4071a79 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:37.504811 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:37.510935 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31c80a-46b7-40be-aa1b-9abbdcbe3cc5 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:37.592949 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e19727-3083-4df6-82de-ef400a974819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:37.594233 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e19727-3083-4df6-82de-ef400a974819 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:37.594719 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e19727-3083-4df6-82de-ef400a974819 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:37.595315 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e19727-3083-4df6-82de-ef400a974819 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:37.607816 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e19727-3083-4df6-82de-ef400a974819 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:37.609564 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e19727-3083-4df6-82de-ef400a974819 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:37.615213 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0bb19-60ac-4c74-9887-8b2dd4071a79 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:37.643063 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-00e19727-3083-4df6-82de-ef400a974819 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:37.643063 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:37.643063 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:37.643063 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:37.643063 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:37.643063 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:37.643063 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:37.643063 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:37.643063 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:37.643063 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:37.643063 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:37.643063 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:37.643063 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:43:37.643063 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:43:37.643063 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:43:37.644050 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:43:37.644050 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:37.644050 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:37.644050 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:37.644050 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:37.644050 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:37.644050 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:37.644050 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:37.644050 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:37.644050 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:37.644050 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:37.644050 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:37.644050 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:37.644050 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:37.644050 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:37.644050 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:37.644050 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:37.644918 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:43:37.644918 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:43:37.644918 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:43:37.644918 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:43:37.644918 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:43:37.644918 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:43:37.644918 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:37.644918 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:37.645364 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a1fc0-a50f-48db-b227-e97396a64f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:37.645952 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a1fc0-a50f-48db-b227-e97396a64f90 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:37.645952 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a1fc0-a50f-48db-b227-e97396a64f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:37.646195 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a1fc0-a50f-48db-b227-e97396a64f90 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:37.646981 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a1fc0-a50f-48db-b227-e97396a64f90 None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:37.647329 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a1fc0-a50f-48db-b227-e97396a64f90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:37.648116 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 308/621] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:43:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:43:37.651225 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a1fc0-a50f-48db-b227-e97396a64f90 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:37.655560 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e19727-3083-4df6-82de-ef400a974819 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:37.657992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 314/622] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 4 05:43:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:37.663702 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a1fc0-a50f-48db-b227-e97396a64f90 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:37.697337 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:37.800327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e19727-3083-4df6-82de-ef400a974819 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:37.833129 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a1fc0-a50f-48db-b227-e97396a64f90 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:37.834906 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b875aaf5-02ed-4019-aaff-3fbefbdc4de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:37.835865 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875aaf5-02ed-4019-aaff-3fbefbdc4de0 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:37.836283 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875aaf5-02ed-4019-aaff-3fbefbdc4de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:37.836684 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875aaf5-02ed-4019-aaff-3fbefbdc4de0 None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:37.837650 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b875aaf5-02ed-4019-aaff-3fbefbdc4de0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:37.838116 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b875aaf5-02ed-4019-aaff-3fbefbdc4de0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:37.839823 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b875aaf5-02ed-4019-aaff-3fbefbdc4de0 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:37.853311 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 309/623] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:43:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:43:37.854793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549091f2-6d43-483a-ab74-09e16546fd99 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:37.855261 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549091f2-6d43-483a-ab74-09e16546fd99 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:37.855664 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549091f2-6d43-483a-ab74-09e16546fd99 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:37.857266 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 310/624] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:37.863207 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20032d7d-ed3d-4c1a-b8a7-72237041b150 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:37.863517 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20032d7d-ed3d-4c1a-b8a7-72237041b150 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:37.863630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20032d7d-ed3d-4c1a-b8a7-72237041b150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:37.874230 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c6412-16ca-442c-b3d8-877caf50bfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:37.875144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c6412-16ca-442c-b3d8-877caf50bfa5 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:37.875553 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c6412-16ca-442c-b3d8-877caf50bfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:37.875924 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c6412-16ca-442c-b3d8-877caf50bfa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:37.883203 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-20032d7d-ed3d-4c1a-b8a7-72237041b150 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:37.884438 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-20032d7d-ed3d-4c1a-b8a7-72237041b150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:37.887308 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c6412-16ca-442c-b3d8-877caf50bfa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:37.888881 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c6412-16ca-442c-b3d8-877caf50bfa5 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:37.901634 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:37.906791 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-4a7c6412-16ca-442c-b3d8-877caf50bfa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:37.906791 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:37.906791 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:37.906791 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:37.906791 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:37.906791 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:37.906791 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:37.906791 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:37.906791 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:37.906791 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:37.906791 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:37.906791 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:37.906791 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:37.906791 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:37.906791 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:37.907864 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:37.907864 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:37.907864 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:37.907864 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:37.907864 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:37.907864 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:37.907864 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:37.907864 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:37.907864 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:37.907864 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:37.907864 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:37.907864 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:37.907864 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:37.907864 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:37.907864 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:37.907864 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:37.907864 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:37.908753 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:37.908753 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:37.908753 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:37.908753 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:37.913472 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 315/625] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:37.914273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c6412-16ca-442c-b3d8-877caf50bfa5 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:37.980876 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 311/626] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:37.981779 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20032d7d-ed3d-4c1a-b8a7-72237041b150 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:37.992624 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:38.056696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c6412-16ca-442c-b3d8-877caf50bfa5 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:38.091808 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fd84a-37e9-4d16-bb31-9223e18ac63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:38.092702 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fd84a-37e9-4d16-bb31-9223e18ac63f None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:38.092981 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fd84a-37e9-4d16-bb31-9223e18ac63f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:38.093252 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fd84a-37e9-4d16-bb31-9223e18ac63f None admin] PATH_INFO: `/v3/projects/4bc610fb6724419dac99f2483089c783/users/e55a1c343c60428db2d9e5e6ed865e21/roles/d775f350758d4eb8bfceeeb91e54351f` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:38.108681 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090fd84a-37e9-4d16-bb31-9223e18ac63f None admin] RBAC: Authorizing `identity:create_grant(project_id=4bc610fb6724419dac99f2483089c783, user_id=e55a1c343c60428db2d9e5e6ed865e21, role_id=d775f350758d4eb8bfceeeb91e54351f)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:38.110722 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090fd84a-37e9-4d16-bb31-9223e18ac63f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:38.112849 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20032d7d-ed3d-4c1a-b8a7-72237041b150 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:38.131316 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 316/627] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 4 05:43:37 2022] PUT /identity/v3/projects/4bc610fb6724419dac99f2483089c783/users/e55a1c343c60428db2d9e5e6ed865e21/roles/d775f350758d4eb8bfceeeb91e54351f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:43:38.132555 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fd84a-37e9-4d16-bb31-9223e18ac63f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:38.186154 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c1424-1b5e-4c9a-a559-0bd5ee091891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:38.187730 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c1424-1b5e-4c9a-a559-0bd5ee091891 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:38.188920 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c1424-1b5e-4c9a-a559-0bd5ee091891 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:38.189413 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c1424-1b5e-4c9a-a559-0bd5ee091891 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:38.191664 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c1424-1b5e-4c9a-a559-0bd5ee091891 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:38.193641 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c1424-1b5e-4c9a-a559-0bd5ee091891 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:38.196421 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c1424-1b5e-4c9a-a559-0bd5ee091891 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:38.225636 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 312/628] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:38.230949 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c1424-1b5e-4c9a-a559-0bd5ee091891 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:38.255839 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:38.284712 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fd84a-37e9-4d16-bb31-9223e18ac63f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:38.297036 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:38.324397 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0180acb-624a-4354-936e-5717ba53a671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:38.325550 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0180acb-624a-4354-936e-5717ba53a671 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:38.326046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0180acb-624a-4354-936e-5717ba53a671 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:38.326544 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0180acb-624a-4354-936e-5717ba53a671 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:38.340684 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0180acb-624a-4354-936e-5717ba53a671 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:38.348589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-c0180acb-624a-4354-936e-5717ba53a671 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:43:38.348589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:38.348589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:38.348589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:38.348589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:38.348589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:38.348589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:38.348589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:38.348589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:38.348589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:38.348589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:38.348589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:38.348589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:38.348589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:38.348589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:38.348589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:38.349720 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:38.349720 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:38.349720 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:38.349720 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:38.349720 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:38.349720 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:38.349720 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:38.349720 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:38.349720 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:38.349720 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:38.349720 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:38.349720 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:38.349720 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:38.349720 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:38.349720 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:38.349720 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:38.350803 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:38.350803 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:38.350803 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:38.350803 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:38.350803 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:38.350803 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:38.350803 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:38.350803 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:38.350803 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:38.350803 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:38.350803 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:43:38.350803 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:38.356607 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 317/629] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 4 05:43:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:38.362325 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0180acb-624a-4354-936e-5717ba53a671 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:38.477307 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c1424-1b5e-4c9a-a559-0bd5ee091891 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:38.481243 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0180acb-624a-4354-936e-5717ba53a671 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:38.546395 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16375e0-0111-494a-90cd-047c93f2ff24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:38.548707 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16375e0-0111-494a-90cd-047c93f2ff24 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:38.549519 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a6ff0-c524-4908-b251-1f3663052640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:38.550397 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a6ff0-c524-4908-b251-1f3663052640 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:38.550890 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a6ff0-c524-4908-b251-1f3663052640 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:38.551384 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a6ff0-c524-4908-b251-1f3663052640 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:38.552347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a6ff0-c524-4908-b251-1f3663052640 None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:38.552819 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16375e0-0111-494a-90cd-047c93f2ff24 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:38.553283 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16375e0-0111-494a-90cd-047c93f2ff24 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:38.553775 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a6ff0-c524-4908-b251-1f3663052640 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:38.556002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a6ff0-c524-4908-b251-1f3663052640 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:38.570088 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16375e0-0111-494a-90cd-047c93f2ff24 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:38.573463 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16375e0-0111-494a-90cd-047c93f2ff24 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:38.574119 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 318/630] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 4 05:43:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:43:38.584251 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a6ff0-c524-4908-b251-1f3663052640 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:38.593242 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-e16375e0-0111-494a-90cd-047c93f2ff24 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 05:43:38.593242 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:38.593242 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:38.593242 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:38.593242 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:38.593242 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:38.593242 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:38.593242 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:38.593242 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:38.593242 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:38.593242 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:38.593242 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:38.593242 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:43:38.593242 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:43:38.593242 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:43:38.593242 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:43:38.594187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:38.594187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:38.594187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:43:38.594187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:38.594187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:43:38.594187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:38.594187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:38.594187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:38.594187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:38.594187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:38.594187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:38.594187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:38.594187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:38.594187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:38.594187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:38.594187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:38.594187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:38.594187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:38.595115 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:38.595115 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:38.595115 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:43:38.595115 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:43:38.595115 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:43:38.595115 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:43:38.595115 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:43:38.595115 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:43:38.595115 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 05:43:38.595115 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:38.595115 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 313/631] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jul 4 05:43:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:38.607233 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16375e0-0111-494a-90cd-047c93f2ff24 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:38.627627 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:38.676101 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:38.710852 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16375e0-0111-494a-90cd-047c93f2ff24 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:38.714831 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a6ff0-c524-4908-b251-1f3663052640 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:38.754626 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0475bc-162c-4d8a-93e8-630771299a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:38.755824 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0475bc-162c-4d8a-93e8-630771299a94 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:38.756383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0475bc-162c-4d8a-93e8-630771299a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:38.756887 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0475bc-162c-4d8a-93e8-630771299a94 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:38.757182 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5441ccd-5f3d-495a-a72b-3eeb0f6eecab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:38.757989 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5441ccd-5f3d-495a-a72b-3eeb0f6eecab None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:38.758272 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5441ccd-5f3d-495a-a72b-3eeb0f6eecab None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:38.758548 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5441ccd-5f3d-495a-a72b-3eeb0f6eecab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:38.758834 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0475bc-162c-4d8a-93e8-630771299a94 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:38.759364 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0475bc-162c-4d8a-93e8-630771299a94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:38.761731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0475bc-162c-4d8a-93e8-630771299a94 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:38.769195 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5441ccd-5f3d-495a-a72b-3eeb0f6eecab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:38.770646 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5441ccd-5f3d-495a-a72b-3eeb0f6eecab None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:38.784409 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 314/632] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jul 4 05:43:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:43:38.785962 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f976ef-0250-4694-b58d-49c4cb456ce3 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:38.786450 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f976ef-0250-4694-b58d-49c4cb456ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:38.786922 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f976ef-0250-4694-b58d-49c4cb456ce3 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:38.788609 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 315/633] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:38.793442 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f976ef-0250-4694-b58d-49c4cb456ce3 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:38.794626 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-c5441ccd-5f3d-495a-a72b-3eeb0f6eecab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:38.794626 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:38.794626 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:38.794626 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:38.794626 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:38.794626 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:38.794626 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:38.794626 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:38.794626 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:38.794626 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:38.794626 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:38.794626 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:38.794626 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:38.794626 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:38.794626 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:38.795509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:38.795509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:38.795509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:38.795509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:38.795509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:38.795509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:38.795509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:38.795509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:38.795509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:38.795509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:38.795509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:38.795509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:38.795509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:38.795509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:38.795509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:38.795509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:38.795509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:38.796427 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:38.796427 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:38.796427 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:38.796427 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:38.800384 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 319/634] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:38.801748 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afd4c9-f891-4d75-b54a-ed0c38db82e6 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:38.802038 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afd4c9-f891-4d75-b54a-ed0c38db82e6 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:38.802317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afd4c9-f891-4d75-b54a-ed0c38db82e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:38.821069 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-05afd4c9-f891-4d75-b54a-ed0c38db82e6 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:38.822535 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-05afd4c9-f891-4d75-b54a-ed0c38db82e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:38.899404 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 320/635] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:38.899404 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afd4c9-f891-4d75-b54a-ed0c38db82e6 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:38.908291 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:38.926241 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f976ef-0250-4694-b58d-49c4cb456ce3 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:38.956110 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:38.965767 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d7d84-9b17-4812-bc91-66503080b4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:38.966682 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d7d84-9b17-4812-bc91-66503080b4b2 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:38.967166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d7d84-9b17-4812-bc91-66503080b4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:38.967778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d7d84-9b17-4812-bc91-66503080b4b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:39.008976 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afd4c9-f891-4d75-b54a-ed0c38db82e6 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:39.041867 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d7d84-9b17-4812-bc91-66503080b4b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:39.043035 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f54788-d630-45d9-a7f1-1f0e40ac9c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:39.043797 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f54788-d630-45d9-a7f1-1f0e40ac9c01 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:39.044096 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d7d84-9b17-4812-bc91-66503080b4b2 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:39.044201 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f54788-d630-45d9-a7f1-1f0e40ac9c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:39.044478 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f54788-d630-45d9-a7f1-1f0e40ac9c01 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:39.045261 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f54788-d630-45d9-a7f1-1f0e40ac9c01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:39.045628 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f54788-d630-45d9-a7f1-1f0e40ac9c01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:39.047076 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f54788-d630-45d9-a7f1-1f0e40ac9c01 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:39.059159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 321/636] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:39.060216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f54788-d630-45d9-a7f1-1f0e40ac9c01 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:39.138019 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:39.154358 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 316/637] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:43:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 05:43:39.159670 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d7d84-9b17-4812-bc91-66503080b4b2 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:39.166085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f54788-d630-45d9-a7f1-1f0e40ac9c01 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:39.188900 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:39.203482 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7bb91-575f-4458-84fa-7bf76b17bd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:39.204291 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7bb91-575f-4458-84fa-7bf76b17bd42 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:39.204570 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7bb91-575f-4458-84fa-7bf76b17bd42 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:39.204840 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7bb91-575f-4458-84fa-7bf76b17bd42 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:39.215305 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac7bb91-575f-4458-84fa-7bf76b17bd42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:39.222957 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-8ac7bb91-575f-4458-84fa-7bf76b17bd42 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:43:39.222957 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:39.222957 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:39.222957 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:39.222957 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:39.222957 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:39.222957 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:39.222957 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:39.222957 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:39.222957 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:39.222957 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:39.222957 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:39.222957 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:39.222957 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:39.222957 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:39.222957 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:39.224216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:39.224216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:39.224216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:39.224216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:39.224216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:39.224216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:39.224216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:39.224216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:39.224216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:39.224216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:39.224216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:39.224216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:39.224216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:39.224216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:39.224216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:39.224216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:39.225174 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:39.225174 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:39.225174 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:39.225174 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:39.225174 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:39.225174 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:39.225174 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:39.225174 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:39.225174 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:39.225174 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:39.225174 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:43:39.225174 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:39.225174 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 322/638] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 4 05:43:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:39.229252 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745de70-9c46-42bb-bd10-81670467a4ba None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:39.229782 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745de70-9c46-42bb-bd10-81670467a4ba None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:39.229968 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745de70-9c46-42bb-bd10-81670467a4ba None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:39.231436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 323/639] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:39.231990 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745de70-9c46-42bb-bd10-81670467a4ba None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:39.284487 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d7d84-9b17-4812-bc91-66503080b4b2 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:39.320814 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df153209-786f-45fb-a7c7-e4dc23c8c9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:39.321617 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df153209-786f-45fb-a7c7-e4dc23c8c9c9 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:39.321898 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df153209-786f-45fb-a7c7-e4dc23c8c9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:39.322166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df153209-786f-45fb-a7c7-e4dc23c8c9c9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:39.330894 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df153209-786f-45fb-a7c7-e4dc23c8c9c9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:39.332361 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df153209-786f-45fb-a7c7-e4dc23c8c9c9 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:39.339645 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745de70-9c46-42bb-bd10-81670467a4ba None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:39.347627 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-df153209-786f-45fb-a7c7-e4dc23c8c9c9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 05:43:39.347627 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:39.347627 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:39.347627 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:39.347627 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:39.347627 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:39.347627 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:39.347627 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:39.347627 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:39.347627 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:39.347627 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:39.347627 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:39.347627 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:43:39.347627 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:43:39.347627 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:43:39.347627 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:43:39.348572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:39.348572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:39.348572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:43:39.348572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:39.348572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:43:39.348572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:39.348572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:39.348572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:39.348572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:39.348572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:39.348572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:39.348572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:39.348572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:39.348572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:39.348572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:39.348572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:39.348572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:39.348572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:39.349485 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:39.349485 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:39.349485 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:43:39.349485 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:43:39.349485 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:43:39.349485 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:43:39.349485 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:43:39.349485 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:43:39.349485 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 05:43:39.349485 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:39.349485 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 317/640] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:43:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:39.350743 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df153209-786f-45fb-a7c7-e4dc23c8c9c9 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:39.381960 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07a31e-16ec-4862-b331-bbe39f339412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:39.382763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07a31e-16ec-4862-b331-bbe39f339412 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:39.383046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07a31e-16ec-4862-b331-bbe39f339412 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:39.383364 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07a31e-16ec-4862-b331-bbe39f339412 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:39.385352 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:39.395373 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07a31e-16ec-4862-b331-bbe39f339412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:39.396847 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07a31e-16ec-4862-b331-bbe39f339412 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:39.414548 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-0a07a31e-16ec-4862-b331-bbe39f339412 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:39.414548 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:39.414548 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:39.414548 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:39.414548 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:39.414548 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:39.414548 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:39.414548 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:39.414548 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:39.414548 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:39.414548 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:39.414548 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:39.414548 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:39.414548 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:39.414548 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:39.415539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:39.415539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:39.415539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:39.415539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:39.415539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:39.415539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:39.415539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:39.415539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:39.415539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:39.415539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:39.415539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:39.415539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:39.415539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:39.415539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:39.415539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:39.415539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:39.415539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:39.416441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:39.416441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:39.416441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:39.416441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:39.416441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 324/641] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:39.417489 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2aef8c-e3cb-4709-b37e-9ae724664cb5 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:39.417773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2aef8c-e3cb-4709-b37e-9ae724664cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:39.418046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2aef8c-e3cb-4709-b37e-9ae724664cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:39.435001 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-2b2aef8c-e3cb-4709-b37e-9ae724664cb5 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:39.436414 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2b2aef8c-e3cb-4709-b37e-9ae724664cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:39.449535 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:39.462324 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df153209-786f-45fb-a7c7-e4dc23c8c9c9 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:39.500986 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c845d-daa8-47fd-b58a-f433f24d866d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:39.501657 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c845d-daa8-47fd-b58a-f433f24d866d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:39.501944 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c845d-daa8-47fd-b58a-f433f24d866d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:39.502222 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c845d-daa8-47fd-b58a-f433f24d866d None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:39.502963 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c845d-daa8-47fd-b58a-f433f24d866d None admin] RBAC: Adding query filter params (name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:39.503300 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c845d-daa8-47fd-b58a-f433f24d866d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:39.504674 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c845d-daa8-47fd-b58a-f433f24d866d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:39.515206 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 325/642] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:39.515206 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2aef8c-e3cb-4709-b37e-9ae724664cb5 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:39.515430 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 318/643] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 4 05:43:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:39.515430 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c845d-daa8-47fd-b58a-f433f24d866d None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:39.623048 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c845d-daa8-47fd-b58a-f433f24d866d None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:39.629520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2aef8c-e3cb-4709-b37e-9ae724664cb5 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:39.647162 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:39.658603 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909797b6-51c5-4853-9c83-a1a69c33607d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:39.659305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909797b6-51c5-4853-9c83-a1a69c33607d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:39.659681 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909797b6-51c5-4853-9c83-a1a69c33607d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:39.659963 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909797b6-51c5-4853-9c83-a1a69c33607d None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:39.660694 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909797b6-51c5-4853-9c83-a1a69c33607d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:39.661117 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909797b6-51c5-4853-9c83-a1a69c33607d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:39.662434 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909797b6-51c5-4853-9c83-a1a69c33607d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:39.666728 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3eac3-c99d-4d53-b0a9-fd00aca4a1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:39.667462 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3eac3-c99d-4d53-b0a9-fd00aca4a1e3 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:39.667820 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3eac3-c99d-4d53-b0a9-fd00aca4a1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:39.668155 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3eac3-c99d-4d53-b0a9-fd00aca4a1e3 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:39.669051 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3eac3-c99d-4d53-b0a9-fd00aca4a1e3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:39.669424 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3eac3-c99d-4d53-b0a9-fd00aca4a1e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:39.670915 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3eac3-c99d-4d53-b0a9-fd00aca4a1e3 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:39.674641 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 319/644] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:39.676131 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909797b6-51c5-4853-9c83-a1a69c33607d None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:39.689720 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:39.694448 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 326/645] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Jul 4 05:43:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:39.694951 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3eac3-c99d-4d53-b0a9-fd00aca4a1e3 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:39.785204 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909797b6-51c5-4853-9c83-a1a69c33607d None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:39.806917 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3eac3-c99d-4d53-b0a9-fd00aca4a1e3 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:39.823796 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9cb97-e4e2-4d2a-bf47-d0b7c95d3ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:39.824890 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9cb97-e4e2-4d2a-bf47-d0b7c95d3ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:39.825173 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9cb97-e4e2-4d2a-bf47-d0b7c95d3ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:39.825456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9cb97-e4e2-4d2a-bf47-d0b7c95d3ff0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:39.835783 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9cb97-e4e2-4d2a-bf47-d0b7c95d3ff0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:39.837234 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9cb97-e4e2-4d2a-bf47-d0b7c95d3ff0 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:39.843134 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd01eca-0b89-4bc9-8c40-c068befcf625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:39.844017 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd01eca-0b89-4bc9-8c40-c068befcf625 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:39.844299 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd01eca-0b89-4bc9-8c40-c068befcf625 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:39.844565 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd01eca-0b89-4bc9-8c40-c068befcf625 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:39.855304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd01eca-0b89-4bc9-8c40-c068befcf625 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:39.855702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-9fc9cb97-e4e2-4d2a-bf47-d0b7c95d3ff0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:39.855702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:39.855702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:39.855702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:39.855702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:39.855702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:39.855702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:39.855702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:39.855702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:39.855702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:39.855702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:39.855702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:39.855702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:39.855702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:39.855702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:39.856776 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:39.856776 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:39.856776 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:39.856776 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:39.856776 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:39.856776 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:39.856776 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:39.856776 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:39.856776 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:39.856776 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:39.856776 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:39.856776 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:39.856776 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:39.856776 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:39.856776 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:39.856776 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:39.856776 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:39.858045 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:39.858045 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:39.858045 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:39.858045 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:39.863843 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 320/646] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:39.863843 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9cb97-e4e2-4d2a-bf47-d0b7c95d3ff0 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:39.864051 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-ecd01eca-0b89-4bc9-8c40-c068befcf625 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:43:39.864051 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:39.864051 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:39.864051 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:39.864051 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:39.864051 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:39.864051 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:39.864051 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:39.864051 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:39.864051 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:39.864051 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:39.864051 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:39.864051 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:39.864051 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:39.864051 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:39.864051 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:39.865079 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:39.865079 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:39.865079 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:39.865079 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:39.865079 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:39.865079 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:39.865079 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:39.865079 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:39.865079 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:39.865079 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:39.865079 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:39.865079 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:39.865079 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:39.865079 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:39.865079 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:39.865079 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:39.866050 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:39.866050 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:39.866050 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:39.866050 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:39.866050 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:39.866050 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:39.866050 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:39.866050 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:39.866050 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:39.866050 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:39.866050 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:43:39.866050 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:39.866050 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 327/647] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 4 05:43:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:39.866050 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd01eca-0b89-4bc9-8c40-c068befcf625 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:39.906864 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:39.935176 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:39.976236 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9cb97-e4e2-4d2a-bf47-d0b7c95d3ff0 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:39.977502 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd01eca-0b89-4bc9-8c40-c068befcf625 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:40.013432 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67476161-3b4e-4768-abe2-6a0cc9cf1d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:40.014416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67476161-3b4e-4768-abe2-6a0cc9cf1d4f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:40.014790 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67476161-3b4e-4768-abe2-6a0cc9cf1d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:40.015070 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67476161-3b4e-4768-abe2-6a0cc9cf1d4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:40.016468 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9562d4c-10e2-46dc-b633-604df580ab71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:40.017114 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9562d4c-10e2-46dc-b633-604df580ab71 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:40.017397 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9562d4c-10e2-46dc-b633-604df580ab71 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:40.017675 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9562d4c-10e2-46dc-b633-604df580ab71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:40.023286 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67476161-3b4e-4768-abe2-6a0cc9cf1d4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:40.024811 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67476161-3b4e-4768-abe2-6a0cc9cf1d4f None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:40.044403 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-67476161-3b4e-4768-abe2-6a0cc9cf1d4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:40.044403 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:40.044403 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:40.044403 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:40.044403 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:40.044403 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:40.044403 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:40.044403 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:40.044403 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:40.044403 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:40.044403 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:40.044403 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:40.044403 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:43:40.044403 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:43:40.044403 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:43:40.045460 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:43:40.045460 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:40.045460 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:40.045460 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:40.045460 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:40.045460 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:40.045460 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:40.045460 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:40.045460 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:40.045460 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:40.045460 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:40.045460 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:40.045460 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:40.045460 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:40.045460 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:40.045460 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:40.045460 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:40.051611 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:43:40.051611 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:43:40.051611 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:43:40.051611 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:43:40.051611 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:43:40.051611 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:43:40.051611 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:40.051611 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:40.051611 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 321/648] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:43:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:40.051611 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67476161-3b4e-4768-abe2-6a0cc9cf1d4f None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:40.090396 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9562d4c-10e2-46dc-b633-604df580ab71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:40.094057 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9562d4c-10e2-46dc-b633-604df580ab71 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:40.130938 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:40.157629 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67476161-3b4e-4768-abe2-6a0cc9cf1d4f None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:40.180774 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:40.193285 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff55d3-318f-4fc6-a4ed-fc368339c0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:40.193892 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff55d3-318f-4fc6-a4ed-fc368339c0fb None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:40.194178 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff55d3-318f-4fc6-a4ed-fc368339c0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:40.194451 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff55d3-318f-4fc6-a4ed-fc368339c0fb None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:40.195169 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff55d3-318f-4fc6-a4ed-fc368339c0fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:40.195503 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff55d3-318f-4fc6-a4ed-fc368339c0fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:40.196880 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff55d3-318f-4fc6-a4ed-fc368339c0fb None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:40.201760 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 328/649] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:43:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 05:43:40.202763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9562d4c-10e2-46dc-b633-604df580ab71 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:40.211719 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 322/650] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:40.212540 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff55d3-318f-4fc6-a4ed-fc368339c0fb None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:40.304874 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9562d4c-10e2-46dc-b633-604df580ab71 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:40.313553 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff55d3-318f-4fc6-a4ed-fc368339c0fb None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:40.337208 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28499431-f66d-48e3-b4a3-918d5d182118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:40.337874 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28499431-f66d-48e3-b4a3-918d5d182118 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:40.338155 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28499431-f66d-48e3-b4a3-918d5d182118 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:40.338414 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28499431-f66d-48e3-b4a3-918d5d182118 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:40.339229 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28499431-f66d-48e3-b4a3-918d5d182118 None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:40.339517 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28499431-f66d-48e3-b4a3-918d5d182118 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:40.340981 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28499431-f66d-48e3-b4a3-918d5d182118 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:40.342271 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:40.346601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1742d1c-9e3c-4840-a5f7-faaf4d0c4236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:40.347459 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1742d1c-9e3c-4840-a5f7-faaf4d0c4236 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:40.347746 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1742d1c-9e3c-4840-a5f7-faaf4d0c4236 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:40.348022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1742d1c-9e3c-4840-a5f7-faaf4d0c4236 None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:40.348806 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1742d1c-9e3c-4840-a5f7-faaf4d0c4236 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:40.349117 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1742d1c-9e3c-4840-a5f7-faaf4d0c4236 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:40.349649 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 329/651] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 4 05:43:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:40.350617 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1742d1c-9e3c-4840-a5f7-faaf4d0c4236 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:40.350890 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766d7a3-036b-4ef7-a05d-f63e780ccd31 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:40.351191 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766d7a3-036b-4ef7-a05d-f63e780ccd31 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:40.351482 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766d7a3-036b-4ef7-a05d-f63e780ccd31 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:40.352776 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 330/652] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:40.358717 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766d7a3-036b-4ef7-a05d-f63e780ccd31 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:40.368393 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 323/653] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:43:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:40.369069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1742d1c-9e3c-4840-a5f7-faaf4d0c4236 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:40.412791 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:40.460465 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766d7a3-036b-4ef7-a05d-f63e780ccd31 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:40.467349 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1742d1c-9e3c-4840-a5f7-faaf4d0c4236 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:40.492225 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6689647-564c-4237-b851-fb7767117dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:40.493016 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6689647-564c-4237-b851-fb7767117dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:40.493307 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6689647-564c-4237-b851-fb7767117dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:40.493574 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6689647-564c-4237-b851-fb7767117dd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:40.500641 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cbcebc-ce01-4789-b8df-2a3b56492d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:40.501827 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbcebc-ce01-4789-b8df-2a3b56492d60 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:40.502107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbcebc-ce01-4789-b8df-2a3b56492d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:40.502376 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbcebc-ce01-4789-b8df-2a3b56492d60 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:40.505041 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6689647-564c-4237-b851-fb7767117dd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:40.506511 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6689647-564c-4237-b851-fb7767117dd0 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:40.509677 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cbcebc-ce01-4789-b8df-2a3b56492d60 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:40.511176 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cbcebc-ce01-4789-b8df-2a3b56492d60 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:40.523021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-c6689647-564c-4237-b851-fb7767117dd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:40.523021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:40.523021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:40.523021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:40.523021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:40.523021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:40.523021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:40.523021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:40.523021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:40.523021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:40.523021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:40.523021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:40.523021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:40.523021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:40.523021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:40.524028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:40.524028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:40.524028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:40.524028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:40.524028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:40.524028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:40.524028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:40.524028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:40.524028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:40.524028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:40.524028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:40.524028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:40.524028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:40.524028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:40.524028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:40.524028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:40.524028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:40.524992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:40.524992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:40.524992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:40.524992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:40.525354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-b9cbcebc-ce01-4789-b8df-2a3b56492d60 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 04 05:43:40.525354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:40.525354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:40.525354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:40.525354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:40.525354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:40.525354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:40.525354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:40.525354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:40.525354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:40.525354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:40.525354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:40.525354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:43:40.525354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:43:40.525354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:43:40.525354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:43:40.526234 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:40.526234 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:40.526234 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:43:40.526234 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:40.526234 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:43:40.526234 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:40.526234 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:40.526234 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:40.526234 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:40.526234 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:40.526234 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:40.526234 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:40.526234 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:40.526234 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:40.526234 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:40.526234 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:40.526234 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:40.526234 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:40.527199 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:40.527199 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:40.527199 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:43:40.527199 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:43:40.527199 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:43:40.527199 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:43:40.527199 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:43:40.527199 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:43:40.527199 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 04 05:43:40.527199 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:40.527869 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 331/654] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:40.527947 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 324/655] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:43:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:40.527947 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cbcebc-ce01-4789-b8df-2a3b56492d60 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:40.529399 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fb981-2781-40f4-a6b7-45f290f48f32 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:40.529689 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fb981-2781-40f4-a6b7-45f290f48f32 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:40.530088 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fb981-2781-40f4-a6b7-45f290f48f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:40.547323 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-ff2fb981-2781-40f4-a6b7-45f290f48f32 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:40.548512 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ff2fb981-2781-40f4-a6b7-45f290f48f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:40.590354 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:40.612961 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 332/656] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:40.613769 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fb981-2781-40f4-a6b7-45f290f48f32 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:40.623528 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cbcebc-ce01-4789-b8df-2a3b56492d60 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:40.625221 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:40.660448 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1a5ab-0a53-427c-b398-cb37039b53ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:40.661244 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1a5ab-0a53-427c-b398-cb37039b53ea None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:40.661517 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1a5ab-0a53-427c-b398-cb37039b53ea None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:40.661787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1a5ab-0a53-427c-b398-cb37039b53ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:40.672078 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1a5ab-0a53-427c-b398-cb37039b53ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:40.673516 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1a5ab-0a53-427c-b398-cb37039b53ea None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:40.690658 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-c3b1a5ab-0a53-427c-b398-cb37039b53ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:40.690658 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:40.690658 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:40.690658 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:40.690658 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:40.690658 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:40.690658 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:40.690658 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:40.690658 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:40.690658 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:40.690658 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:40.690658 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:40.690658 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:40.690658 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:40.690658 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:40.691601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:40.691601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:40.691601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:40.691601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:40.691601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:40.691601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:40.691601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:40.691601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:40.691601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:40.691601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:40.691601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:40.691601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:40.691601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:40.691601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:40.691601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:40.691601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:40.691601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:40.692476 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:40.692476 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:40.692476 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:40.692476 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:40.692476 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 325/657] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:40.693046 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1a5ab-0a53-427c-b398-cb37039b53ea None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:40.718877 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fb981-2781-40f4-a6b7-45f290f48f32 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:40.751303 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09a2f4-f408-4094-9cf3-3e37a22fcb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:40.751955 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09a2f4-f408-4094-9cf3-3e37a22fcb6c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:40.752234 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09a2f4-f408-4094-9cf3-3e37a22fcb6c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:40.752507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09a2f4-f408-4094-9cf3-3e37a22fcb6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:40.753335 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a09a2f4-f408-4094-9cf3-3e37a22fcb6c None admin] RBAC: Adding query filter params (role.id=d775f350758d4eb8bfceeeb91e54351f, scope.project.id=4bc610fb6724419dac99f2483089c783, user.id=6f638cc70c994a529a48cb2c92b70384) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:40.753645 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a09a2f4-f408-4094-9cf3-3e37a22fcb6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:40.755084 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a09a2f4-f408-4094-9cf3-3e37a22fcb6c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:40.760877 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 333/658] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:43:40 2022] GET /identity/v3/role_assignments?user.id=6f638cc70c994a529a48cb2c92b70384&scope.project.id=4bc610fb6724419dac99f2483089c783&role.id=d775f350758d4eb8bfceeeb91e54351f => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:40.761637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09a2f4-f408-4094-9cf3-3e37a22fcb6c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:40.800361 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1a5ab-0a53-427c-b398-cb37039b53ea None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:40.809576 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:40.839073 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b12048-2de5-462a-959f-fe6a95d39427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:40.840054 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b12048-2de5-462a-959f-fe6a95d39427 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:40.840330 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b12048-2de5-462a-959f-fe6a95d39427 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:40.840617 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b12048-2de5-462a-959f-fe6a95d39427 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:40.841340 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b12048-2de5-462a-959f-fe6a95d39427 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:40.841642 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b12048-2de5-462a-959f-fe6a95d39427 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:40.843089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b12048-2de5-462a-959f-fe6a95d39427 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:40.856141 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 326/659] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:40.857018 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b12048-2de5-462a-959f-fe6a95d39427 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:40.875409 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:40.880552 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09a2f4-f408-4094-9cf3-3e37a22fcb6c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:40.919688 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c110ac-d358-4ac5-b65d-cbd80d0e18a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:40.920387 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c110ac-d358-4ac5-b65d-cbd80d0e18a1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:40.920662 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c110ac-d358-4ac5-b65d-cbd80d0e18a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:40.922084 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c110ac-d358-4ac5-b65d-cbd80d0e18a1 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:40.922084 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c110ac-d358-4ac5-b65d-cbd80d0e18a1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:40.922084 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c110ac-d358-4ac5-b65d-cbd80d0e18a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:40.923774 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c110ac-d358-4ac5-b65d-cbd80d0e18a1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:40.942413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 334/660] 10.222.0.16 () {56 vars in 1137 bytes} [Mon Jul 4 05:43:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:40.943030 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c110ac-d358-4ac5-b65d-cbd80d0e18a1 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:40.972272 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b12048-2de5-462a-959f-fe6a95d39427 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:41.016569 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0088d-c5b3-4adb-8e6e-a8ae1e7d3c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:41.017386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0088d-c5b3-4adb-8e6e-a8ae1e7d3c53 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:41.017917 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0088d-c5b3-4adb-8e6e-a8ae1e7d3c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:41.018197 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0088d-c5b3-4adb-8e6e-a8ae1e7d3c53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:41.032133 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0088d-c5b3-4adb-8e6e-a8ae1e7d3c53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:41.040807 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-0fc0088d-c5b3-4adb-8e6e-a8ae1e7d3c53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:43:41.040807 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:41.040807 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:41.040807 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:41.040807 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:41.040807 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:41.040807 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:41.040807 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:41.040807 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:41.040807 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:41.040807 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:41.040807 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:41.040807 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:41.040807 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:41.040807 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:41.040807 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:41.041822 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:41.041822 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:41.041822 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:41.041822 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:41.041822 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:41.041822 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:41.041822 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:41.041822 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:41.041822 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:41.041822 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:41.041822 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:41.041822 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:41.041822 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:41.041822 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:41.041822 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:41.041822 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:41.042638 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:41.042638 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:41.042638 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:41.042638 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:41.042638 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:41.042638 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:41.042638 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:41.042638 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:41.042638 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:41.042638 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:41.042638 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:43:41.042638 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:41.042638 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 327/661] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 4 05:43:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:41.043884 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0088d-c5b3-4adb-8e6e-a8ae1e7d3c53 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:41.055016 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:41.059141 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c110ac-d358-4ac5-b65d-cbd80d0e18a1 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:41.094516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5feb1a-59f7-428d-8d69-dc353fa2eca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:41.095389 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5feb1a-59f7-428d-8d69-dc353fa2eca7 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:41.095837 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5feb1a-59f7-428d-8d69-dc353fa2eca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:41.096210 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5feb1a-59f7-428d-8d69-dc353fa2eca7 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:41.097023 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5feb1a-59f7-428d-8d69-dc353fa2eca7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:41.097425 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5feb1a-59f7-428d-8d69-dc353fa2eca7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:41.099028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5feb1a-59f7-428d-8d69-dc353fa2eca7 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:41.119223 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 335/662] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:41.119223 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5feb1a-59f7-428d-8d69-dc353fa2eca7 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:41.131145 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:41.161350 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0088d-c5b3-4adb-8e6e-a8ae1e7d3c53 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:41.197369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479077c-ce24-4274-af9a-8a25392c57c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:41.198566 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479077c-ce24-4274-af9a-8a25392c57c8 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:41.198852 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479077c-ce24-4274-af9a-8a25392c57c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:41.199128 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479077c-ce24-4274-af9a-8a25392c57c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:41.206343 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6479077c-ce24-4274-af9a-8a25392c57c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:41.207853 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6479077c-ce24-4274-af9a-8a25392c57c8 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:41.222833 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-6479077c-ce24-4274-af9a-8a25392c57c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:41.222833 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:41.222833 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:41.222833 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:41.222833 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:41.222833 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:41.222833 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:41.222833 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:41.222833 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:41.222833 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:41.222833 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:41.222833 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:41.222833 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:43:41.222833 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:43:41.222833 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:43:41.224032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:43:41.224032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:41.224032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:41.224032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:41.224032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:41.224032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:41.224032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:41.224032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:41.224032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:41.224032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:41.224032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:41.224032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:41.224032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:41.224032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:41.224032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:41.224032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:41.224032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:41.225399 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:43:41.225399 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:43:41.225399 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:43:41.225399 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:43:41.225399 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:43:41.225399 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:43:41.225399 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:41.225399 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:41.225912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5feb1a-59f7-428d-8d69-dc353fa2eca7 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:41.228659 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 328/663] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:43:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:41.229592 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479077c-ce24-4274-af9a-8a25392c57c8 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:41.260192 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136effa-d6ca-4537-af8b-620b127cf7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:41.261059 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136effa-d6ca-4537-af8b-620b127cf7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:41.261439 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136effa-d6ca-4537-af8b-620b127cf7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:41.261714 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136effa-d6ca-4537-af8b-620b127cf7c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:41.291207 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:41.333340 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479077c-ce24-4274-af9a-8a25392c57c8 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:41.336060 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136effa-d6ca-4537-af8b-620b127cf7c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:41.337641 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136effa-d6ca-4537-af8b-620b127cf7c4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:41.375676 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffb761-5246-42a5-a601-ca39c65e824a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:41.377030 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffb761-5246-42a5-a601-ca39c65e824a None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:41.377473 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffb761-5246-42a5-a601-ca39c65e824a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:41.377897 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffb761-5246-42a5-a601-ca39c65e824a None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:41.379095 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bffb761-5246-42a5-a601-ca39c65e824a None admin] RBAC: Adding query filter params (name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:41.379898 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bffb761-5246-42a5-a601-ca39c65e824a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:41.381494 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bffb761-5246-42a5-a601-ca39c65e824a None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:41.383097 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:41.391931 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 329/664] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 4 05:43:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:41.392540 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffb761-5246-42a5-a601-ca39c65e824a None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:41.442113 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 336/665] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:43:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 05:43:41.443356 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136effa-d6ca-4537-af8b-620b127cf7c4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:41.502462 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffb761-5246-42a5-a601-ca39c65e824a None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:41.504485 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:41.542186 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7b93c-de67-468c-8386-76d81364c83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:41.543087 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7b93c-de67-468c-8386-76d81364c83f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:41.543400 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7b93c-de67-468c-8386-76d81364c83f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:41.543670 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7b93c-de67-468c-8386-76d81364c83f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:41.551641 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b7b93c-de67-468c-8386-76d81364c83f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:41.552168 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136effa-d6ca-4537-af8b-620b127cf7c4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:41.553086 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b7b93c-de67-468c-8386-76d81364c83f None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:41.567308 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-40b7b93c-de67-468c-8386-76d81364c83f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 04 05:43:41.567308 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:41.567308 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:41.567308 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:41.567308 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:41.567308 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:41.567308 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:41.567308 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:41.567308 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:41.567308 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:41.567308 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:41.567308 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:41.567308 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:43:41.567308 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:43:41.567308 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:43:41.567308 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:43:41.568487 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:41.568487 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:41.568487 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:43:41.568487 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:41.568487 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:43:41.568487 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:41.568487 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:41.568487 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:41.568487 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:41.568487 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:41.568487 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:41.568487 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:41.568487 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:41.568487 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:41.568487 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:41.568487 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:41.568487 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:41.568487 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:41.569467 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:41.569467 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:41.569467 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:43:41.569467 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:43:41.569467 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:43:41.569467 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:43:41.569467 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:43:41.569467 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:43:41.569467 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 04 05:43:41.569467 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:41.569467 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 330/666] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 4 05:43:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:41.570072 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7b93c-de67-468c-8386-76d81364c83f None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:41.592294 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5bb370-64e6-4ece-ad04-78e4953f9612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:41.592950 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bb370-64e6-4ece-ad04-78e4953f9612 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:41.593227 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bb370-64e6-4ece-ad04-78e4953f9612 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:41.593497 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bb370-64e6-4ece-ad04-78e4953f9612 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:41.594272 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5bb370-64e6-4ece-ad04-78e4953f9612 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:41.594573 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5bb370-64e6-4ece-ad04-78e4953f9612 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:41.596025 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5bb370-64e6-4ece-ad04-78e4953f9612 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:41.612763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 337/667] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:43:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:41.612763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5bb370-64e6-4ece-ad04-78e4953f9612 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:41.628464 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:41.676925 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7b93c-de67-468c-8386-76d81364c83f None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:41.709687 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5bb370-64e6-4ece-ad04-78e4953f9612 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:41.711314 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea15733-bfb4-40c9-86d3-8c513f13db2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:41.712225 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea15733-bfb4-40c9-86d3-8c513f13db2e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:41.712503 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea15733-bfb4-40c9-86d3-8c513f13db2e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:41.712771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea15733-bfb4-40c9-86d3-8c513f13db2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:41.724478 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea15733-bfb4-40c9-86d3-8c513f13db2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:41.725911 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea15733-bfb4-40c9-86d3-8c513f13db2e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:41.730269 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:41.743929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-fea15733-bfb4-40c9-86d3-8c513f13db2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:41.743929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:41.743929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:41.743929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:41.743929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:41.743929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:41.743929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:41.743929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:41.743929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:41.743929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:41.743929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:41.743929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:41.743929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:41.743929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:41.743929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:41.745020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:41.745020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:41.745020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:41.745020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:41.745020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:41.745020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:41.745020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:41.745020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:41.745020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:41.745020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:41.745020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:41.745020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:41.745020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:41.745020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:41.745020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:41.745020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:41.745020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:41.746122 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:41.746122 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:41.746122 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:41.746122 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:41.746122 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 331/668] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:41.746122 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea15733-bfb4-40c9-86d3-8c513f13db2e None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:41.752889 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18762212-5973-49d9-93e4-47c64d91336a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:41.753749 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18762212-5973-49d9-93e4-47c64d91336a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:41.754128 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18762212-5973-49d9-93e4-47c64d91336a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:41.754499 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18762212-5973-49d9-93e4-47c64d91336a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:41.765922 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18762212-5973-49d9-93e4-47c64d91336a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:41.767534 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18762212-5973-49d9-93e4-47c64d91336a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:41.784588 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-18762212-5973-49d9-93e4-47c64d91336a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:41.784588 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:41.784588 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:41.784588 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:41.784588 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:41.784588 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:41.784588 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:41.784588 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:41.784588 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:41.784588 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:41.784588 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:41.784588 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:41.784588 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:41.784588 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:41.784588 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:41.785666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:41.785666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:41.785666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:41.785666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:41.785666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:41.785666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:41.785666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:41.785666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:41.785666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:41.785666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:41.785666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:41.785666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:41.785666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:41.785666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:41.785666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:41.785666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:41.785666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:41.786749 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:41.786749 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:41.786749 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:41.786749 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:41.791497 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 338/669] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:41.791497 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18762212-5973-49d9-93e4-47c64d91336a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:41.852293 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea15733-bfb4-40c9-86d3-8c513f13db2e None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:41.861159 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:41.892545 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c030d67-421a-4526-8432-ff1191d78c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:41.893222 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c030d67-421a-4526-8432-ff1191d78c38 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:41.893376 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18762212-5973-49d9-93e4-47c64d91336a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:41.893484 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c030d67-421a-4526-8432-ff1191d78c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:41.893762 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c030d67-421a-4526-8432-ff1191d78c38 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:41.894601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c030d67-421a-4526-8432-ff1191d78c38 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:41.894905 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c030d67-421a-4526-8432-ff1191d78c38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:41.896381 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c030d67-421a-4526-8432-ff1191d78c38 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:41.915702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 332/670] 10.222.0.16 () {56 vars in 1139 bytes} [Mon Jul 4 05:43:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:41.916861 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c030d67-421a-4526-8432-ff1191d78c38 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:41.933886 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ed6bd-421d-49f9-9f2e-216c5933ff10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:41.934544 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ed6bd-421d-49f9-9f2e-216c5933ff10 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:41.934821 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ed6bd-421d-49f9-9f2e-216c5933ff10 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:41.935089 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ed6bd-421d-49f9-9f2e-216c5933ff10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:41.935943 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ed6bd-421d-49f9-9f2e-216c5933ff10 None admin] RBAC: Adding query filter params (role.id=d775f350758d4eb8bfceeeb91e54351f, scope.project.id=4bc610fb6724419dac99f2483089c783, user.id=8103fdfbdcf449a49e770750876bbee3) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:41.936247 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ed6bd-421d-49f9-9f2e-216c5933ff10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:41.937688 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ed6bd-421d-49f9-9f2e-216c5933ff10 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:41.943670 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 339/671] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:43:41 2022] GET /identity/v3/role_assignments?user.id=8103fdfbdcf449a49e770750876bbee3&scope.project.id=4bc610fb6724419dac99f2483089c783&role.id=d775f350758d4eb8bfceeeb91e54351f => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:41.944422 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ed6bd-421d-49f9-9f2e-216c5933ff10 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:41.999529 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:42.049249 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c030d67-421a-4526-8432-ff1191d78c38 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:42.089741 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ed6bd-421d-49f9-9f2e-216c5933ff10 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:42.093479 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdc10a-5bdb-4330-a643-4468374576dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:42.094354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdc10a-5bdb-4330-a643-4468374576dd None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:42.094705 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdc10a-5bdb-4330-a643-4468374576dd None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:42.095050 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdc10a-5bdb-4330-a643-4468374576dd None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:42.095901 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fdc10a-5bdb-4330-a643-4468374576dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:42.096273 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fdc10a-5bdb-4330-a643-4468374576dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:42.097751 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fdc10a-5bdb-4330-a643-4468374576dd None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:42.111099 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 333/672] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:42.112169 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdc10a-5bdb-4330-a643-4468374576dd None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:42.135554 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67f28d-89e3-4008-ad4d-99ac1babdfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:42.136226 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67f28d-89e3-4008-ad4d-99ac1babdfae None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:42.136511 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67f28d-89e3-4008-ad4d-99ac1babdfae None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:42.136784 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67f28d-89e3-4008-ad4d-99ac1babdfae None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:42.137507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67f28d-89e3-4008-ad4d-99ac1babdfae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:42.137810 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67f28d-89e3-4008-ad4d-99ac1babdfae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:42.139231 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67f28d-89e3-4008-ad4d-99ac1babdfae None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:42.145412 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:42.156012 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 340/673] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:42.156909 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67f28d-89e3-4008-ad4d-99ac1babdfae None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:42.230361 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdc10a-5bdb-4330-a643-4468374576dd None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:42.261559 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:42.268497 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b8c86-2308-4bee-b2d1-096d7a53c1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:42.268857 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67f28d-89e3-4008-ad4d-99ac1babdfae None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:42.269537 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b8c86-2308-4bee-b2d1-096d7a53c1ca None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:42.269826 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b8c86-2308-4bee-b2d1-096d7a53c1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:42.270106 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b8c86-2308-4bee-b2d1-096d7a53c1ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:42.304920 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8103c0-3e01-4332-9f2b-2ad5fd298428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:42.306037 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8103c0-3e01-4332-9f2b-2ad5fd298428 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:42.306522 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8103c0-3e01-4332-9f2b-2ad5fd298428 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:42.306974 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8103c0-3e01-4332-9f2b-2ad5fd298428 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:42.315086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8103c0-3e01-4332-9f2b-2ad5fd298428 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:42.316806 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8103c0-3e01-4332-9f2b-2ad5fd298428 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:42.331841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-2d8103c0-3e01-4332-9f2b-2ad5fd298428 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 04 05:43:42.331841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:42.331841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:42.331841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:42.331841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:42.331841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:42.331841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:42.331841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:42.331841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:42.331841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:42.331841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:42.331841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:42.331841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:43:42.331841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:43:42.331841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:43:42.331841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:43:42.332784 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:42.332784 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:42.332784 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:43:42.332784 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:42.332784 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:43:42.332784 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:42.332784 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:42.332784 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:42.332784 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:42.332784 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:42.332784 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:42.332784 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:42.332784 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:42.332784 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:42.332784 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:42.332784 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:42.332784 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:42.332784 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:42.333723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:42.333723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:42.333723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:43:42.333723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:43:42.333723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:43:42.333723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:43:42.333723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:43:42.333723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:43:42.333723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 04 05:43:42.333723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:42.336082 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 341/674] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:43:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:42.337109 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8103c0-3e01-4332-9f2b-2ad5fd298428 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:42.359102 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b8c86-2308-4bee-b2d1-096d7a53c1ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:42.361331 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b8c86-2308-4bee-b2d1-096d7a53c1ca None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:42.395774 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:42.467715 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8103c0-3e01-4332-9f2b-2ad5fd298428 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:42.476374 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 334/675] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:43:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 05:43:42.477613 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b8c86-2308-4bee-b2d1-096d7a53c1ca None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:42.513062 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77c3e6-817f-40d7-898b-fc218eae171a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:42.514115 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77c3e6-817f-40d7-898b-fc218eae171a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:42.514403 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77c3e6-817f-40d7-898b-fc218eae171a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:42.514678 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77c3e6-817f-40d7-898b-fc218eae171a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:42.526779 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed77c3e6-817f-40d7-898b-fc218eae171a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:42.528379 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed77c3e6-817f-40d7-898b-fc218eae171a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:42.548422 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-ed77c3e6-817f-40d7-898b-fc218eae171a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:42.548422 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:42.548422 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:42.548422 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:42.548422 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:42.548422 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:42.548422 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:42.548422 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:42.548422 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:42.548422 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:42.548422 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:42.548422 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:42.548422 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:43:42.548422 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:43:42.548422 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:43:42.549317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:43:42.549317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:42.549317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:42.549317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:42.549317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:42.549317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:42.549317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:42.549317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:42.549317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:42.549317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:42.549317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:42.549317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:42.549317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:42.549317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:42.549317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:42.549317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:42.549317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:42.550180 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:43:42.550180 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:43:42.550180 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:43:42.550180 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:43:42.550180 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:43:42.550180 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:43:42.550180 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:42.550180 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:42.551305 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 342/676] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:43:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:42.554554 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77c3e6-817f-40d7-898b-fc218eae171a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:42.576826 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:42.598559 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b8c86-2308-4bee-b2d1-096d7a53c1ca None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:42.634378 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:42.644518 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f32cd-1fd2-4e7a-93b2-130a7dd4baba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:42.645532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f32cd-1fd2-4e7a-93b2-130a7dd4baba None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:42.645674 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f32cd-1fd2-4e7a-93b2-130a7dd4baba None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:42.646029 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f32cd-1fd2-4e7a-93b2-130a7dd4baba None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:42.646964 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f32cd-1fd2-4e7a-93b2-130a7dd4baba None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:42.647399 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f32cd-1fd2-4e7a-93b2-130a7dd4baba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:42.648988 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f32cd-1fd2-4e7a-93b2-130a7dd4baba None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:42.671651 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 335/677] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Jul 4 05:43:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:42.672042 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77c3e6-817f-40d7-898b-fc218eae171a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:42.672844 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f32cd-1fd2-4e7a-93b2-130a7dd4baba None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:42.717104 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee13021-7a4e-4568-be80-88cb910a406d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:42.718805 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee13021-7a4e-4568-be80-88cb910a406d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:42.719281 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee13021-7a4e-4568-be80-88cb910a406d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:42.719723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee13021-7a4e-4568-be80-88cb910a406d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:42.734710 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee13021-7a4e-4568-be80-88cb910a406d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:42.736764 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee13021-7a4e-4568-be80-88cb910a406d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:42.755053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-3ee13021-7a4e-4568-be80-88cb910a406d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:42.755053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:42.755053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:42.755053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:42.755053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:42.755053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:42.755053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:42.755053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:42.755053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:42.755053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:42.755053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:42.755053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:42.755053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:42.755053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:42.755053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:42.756040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:42.756040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:42.756040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:42.756040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:42.756040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:42.756040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:42.756040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:42.756040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:42.756040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:42.756040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:42.756040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:42.756040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:42.756040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:42.756040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:42.756040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:42.756040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:42.756040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:42.756936 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:42.756936 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:42.756936 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:42.756936 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:42.761243 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 343/678] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:42.762038 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee13021-7a4e-4568-be80-88cb910a406d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:42.788589 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f32cd-1fd2-4e7a-93b2-130a7dd4baba None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:42.833210 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:42.840009 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8110f-64a0-4b57-aa3f-83bb378cfee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:42.840999 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8110f-64a0-4b57-aa3f-83bb378cfee2 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:42.841462 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8110f-64a0-4b57-aa3f-83bb378cfee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:42.841913 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8110f-64a0-4b57-aa3f-83bb378cfee2 None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:42.842886 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8110f-64a0-4b57-aa3f-83bb378cfee2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:42.843244 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8110f-64a0-4b57-aa3f-83bb378cfee2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:42.845123 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8110f-64a0-4b57-aa3f-83bb378cfee2 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:42.859343 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 336/679] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:43:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:42.859343 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8110f-64a0-4b57-aa3f-83bb378cfee2 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:42.869103 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee13021-7a4e-4568-be80-88cb910a406d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:42.904274 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:42.905589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0d203-1e50-4aa2-a609-2204d312c747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:42.906244 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0d203-1e50-4aa2-a609-2204d312c747 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:42.906528 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0d203-1e50-4aa2-a609-2204d312c747 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:42.906857 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0d203-1e50-4aa2-a609-2204d312c747 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:42.962087 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8110f-64a0-4b57-aa3f-83bb378cfee2 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:42.975907 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0d203-1e50-4aa2-a609-2204d312c747 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:42.977376 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0d203-1e50-4aa2-a609-2204d312c747 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:42.999719 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76dfce-9db8-44a4-8e38-009cb547ea4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:43.000383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76dfce-9db8-44a4-8e38-009cb547ea4b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:43.000674 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76dfce-9db8-44a4-8e38-009cb547ea4b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:43.000939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76dfce-9db8-44a4-8e38-009cb547ea4b None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:43.001663 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76dfce-9db8-44a4-8e38-009cb547ea4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:43.001968 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76dfce-9db8-44a4-8e38-009cb547ea4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:43.003354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76dfce-9db8-44a4-8e38-009cb547ea4b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:43.021220 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 337/680] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:43.021220 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117b27b-9711-419a-b21c-82d7bd218a6d None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:43.021220 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117b27b-9711-419a-b21c-82d7bd218a6d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:43.021220 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117b27b-9711-419a-b21c-82d7bd218a6d None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:43.021220 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 338/681] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:43.021220 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117b27b-9711-419a-b21c-82d7bd218a6d None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:43.050033 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:43.085601 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 344/682] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:43:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 05:43:43.086353 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0d203-1e50-4aa2-a609-2204d312c747 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:43.132879 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117b27b-9711-419a-b21c-82d7bd218a6d None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:43.136245 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:43.170325 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500ba60-0db5-45e4-ab35-3bde5e9d9afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:43.170996 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500ba60-0db5-45e4-ab35-3bde5e9d9afd None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:43.171307 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500ba60-0db5-45e4-ab35-3bde5e9d9afd None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:43.171582 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500ba60-0db5-45e4-ab35-3bde5e9d9afd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:43.172406 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500ba60-0db5-45e4-ab35-3bde5e9d9afd None admin] RBAC: Adding query filter params (role.id=d775f350758d4eb8bfceeeb91e54351f, scope.project.id=4bc610fb6724419dac99f2483089c783, user.id=77f0477631724d7f9c8ba752ba27866d) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:43.172712 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500ba60-0db5-45e4-ab35-3bde5e9d9afd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:43.174140 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500ba60-0db5-45e4-ab35-3bde5e9d9afd None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:43.180354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 339/683] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:43:43 2022] GET /identity/v3/role_assignments?user.id=77f0477631724d7f9c8ba752ba27866d&scope.project.id=4bc610fb6724419dac99f2483089c783&role.id=d775f350758d4eb8bfceeeb91e54351f => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:43.181474 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213f40a-dd6d-4f8f-905c-0da0aab5d0ba None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:43.181749 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213f40a-dd6d-4f8f-905c-0da0aab5d0ba None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:43.182051 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213f40a-dd6d-4f8f-905c-0da0aab5d0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:43.199466 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-4213f40a-dd6d-4f8f-905c-0da0aab5d0ba None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:43.200693 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-4213f40a-dd6d-4f8f-905c-0da0aab5d0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:43.206055 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0d203-1e50-4aa2-a609-2204d312c747 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:43.260816 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0901430-c81a-480d-8b35-775007f3167c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:43.262325 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0901430-c81a-480d-8b35-775007f3167c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:43.262863 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0901430-c81a-480d-8b35-775007f3167c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:43.263401 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0901430-c81a-480d-8b35-775007f3167c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:43.274251 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0901430-c81a-480d-8b35-775007f3167c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:43.276679 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0901430-c81a-480d-8b35-775007f3167c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:43.283977 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 340/684] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:43.283977 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213f40a-dd6d-4f8f-905c-0da0aab5d0ba None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:43.308567 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-e0901430-c81a-480d-8b35-775007f3167c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:43.308567 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:43.308567 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:43.308567 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:43.308567 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:43.308567 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:43.308567 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:43.308567 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:43.308567 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:43.308567 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:43.308567 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:43.308567 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:43.308567 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:43:43.308567 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:43:43.308567 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:43:43.309569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:43:43.309569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:43.309569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:43.309569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:43.309569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:43.309569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:43.309569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:43.309569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:43.309569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:43.309569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:43.309569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:43.309569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:43.309569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:43.309569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:43.309569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:43.309569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:43.309569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:43.310445 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:43:43.310445 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:43:43.310445 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:43:43.310445 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:43:43.310445 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:43:43.310445 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:43:43.310445 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:43.310445 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:43.310445 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 345/685] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:43:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:43.311826 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0901430-c81a-480d-8b35-775007f3167c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:43.348206 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:43.411675 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:43.416428 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213f40a-dd6d-4f8f-905c-0da0aab5d0ba None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:43.438887 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0901430-c81a-480d-8b35-775007f3167c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:43.465520 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d1a74-460f-4e77-afb1-f952be620e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:43.466439 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d1a74-460f-4e77-afb1-f952be620e85 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:43.466793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d1a74-460f-4e77-afb1-f952be620e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:43.467155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d1a74-460f-4e77-afb1-f952be620e85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:43.479505 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d1a74-460f-4e77-afb1-f952be620e85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:43.481141 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec2f9a-11a4-4826-b4c0-15c4e2235861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:43.481565 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d1a74-460f-4e77-afb1-f952be620e85 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:43.482093 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec2f9a-11a4-4826-b4c0-15c4e2235861 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:43.482573 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec2f9a-11a4-4826-b4c0-15c4e2235861 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:43.482919 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec2f9a-11a4-4826-b4c0-15c4e2235861 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:43.494144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec2f9a-11a4-4826-b4c0-15c4e2235861 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:43.501323 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-1e6d1a74-460f-4e77-afb1-f952be620e85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:43.501323 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:43.501323 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:43.501323 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:43.501323 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:43.501323 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:43.501323 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:43.501323 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:43.501323 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:43.501323 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:43.501323 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:43.501323 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:43.501323 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:43.501323 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:43.501323 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:43.502187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:43.502187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:43.502187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:43.502187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:43.502187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:43.502187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:43.502187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:43.502187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:43.502187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:43.502187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:43.502187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:43.502187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:43.502187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:43.502187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:43.502187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:43.502187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:43.502187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:43.503061 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:43.503061 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:43.503061 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:43.503061 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:43.503304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-d9ec2f9a-11a4-4826-b4c0-15c4e2235861 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:43:43.503304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:43.503304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:43.503304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:43.503304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:43.503304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:43.503304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:43.503304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:43.503304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:43.503304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:43.503304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:43.503304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:43.503304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:43.503304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:43.503304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:43.503304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:43.504151 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:43.504151 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:43.504151 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:43.504151 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:43.504151 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:43.504151 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:43.504151 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:43.504151 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:43.504151 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:43.504151 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:43.504151 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:43.504151 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:43.504151 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:43.504151 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:43.504151 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:43.504151 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:43.505045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:43.505045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:43.505045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:43.505045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:43.505045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:43.505045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:43.505045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:43.505045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:43.505045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:43.505045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:43.505045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:43:43.505045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:43.505045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 346/686] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:43:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:43.505045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec2f9a-11a4-4826-b4c0-15c4e2235861 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:43.508337 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 341/687] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:43.510422 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d1a74-460f-4e77-afb1-f952be620e85 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:43.606521 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:43.613235 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d1a74-460f-4e77-afb1-f952be620e85 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:43.620045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec2f9a-11a4-4826-b4c0-15c4e2235861 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:43.648405 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5d4f2-b700-48e7-beed-fc84cf2496ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:43.649461 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5d4f2-b700-48e7-beed-fc84cf2496ea None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:43.649962 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5d4f2-b700-48e7-beed-fc84cf2496ea None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:43.650431 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5d4f2-b700-48e7-beed-fc84cf2496ea None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:43.651499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea5d4f2-b700-48e7-beed-fc84cf2496ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:43.652018 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea5d4f2-b700-48e7-beed-fc84cf2496ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:43.653600 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea5d4f2-b700-48e7-beed-fc84cf2496ea None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:43.657226 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f800a-0a6a-422d-a7d2-f893cd3eee41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:43.657894 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f800a-0a6a-422d-a7d2-f893cd3eee41 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:43.658180 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f800a-0a6a-422d-a7d2-f893cd3eee41 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:43.658457 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f800a-0a6a-422d-a7d2-f893cd3eee41 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:43.659269 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f800a-0a6a-422d-a7d2-f893cd3eee41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:43.659583 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f800a-0a6a-422d-a7d2-f893cd3eee41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:43.661143 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f800a-0a6a-422d-a7d2-f893cd3eee41 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:43.664731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 342/688] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:43:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:43.665760 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5d4f2-b700-48e7-beed-fc84cf2496ea None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:43.679044 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 347/689] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:43:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:43.683959 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f800a-0a6a-422d-a7d2-f893cd3eee41 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:43.686293 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:43.775661 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5d4f2-b700-48e7-beed-fc84cf2496ea None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:43.787254 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f800a-0a6a-422d-a7d2-f893cd3eee41 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:43.815925 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73dc4e-e6c9-43bd-90a8-0407f7469ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:43.816694 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73dc4e-e6c9-43bd-90a8-0407f7469ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:43.816975 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73dc4e-e6c9-43bd-90a8-0407f7469ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:43.817243 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73dc4e-e6c9-43bd-90a8-0407f7469ae3 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:43.817960 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73dc4e-e6c9-43bd-90a8-0407f7469ae3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:43.818261 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73dc4e-e6c9-43bd-90a8-0407f7469ae3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:43.819862 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73dc4e-e6c9-43bd-90a8-0407f7469ae3 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:43.824429 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d713b-2b52-4feb-9b25-510e9d0426e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:43.825227 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d713b-2b52-4feb-9b25-510e9d0426e4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:43.825509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d713b-2b52-4feb-9b25-510e9d0426e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:43.825785 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d713b-2b52-4feb-9b25-510e9d0426e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:43.832449 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 343/690] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:43.833433 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73dc4e-e6c9-43bd-90a8-0407f7469ae3 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:43.836444 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d713b-2b52-4feb-9b25-510e9d0426e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:43.838000 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d713b-2b52-4feb-9b25-510e9d0426e4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:43.847099 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:43.857763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-896d713b-2b52-4feb-9b25-510e9d0426e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:43.857763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:43.857763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:43.857763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:43.857763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:43.857763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:43.857763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:43.857763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:43.857763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:43.857763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:43.857763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:43.857763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:43.857763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:43.857763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:43.857763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:43.858752 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:43.858752 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:43.858752 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:43.858752 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:43.858752 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:43.858752 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:43.858752 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:43.858752 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:43.858752 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:43.858752 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:43.858752 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:43.858752 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:43.858752 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:43.858752 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:43.858752 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:43.858752 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:43.858752 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:43.859676 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:43.859676 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:43.859676 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:43.859676 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:43.864172 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 348/691] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:43.865040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d713b-2b52-4feb-9b25-510e9d0426e4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:43.906420 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:43.938023 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73dc4e-e6c9-43bd-90a8-0407f7469ae3 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:43.975156 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d713b-2b52-4feb-9b25-510e9d0426e4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:43.976091 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5cedf-5c2f-4c44-9011-cf7a4e98e61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:43.976844 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5cedf-5c2f-4c44-9011-cf7a4e98e61c None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:43.977175 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5cedf-5c2f-4c44-9011-cf7a4e98e61c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:43.977491 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5cedf-5c2f-4c44-9011-cf7a4e98e61c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:43.979138 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5cedf-5c2f-4c44-9011-cf7a4e98e61c None admin] RBAC: Adding query filter params (role.id=d775f350758d4eb8bfceeeb91e54351f, scope.project.id=4bc610fb6724419dac99f2483089c783, user.id=5e5be3de52e945d3af1b2cad1c84c755) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:43.979138 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5cedf-5c2f-4c44-9011-cf7a4e98e61c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:43.980292 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5cedf-5c2f-4c44-9011-cf7a4e98e61c None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:43.986818 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 344/692] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:43:43 2022] GET /identity/v3/role_assignments?user.id=5e5be3de52e945d3af1b2cad1c84c755&scope.project.id=4bc610fb6724419dac99f2483089c783&role.id=d775f350758d4eb8bfceeeb91e54351f => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:43.987709 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5cedf-5c2f-4c44-9011-cf7a4e98e61c None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:44.014789 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43b836-9bf7-4898-8879-9822fd4bf65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:44.016029 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43b836-9bf7-4898-8879-9822fd4bf65a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:44.016472 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43b836-9bf7-4898-8879-9822fd4bf65a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:44.016896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43b836-9bf7-4898-8879-9822fd4bf65a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:44.025549 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43b836-9bf7-4898-8879-9822fd4bf65a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:44.027405 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43b836-9bf7-4898-8879-9822fd4bf65a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:44.042923 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-8d43b836-9bf7-4898-8879-9822fd4bf65a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:44.042923 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:44.042923 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:44.042923 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:44.042923 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:44.042923 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:44.042923 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:44.042923 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:44.042923 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:44.042923 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:44.042923 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:44.042923 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:44.042923 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:43:44.042923 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:43:44.042923 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:43:44.044101 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:43:44.044101 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:44.044101 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:44.044101 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:44.044101 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:44.044101 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:44.044101 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:44.044101 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:44.044101 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:44.044101 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:44.044101 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:44.044101 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:44.044101 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:44.044101 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:44.044101 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:44.044101 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:44.044101 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:44.045216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:43:44.045216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:43:44.045216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:43:44.045216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:43:44.045216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:43:44.045216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:43:44.045216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:44.045216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:44.047574 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 349/693] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:43:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:44.055328 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43b836-9bf7-4898-8879-9822fd4bf65a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:44.144838 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5cedf-5c2f-4c44-9011-cf7a4e98e61c None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:44.150546 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:44.182828 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80beb1-3215-47f0-8c40-dbdf867ed3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:44.183954 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80beb1-3215-47f0-8c40-dbdf867ed3ad None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:44.184442 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80beb1-3215-47f0-8c40-dbdf867ed3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:44.184924 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80beb1-3215-47f0-8c40-dbdf867ed3ad None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:44.185883 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80beb1-3215-47f0-8c40-dbdf867ed3ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:44.186386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80beb1-3215-47f0-8c40-dbdf867ed3ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:44.188096 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80beb1-3215-47f0-8c40-dbdf867ed3ad None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:44.190972 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:44.197288 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43b836-9bf7-4898-8879-9822fd4bf65a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:44.202823 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 345/694] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:44.204582 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62aaf9e-ff5d-47eb-9ddf-b9234ae7f4a7 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:44.204847 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62aaf9e-ff5d-47eb-9ddf-b9234ae7f4a7 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:44.205120 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62aaf9e-ff5d-47eb-9ddf-b9234ae7f4a7 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:44.206583 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 346/695] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:44.207894 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62aaf9e-ff5d-47eb-9ddf-b9234ae7f4a7 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:44.237934 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b31980-0f3d-4d92-ad20-e4e0951d5f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:44.238652 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b31980-0f3d-4d92-ad20-e4e0951d5f00 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:44.238932 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b31980-0f3d-4d92-ad20-e4e0951d5f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:44.239231 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b31980-0f3d-4d92-ad20-e4e0951d5f00 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:44.240193 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b31980-0f3d-4d92-ad20-e4e0951d5f00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:44.240503 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b31980-0f3d-4d92-ad20-e4e0951d5f00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:44.242112 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b31980-0f3d-4d92-ad20-e4e0951d5f00 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:44.261237 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 350/696] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:43:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:44.261237 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1765df-06f2-40eb-abca-ba716639d970 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:44.261237 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1765df-06f2-40eb-abca-ba716639d970 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:44.261237 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1765df-06f2-40eb-abca-ba716639d970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:44.274683 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-1e1765df-06f2-40eb-abca-ba716639d970 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:44.275946 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1e1765df-06f2-40eb-abca-ba716639d970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:44.334175 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62aaf9e-ff5d-47eb-9ddf-b9234ae7f4a7 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:44.345138 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 351/697] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:44.351857 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1765df-06f2-40eb-abca-ba716639d970 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:44.370306 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602e113-1854-437c-bb86-f3ee1b28f8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:44.371214 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602e113-1854-437c-bb86-f3ee1b28f8a4 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:44.371607 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602e113-1854-437c-bb86-f3ee1b28f8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:44.372246 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602e113-1854-437c-bb86-f3ee1b28f8a4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:44.380232 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602e113-1854-437c-bb86-f3ee1b28f8a4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:44.381772 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602e113-1854-437c-bb86-f3ee1b28f8a4 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:44.398604 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-a602e113-1854-437c-bb86-f3ee1b28f8a4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 05:43:44.398604 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:44.398604 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:44.398604 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:44.398604 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:44.398604 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:44.398604 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:44.398604 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:44.398604 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:44.398604 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:44.398604 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:44.398604 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:44.398604 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:43:44.398604 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:43:44.398604 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:43:44.398604 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:43:44.399799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:44.399799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:44.399799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:43:44.399799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:44.399799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:43:44.399799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:44.399799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:44.399799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:44.399799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:44.399799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:44.399799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:44.399799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:44.399799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:44.399799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:44.399799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:44.399799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:44.399799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:44.399799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:44.401069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:44.401069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:44.401069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:43:44.401069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:43:44.401069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:43:44.401069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:43:44.401069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:43:44.401069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:43:44.401069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 05:43:44.401069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:44.402170 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 347/698] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jul 4 05:43:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:44.402879 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602e113-1854-437c-bb86-f3ee1b28f8a4 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:44.427633 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:44.475989 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:44.485752 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1765df-06f2-40eb-abca-ba716639d970 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:44.521876 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e849b-e64f-468c-aef4-540a445b53ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:44.522779 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e849b-e64f-468c-aef4-540a445b53ba None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:44.523282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e849b-e64f-468c-aef4-540a445b53ba None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:44.523699 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e849b-e64f-468c-aef4-540a445b53ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:44.524666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e849b-e64f-468c-aef4-540a445b53ba None admin] RBAC: Adding query filter params (role.id=d775f350758d4eb8bfceeeb91e54351f, scope.project.id=4bc610fb6724419dac99f2483089c783, user.id=e55a1c343c60428db2d9e5e6ed865e21) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:44.525106 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e849b-e64f-468c-aef4-540a445b53ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:44.526748 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e849b-e64f-468c-aef4-540a445b53ba None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:44.533846 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 352/699] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:43:44 2022] GET /identity/v3/role_assignments?user.id=e55a1c343c60428db2d9e5e6ed865e21&scope.project.id=4bc610fb6724419dac99f2483089c783&role.id=d775f350758d4eb8bfceeeb91e54351f => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:44.534952 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e849b-e64f-468c-aef4-540a445b53ba None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:44.542954 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602e113-1854-437c-bb86-f3ee1b28f8a4 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:44.612117 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f85f9-f06a-40c1-aa92-31c2949670f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:44.613043 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f85f9-f06a-40c1-aa92-31c2949670f1 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:44.613433 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f85f9-f06a-40c1-aa92-31c2949670f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:44.613797 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f85f9-f06a-40c1-aa92-31c2949670f1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:44.614558 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f85f9-f06a-40c1-aa92-31c2949670f1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:44.616067 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f85f9-f06a-40c1-aa92-31c2949670f1 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:44.645481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-e74f85f9-f06a-40c1-aa92-31c2949670f1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 05:43:44.645481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:44.645481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 05:43:44.645481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 05:43:44.645481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 05:43:44.645481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 05:43:44.645481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 05:43:44.645481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:43:44.645481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 05:43:44.645481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:44.645481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 05:43:44.645481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:44.645481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:44.645481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:44.645481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:44.645481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:44.646741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:44.646741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:44.646741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:44.646741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:44.646741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:44.646741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:44.646741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:44.646741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 05:43:44.646741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 05:43:44.646741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 05:43:44.646741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 05:43:44.646741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:44.646741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:44.646741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:44.646741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:44.646741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:44.647896 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:44.647896 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:44.647896 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:44.647896 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:44.647896 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:44.647896 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:44.647896 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:44.647896 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:44.647896 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:44.647896 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:44.647896 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:44.647896 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 05:43:44.647896 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:43:44.647896 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 05:43:44.647896 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:44.647896 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 348/700] 10.222.0.16 () {56 vars in 1129 bytes} [Mon Jul 4 05:43:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:44.650318 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e849b-e64f-468c-aef4-540a445b53ba None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:44.652950 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f85f9-f06a-40c1-aa92-31c2949670f1 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:44.666985 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:44.690358 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a02c7-4d83-41c8-a2de-078ee6248f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:44.691329 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a02c7-4d83-41c8-a2de-078ee6248f4d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:44.691793 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a02c7-4d83-41c8-a2de-078ee6248f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:44.692233 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a02c7-4d83-41c8-a2de-078ee6248f4d None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:44.693256 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a02c7-4d83-41c8-a2de-078ee6248f4d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:44.693724 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a02c7-4d83-41c8-a2de-078ee6248f4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:44.695353 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a02c7-4d83-41c8-a2de-078ee6248f4d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:44.715891 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 353/701] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jul 4 05:43:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:44.721095 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a02c7-4d83-41c8-a2de-078ee6248f4d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:44.824854 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f85f9-f06a-40c1-aa92-31c2949670f1 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:44.853474 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:44.853680 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a02c7-4d83-41c8-a2de-078ee6248f4d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:44.879219 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d7107-a929-4d5e-8b51-c9ebcdf0a58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:44.879953 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d7107-a929-4d5e-8b51-c9ebcdf0a58f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:44.880231 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d7107-a929-4d5e-8b51-c9ebcdf0a58f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:44.880502 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d7107-a929-4d5e-8b51-c9ebcdf0a58f None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:44.881488 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d7107-a929-4d5e-8b51-c9ebcdf0a58f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:44.882060 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d7107-a929-4d5e-8b51-c9ebcdf0a58f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:44.884130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d7107-a929-4d5e-8b51-c9ebcdf0a58f None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:44.894972 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 349/702] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Jul 4 05:43:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:43:44.896604 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d7107-a929-4d5e-8b51-c9ebcdf0a58f None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:44.898759 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465baf4b-3b8d-4105-94be-3ba829e62886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:44.899596 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465baf4b-3b8d-4105-94be-3ba829e62886 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:44.900236 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465baf4b-3b8d-4105-94be-3ba829e62886 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:44.900683 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465baf4b-3b8d-4105-94be-3ba829e62886 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:44.954899 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:44.989189 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465baf4b-3b8d-4105-94be-3ba829e62886 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:44.991009 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465baf4b-3b8d-4105-94be-3ba829e62886 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:45.012801 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d7107-a929-4d5e-8b51-c9ebcdf0a58f None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:45.051643 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4d548-90b4-466f-a23c-2edc203f8b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:45.052727 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4d548-90b4-466f-a23c-2edc203f8b60 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:45.053817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4d548-90b4-466f-a23c-2edc203f8b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:45.054301 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4d548-90b4-466f-a23c-2edc203f8b60 None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:45.055342 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4d548-90b4-466f-a23c-2edc203f8b60 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:45.055976 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4d548-90b4-466f-a23c-2edc203f8b60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:45.057727 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4d548-90b4-466f-a23c-2edc203f8b60 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:45.071338 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 350/703] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Jul 4 05:43:44 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:43:45.106987 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 354/704] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:43:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 04 05:43:45.112198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4d548-90b4-466f-a23c-2edc203f8b60 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:45.169557 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:45.224980 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4d548-90b4-466f-a23c-2edc203f8b60 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:45.263616 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e62a58-1c4f-40a3-a6e0-7bf7fcb7893f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:45.264418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e62a58-1c4f-40a3-a6e0-7bf7fcb7893f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:45.264696 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e62a58-1c4f-40a3-a6e0-7bf7fcb7893f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:45.264968 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e62a58-1c4f-40a3-a6e0-7bf7fcb7893f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:45.276184 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e62a58-1c4f-40a3-a6e0-7bf7fcb7893f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:45.277645 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e62a58-1c4f-40a3-a6e0-7bf7fcb7893f None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:45.295620 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-b8e62a58-1c4f-40a3-a6e0-7bf7fcb7893f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:45.295620 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:45.295620 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:45.295620 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:45.295620 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:45.295620 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:45.295620 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:45.295620 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:45.295620 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:45.295620 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:45.295620 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:45.295620 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:45.295620 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:45.295620 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:45.295620 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:45.296548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:45.296548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:45.296548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:45.296548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:45.296548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:45.296548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:45.296548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:45.296548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:45.296548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:45.296548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:45.296548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:45.296548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:45.296548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:45.296548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:45.296548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:45.296548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:45.296548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:45.297625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:45.297625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:45.297625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:45.297625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:45.297625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 351/705] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:43:45.302321 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465baf4b-3b8d-4105-94be-3ba829e62886 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:45.377835 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:45.413695 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465baf4b-3b8d-4105-94be-3ba829e62886 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:45.452147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7c46e-81b7-43f9-8f2c-34d6030c844f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:45.452722 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7c46e-81b7-43f9-8f2c-34d6030c844f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:45.452997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7c46e-81b7-43f9-8f2c-34d6030c844f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:45.453267 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7c46e-81b7-43f9-8f2c-34d6030c844f None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:45.453979 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e7c46e-81b7-43f9-8f2c-34d6030c844f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:45.454278 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e7c46e-81b7-43f9-8f2c-34d6030c844f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:45.455677 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e7c46e-81b7-43f9-8f2c-34d6030c844f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:45.463905 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19715fb-6a8d-4bfc-b3e2-2c55f07a7908 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:45.464193 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19715fb-6a8d-4bfc-b3e2-2c55f07a7908 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:45.464474 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19715fb-6a8d-4bfc-b3e2-2c55f07a7908 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:45.466110 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 352/706] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:45.467815 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 355/707] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:45.472815 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19715fb-6a8d-4bfc-b3e2-2c55f07a7908 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:45.476667 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf9c16-cac7-4e17-abbb-7a62217f2ac0 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:45.476962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf9c16-cac7-4e17-abbb-7a62217f2ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:45.477245 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf9c16-cac7-4e17-abbb-7a62217f2ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:45.494176 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-17bf9c16-cac7-4e17-abbb-7a62217f2ac0 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:45.495478 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-17bf9c16-cac7-4e17-abbb-7a62217f2ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:45.579421 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 356/708] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:45.604467 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf9c16-cac7-4e17-abbb-7a62217f2ac0 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:45.702612 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19715fb-6a8d-4bfc-b3e2-2c55f07a7908 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:45.714194 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:45.721301 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:45.771381 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf9c16-cac7-4e17-abbb-7a62217f2ac0 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:45.776434 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb8205-7160-4007-8a2a-4ee310e01531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:45.777639 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb8205-7160-4007-8a2a-4ee310e01531 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:45.778927 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb8205-7160-4007-8a2a-4ee310e01531 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:45.779435 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb8205-7160-4007-8a2a-4ee310e01531 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:45.793652 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb8205-7160-4007-8a2a-4ee310e01531 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:45.796483 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb8205-7160-4007-8a2a-4ee310e01531 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:45.822185 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-f5cb8205-7160-4007-8a2a-4ee310e01531 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:45.822185 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:45.822185 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:45.822185 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:45.822185 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:45.822185 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:45.822185 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:45.822185 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:45.822185 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:45.822185 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:45.822185 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:45.822185 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:45.822185 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:43:45.822185 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:43:45.822185 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:43:45.823929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:43:45.823929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:45.823929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:45.823929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:45.823929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:45.823929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:45.823929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:45.823929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:45.823929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:45.823929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:45.823929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:45.823929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:45.823929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:45.823929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:45.823929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:45.823929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:45.823929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:45.825671 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:43:45.825671 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:43:45.825671 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:43:45.825671 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:43:45.825671 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:43:45.825671 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:43:45.825671 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:45.825671 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:45.830000 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 353/709] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:43:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:45.836066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb8205-7160-4007-8a2a-4ee310e01531 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:45.874972 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e52fd-e796-4084-8886-709483a2514e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:45.875811 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e52fd-e796-4084-8886-709483a2514e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:45.876139 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e52fd-e796-4084-8886-709483a2514e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:45.876293 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e52fd-e796-4084-8886-709483a2514e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:45.901229 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e52fd-e796-4084-8886-709483a2514e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:45.902692 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e52fd-e796-4084-8886-709483a2514e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:45.936343 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-d87e52fd-e796-4084-8886-709483a2514e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:45.936343 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:45.936343 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:45.936343 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:45.936343 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:45.936343 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:45.936343 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:45.936343 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:45.936343 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:45.936343 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:45.936343 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:45.936343 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:45.936343 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:45.936343 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:45.936343 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:45.938211 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:45.938211 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:45.938211 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:45.938211 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:45.938211 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:45.938211 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:45.938211 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:45.938211 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:45.938211 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:45.938211 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:45.938211 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:45.938211 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:45.938211 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:45.938211 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:45.938211 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:45.938211 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:45.938211 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:45.939992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:45.939992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:45.939992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:45.939992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:45.947350 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 357/710] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:45.948260 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e52fd-e796-4084-8886-709483a2514e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:46.031522 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb8205-7160-4007-8a2a-4ee310e01531 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:46.101959 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87acbd1b-414f-4a3d-923f-6f4204d845c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:46.103599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acbd1b-414f-4a3d-923f-6f4204d845c9 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:46.104461 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acbd1b-414f-4a3d-923f-6f4204d845c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:46.105357 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acbd1b-414f-4a3d-923f-6f4204d845c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:46.107241 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acbd1b-414f-4a3d-923f-6f4204d845c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:46.108072 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acbd1b-414f-4a3d-923f-6f4204d845c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:46.117931 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acbd1b-414f-4a3d-923f-6f4204d845c9 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:46.135220 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e52fd-e796-4084-8886-709483a2514e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:46.152601 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:46.155717 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 354/711] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:43:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:46.164099 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87acbd1b-414f-4a3d-923f-6f4204d845c9 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:46.188856 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11278c3f-02c5-4e6c-a0c7-875af7e8c857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:46.189529 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11278c3f-02c5-4e6c-a0c7-875af7e8c857 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:46.189811 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11278c3f-02c5-4e6c-a0c7-875af7e8c857 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:46.190086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11278c3f-02c5-4e6c-a0c7-875af7e8c857 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:46.191027 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11278c3f-02c5-4e6c-a0c7-875af7e8c857 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:46.191357 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11278c3f-02c5-4e6c-a0c7-875af7e8c857 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:46.192757 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11278c3f-02c5-4e6c-a0c7-875af7e8c857 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:46.199906 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:46.218859 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 358/712] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:46.229265 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11278c3f-02c5-4e6c-a0c7-875af7e8c857 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:46.338521 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87acbd1b-414f-4a3d-923f-6f4204d845c9 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:46.382906 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa4545-b8c3-4638-af81-864c7ca7bd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:46.383998 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa4545-b8c3-4638-af81-864c7ca7bd78 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:46.384508 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa4545-b8c3-4638-af81-864c7ca7bd78 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:46.385059 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa4545-b8c3-4638-af81-864c7ca7bd78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:46.386085 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa4545-b8c3-4638-af81-864c7ca7bd78 None admin] RBAC: Adding query filter params (role.id=6c5b161dbf33447fa1d383915d3c9382, scope.project.id=4bc610fb6724419dac99f2483089c783, user.id=6f638cc70c994a529a48cb2c92b70384) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:46.386602 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa4545-b8c3-4638-af81-864c7ca7bd78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:46.388320 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa4545-b8c3-4638-af81-864c7ca7bd78 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:46.399685 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 355/713] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:43:46 2022] GET /identity/v3/role_assignments?user.id=6f638cc70c994a529a48cb2c92b70384&scope.project.id=4bc610fb6724419dac99f2483089c783&role.id=6c5b161dbf33447fa1d383915d3c9382 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:46.401780 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d220a-a5e8-4bde-9df2-ae939d8f335a None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:46.402274 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d220a-a5e8-4bde-9df2-ae939d8f335a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:46.402742 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d220a-a5e8-4bde-9df2-ae939d8f335a None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:46.405524 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 356/714] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:46.409842 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129dd98-a2ed-461d-95e1-814f6569716c None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:46.410420 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129dd98-a2ed-461d-95e1-814f6569716c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:46.410940 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129dd98-a2ed-461d-95e1-814f6569716c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:46.412271 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11278c3f-02c5-4e6c-a0c7-875af7e8c857 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:46.439420 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d129dd98-a2ed-461d-95e1-814f6569716c None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:46.441190 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d129dd98-a2ed-461d-95e1-814f6569716c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:46.451447 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537fccf-62ab-47f5-a97d-d2cf164327bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:46.452065 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537fccf-62ab-47f5-a97d-d2cf164327bd None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:46.452348 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537fccf-62ab-47f5-a97d-d2cf164327bd None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:46.452629 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537fccf-62ab-47f5-a97d-d2cf164327bd None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:46.453344 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537fccf-62ab-47f5-a97d-d2cf164327bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:46.454838 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537fccf-62ab-47f5-a97d-d2cf164327bd None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:46.496207 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 359/715] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 4 05:43:46 2022] POST /identity/v3/users => generated 254 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:43:46.581044 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 357/716] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:46.618274 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537fccf-62ab-47f5-a97d-d2cf164327bd None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:46.668930 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:46.753586 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537fccf-62ab-47f5-a97d-d2cf164327bd None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:46.789213 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84552e-e6c3-41e9-8511-d5ec8cd9f3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:46.790023 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84552e-e6c3-41e9-8511-d5ec8cd9f3ad None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:46.790305 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84552e-e6c3-41e9-8511-d5ec8cd9f3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:46.790577 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84552e-e6c3-41e9-8511-d5ec8cd9f3ad None admin] PATH_INFO: `/v3/services/network` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:46.791289 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84552e-e6c3-41e9-8511-d5ec8cd9f3ad None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:46.792686 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84552e-e6c3-41e9-8511-d5ec8cd9f3ad None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:46.806674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-8e84552e-e6c3-41e9-8511-d5ec8cd9f3ad None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 05:43:46.806674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:46.806674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 05:43:46.806674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 05:43:46.806674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 05:43:46.806674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 05:43:46.806674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 05:43:46.806674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:43:46.806674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 05:43:46.806674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:46.806674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 05:43:46.806674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:46.806674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:46.806674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:46.806674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:46.806674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:46.806674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:46.807795 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:46.807795 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:46.807795 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:46.807795 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:46.807795 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:46.807795 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:46.807795 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 05:43:46.807795 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 05:43:46.807795 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 05:43:46.807795 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 05:43:46.807795 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:46.807795 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:46.807795 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:46.807795 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:46.807795 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:46.807795 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:46.809085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:46.809085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:46.809085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:46.809085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:46.809085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:46.809085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:46.809085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:46.809085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:46.809085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:46.809085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:46.809085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 05:43:46.809085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:43:46.809085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 05:43:46.809085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:46.809085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 360/717] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:43:46 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:46.814101 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129dd98-a2ed-461d-95e1-814f6569716c None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:46.834359 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:46.930738 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129dd98-a2ed-461d-95e1-814f6569716c None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:46.969802 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b769f6e-6e32-4a7f-b538-2d86232023d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:46.970484 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b769f6e-6e32-4a7f-b538-2d86232023d8 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:46.970768 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b769f6e-6e32-4a7f-b538-2d86232023d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:46.971044 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b769f6e-6e32-4a7f-b538-2d86232023d8 None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:46.971794 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b769f6e-6e32-4a7f-b538-2d86232023d8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:46.972101 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b769f6e-6e32-4a7f-b538-2d86232023d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:46.973490 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b769f6e-6e32-4a7f-b538-2d86232023d8 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:46.978694 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 358/718] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 4 05:43:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:46.983982 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84552e-e6c3-41e9-8511-d5ec8cd9f3ad None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:47.140866 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:47.151328 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84552e-e6c3-41e9-8511-d5ec8cd9f3ad None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:47.192815 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181b9d9-ab80-4681-a06d-6cb071ad23f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:47.193401 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181b9d9-ab80-4681-a06d-6cb071ad23f1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:47.193679 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181b9d9-ab80-4681-a06d-6cb071ad23f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:47.193949 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181b9d9-ab80-4681-a06d-6cb071ad23f1 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:47.194654 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181b9d9-ab80-4681-a06d-6cb071ad23f1 None admin] RBAC: Adding query filter params (type=network) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:47.194957 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181b9d9-ab80-4681-a06d-6cb071ad23f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:47.196386 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181b9d9-ab80-4681-a06d-6cb071ad23f1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:47.204223 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 361/719] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 4 05:43:46 2022] GET /identity/v3/services?type=network => generated 124 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:47.522550 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109496a-7854-4bfb-892a-6961da01766f None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:47.528893 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109496a-7854-4bfb-892a-6961da01766f None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:47.529417 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109496a-7854-4bfb-892a-6961da01766f None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:47.531375 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 359/720] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:47 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:47.537038 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1d905-4556-4aad-a20f-fbe56dd7cf9b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:47.537038 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1d905-4556-4aad-a20f-fbe56dd7cf9b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:47.537272 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1d905-4556-4aad-a20f-fbe56dd7cf9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:47.559594 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-27c1d905-4556-4aad-a20f-fbe56dd7cf9b None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:47.560801 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-27c1d905-4556-4aad-a20f-fbe56dd7cf9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:47.649156 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 362/721] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:47.692720 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109496a-7854-4bfb-892a-6961da01766f None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:47.804614 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:47.835870 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109496a-7854-4bfb-892a-6961da01766f None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:47.881205 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607ac54-4d63-4876-b995-1f71354b96ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:47.882015 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607ac54-4d63-4876-b995-1f71354b96ac None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:47.882379 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607ac54-4d63-4876-b995-1f71354b96ac None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:47.882666 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607ac54-4d63-4876-b995-1f71354b96ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:47.884278 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfc6f6-f6b4-405b-b5a8-4173f52ebb4f None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:47.884566 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfc6f6-f6b4-405b-b5a8-4173f52ebb4f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:47.884839 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfc6f6-f6b4-405b-b5a8-4173f52ebb4f None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:47.886560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 363/722] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:47.891392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de0aa6-564f-4274-9c7a-f7865864e44b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:47.891680 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de0aa6-564f-4274-9c7a-f7865864e44b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:47.891965 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de0aa6-564f-4274-9c7a-f7865864e44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:47.906860 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607ac54-4d63-4876-b995-1f71354b96ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:47.916418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-3607ac54-4d63-4876-b995-1f71354b96ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:43:47.916418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:47.916418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:47.916418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:47.916418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:47.916418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:47.916418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:47.916418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:47.916418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:47.916418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:47.916418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:47.916418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:47.916418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:47.916418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:47.916418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:47.916418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:47.917327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:47.917327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:47.917327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:47.917327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:47.917327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:47.917327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:47.917327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:47.917327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:47.917327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:47.917327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:47.917327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:47.917327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:47.917327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:47.917327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:47.917327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:47.917327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:47.918165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:47.918165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:47.918165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:47.918165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:47.918165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:47.918165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:47.918165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:47.918165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:47.918165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:47.918165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:47.918165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:43:47.918165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:47.921884 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-39de0aa6-564f-4274-9c7a-f7865864e44b None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:47.922474 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 360/723] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:43:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:47.923197 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-39de0aa6-564f-4274-9c7a-f7865864e44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:47.924156 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607ac54-4d63-4876-b995-1f71354b96ac None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:48.039070 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607ac54-4d63-4876-b995-1f71354b96ac None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:48.043628 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 364/724] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 05:43:48.094772 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36f517-ba7a-4581-a46a-f42028121f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:48.095536 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36f517-ba7a-4581-a46a-f42028121f21 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:48.095822 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36f517-ba7a-4581-a46a-f42028121f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:48.096143 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36f517-ba7a-4581-a46a-f42028121f21 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:48.096899 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac36f517-ba7a-4581-a46a-f42028121f21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:48.097204 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac36f517-ba7a-4581-a46a-f42028121f21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:48.098681 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac36f517-ba7a-4581-a46a-f42028121f21 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:48.104559 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:48.114445 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 361/725] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:43:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:48.115283 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de0aa6-564f-4274-9c7a-f7865864e44b None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:48.120046 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36f517-ba7a-4581-a46a-f42028121f21 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:48.151542 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:48.264829 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de0aa6-564f-4274-9c7a-f7865864e44b None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:48.281166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36f517-ba7a-4581-a46a-f42028121f21 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:48.323753 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23843413-45b3-42be-8b9a-245db77857b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:48.324605 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23843413-45b3-42be-8b9a-245db77857b0 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:48.324835 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23843413-45b3-42be-8b9a-245db77857b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:48.325106 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23843413-45b3-42be-8b9a-245db77857b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:48.326258 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363aa7f-6691-4d1b-b2e7-db126b8bf0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:48.326919 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363aa7f-6691-4d1b-b2e7-db126b8bf0bf None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:48.327206 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363aa7f-6691-4d1b-b2e7-db126b8bf0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:48.327484 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363aa7f-6691-4d1b-b2e7-db126b8bf0bf None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:48.328216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363aa7f-6691-4d1b-b2e7-db126b8bf0bf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:48.329606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363aa7f-6691-4d1b-b2e7-db126b8bf0bf None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:48.341820 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23843413-45b3-42be-8b9a-245db77857b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:48.343749 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23843413-45b3-42be-8b9a-245db77857b0 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:48.361891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-23843413-45b3-42be-8b9a-245db77857b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:48.361891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:48.361891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:48.361891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:48.361891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:48.361891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:48.361891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:48.361891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:48.361891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:48.361891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:48.361891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:48.361891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:48.361891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:48.361891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:48.361891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:48.362789 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:48.362789 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:48.362789 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:48.362789 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:48.362789 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:48.362789 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:48.362789 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:48.362789 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:48.362789 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:48.362789 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:48.362789 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:48.362789 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:48.362789 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:48.362789 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:48.362789 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:48.362789 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:48.362789 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:48.363707 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:48.363707 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:48.363707 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:48.363707 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:48.363707 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 362/727] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:48.363989 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 365/727] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 4 05:43:48 2022] POST /identity/v3/services => generated 251 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:43:48.377501 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23843413-45b3-42be-8b9a-245db77857b0 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:48.461421 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:48.541533 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23843413-45b3-42be-8b9a-245db77857b0 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:48.592255 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13132e-c1f1-40b9-9642-5cdbafbf714f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:48.592993 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13132e-c1f1-40b9-9642-5cdbafbf714f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:48.593280 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13132e-c1f1-40b9-9642-5cdbafbf714f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:48.593609 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13132e-c1f1-40b9-9642-5cdbafbf714f None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:48.594339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13132e-c1f1-40b9-9642-5cdbafbf714f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:48.594647 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13132e-c1f1-40b9-9642-5cdbafbf714f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:48.596057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13132e-c1f1-40b9-9642-5cdbafbf714f None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:48.608767 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 363/728] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:48.614356 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363aa7f-6691-4d1b-b2e7-db126b8bf0bf None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:48.704150 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:48.729789 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363aa7f-6691-4d1b-b2e7-db126b8bf0bf None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:48.768252 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa287ae-1764-4e55-99ee-e64cdd432fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:48.769081 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa287ae-1764-4e55-99ee-e64cdd432fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:48.769359 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa287ae-1764-4e55-99ee-e64cdd432fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:48.769632 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa287ae-1764-4e55-99ee-e64cdd432fb3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:48.778617 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa287ae-1764-4e55-99ee-e64cdd432fb3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:48.780134 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa287ae-1764-4e55-99ee-e64cdd432fb3 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:48.795739 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-eaa287ae-1764-4e55-99ee-e64cdd432fb3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 04 05:43:48.795739 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:48.795739 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:48.795739 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:48.795739 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:48.795739 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:48.795739 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:48.795739 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:48.795739 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:48.795739 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:48.795739 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:48.795739 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:48.795739 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:43:48.795739 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:43:48.795739 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:43:48.795739 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:43:48.796729 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:48.796729 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:48.796729 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:43:48.796729 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:48.796729 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:43:48.796729 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:48.796729 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:48.796729 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:48.796729 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:48.796729 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:48.796729 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:48.796729 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:48.796729 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:48.796729 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:48.796729 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:48.796729 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:48.796729 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:48.796729 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:48.797674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:48.797674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:48.797674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:43:48.797674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:43:48.797674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:43:48.797674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:43:48.797674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:43:48.797674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:43:48.797674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 04 05:43:48.797674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:48.797674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 366/729] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:43:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:48.802902 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13132e-c1f1-40b9-9642-5cdbafbf714f None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:48.808332 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ac86c-462a-424e-b09c-93ce889b668c None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:48.808616 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ac86c-462a-424e-b09c-93ce889b668c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:48.808896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ac86c-462a-424e-b09c-93ce889b668c None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:48.810513 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 367/730] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:43:48.815466 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fede090-c4a7-4a99-a11e-60024d59cd38 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:48.815854 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fede090-c4a7-4a99-a11e-60024d59cd38 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:48.816221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fede090-c4a7-4a99-a11e-60024d59cd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:48.837426 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-0fede090-c4a7-4a99-a11e-60024d59cd38 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:48.838806 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0fede090-c4a7-4a99-a11e-60024d59cd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:48.914118 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13132e-c1f1-40b9-9642-5cdbafbf714f None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:48.931925 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:48.961379 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa4718-5bf2-461e-bbcf-435db07a3418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:48.962356 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa4718-5bf2-461e-bbcf-435db07a3418 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:48.962783 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa4718-5bf2-461e-bbcf-435db07a3418 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:48.963376 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa4718-5bf2-461e-bbcf-435db07a3418 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:48.964420 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa4718-5bf2-461e-bbcf-435db07a3418 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:48.964874 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa4718-5bf2-461e-bbcf-435db07a3418 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:48.966600 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa4718-5bf2-461e-bbcf-435db07a3418 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:48.984724 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 368/731] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:48 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 05:43:48.985653 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 364/732] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Jul 4 05:43:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:48.991210 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fede090-c4a7-4a99-a11e-60024d59cd38 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:49.008083 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa4718-5bf2-461e-bbcf-435db07a3418 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:49.099477 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:49.138957 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fede090-c4a7-4a99-a11e-60024d59cd38 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:49.179794 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e89a4b-60c3-48bb-be8f-c3265bcad5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:49.181040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e89a4b-60c3-48bb-be8f-c3265bcad5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:49.181916 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e89a4b-60c3-48bb-be8f-c3265bcad5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:49.182396 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e89a4b-60c3-48bb-be8f-c3265bcad5b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:49.200494 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa4718-5bf2-461e-bbcf-435db07a3418 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:49.236956 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58261a3d-6e1a-46ec-a859-1b59e7c7d39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:49.238137 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58261a3d-6e1a-46ec-a859-1b59e7c7d39b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:49.238617 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58261a3d-6e1a-46ec-a859-1b59e7c7d39b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:49.239104 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58261a3d-6e1a-46ec-a859-1b59e7c7d39b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:49.251210 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58261a3d-6e1a-46ec-a859-1b59e7c7d39b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:49.257067 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e89a4b-60c3-48bb-be8f-c3265bcad5b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:49.258632 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e89a4b-60c3-48bb-be8f-c3265bcad5b8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:49.260166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-58261a3d-6e1a-46ec-a859-1b59e7c7d39b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:43:49.260166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:49.260166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:49.260166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:49.260166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:49.260166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:49.260166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:49.260166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:49.260166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:49.260166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:49.260166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:49.260166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:49.260166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:49.260166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:49.260166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:49.260166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:49.261069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:49.261069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:49.261069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:49.261069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:49.261069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:49.261069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:49.261069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:49.261069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:49.261069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:49.261069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:49.261069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:49.261069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:49.261069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:49.261069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:49.261069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:49.261069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:49.261913 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:49.261913 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:49.261913 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:49.261913 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:49.261913 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:49.261913 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:49.261913 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:49.261913 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:49.261913 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:49.261913 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:49.261913 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:43:49.261913 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:49.264959 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 365/733] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:43:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:43:49.266406 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d88605-74b2-471e-8d1e-59876c80e87e None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:49.266857 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d88605-74b2-471e-8d1e-59876c80e87e None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:49.267314 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d88605-74b2-471e-8d1e-59876c80e87e None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:49.268989 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 366/734] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:49.270352 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d88605-74b2-471e-8d1e-59876c80e87e None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:49.318883 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:49.354819 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:49.399407 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 369/735] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:43:48 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 05:43:49.399407 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f80a2-5cb6-46fb-855e-02ca554ea02a None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:49.399407 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f80a2-5cb6-46fb-855e-02ca554ea02a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:49.399407 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f80a2-5cb6-46fb-855e-02ca554ea02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:49.421351 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-332f80a2-5cb6-46fb-855e-02ca554ea02a None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:49.422354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d88605-74b2-471e-8d1e-59876c80e87e None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:49.423160 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-332f80a2-5cb6-46fb-855e-02ca554ea02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:49.470351 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535c0de-e152-4aef-b03a-5d3cf022c94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:49.471654 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535c0de-e152-4aef-b03a-5d3cf022c94f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:49.471934 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535c0de-e152-4aef-b03a-5d3cf022c94f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:49.472205 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535c0de-e152-4aef-b03a-5d3cf022c94f None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:49.473071 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535c0de-e152-4aef-b03a-5d3cf022c94f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:49.473371 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535c0de-e152-4aef-b03a-5d3cf022c94f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:49.474748 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535c0de-e152-4aef-b03a-5d3cf022c94f None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:49.484040 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 367/736] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:43:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:49.484919 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535c0de-e152-4aef-b03a-5d3cf022c94f None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:49.517864 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 370/737] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:49.519337 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f80a2-5cb6-46fb-855e-02ca554ea02a None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:49.579028 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:49.592292 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535c0de-e152-4aef-b03a-5d3cf022c94f None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:49.626936 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7d30f-017c-4aa3-a18c-1890634b1d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:49.627870 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7d30f-017c-4aa3-a18c-1890634b1d76 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:49.628145 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7d30f-017c-4aa3-a18c-1890634b1d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:49.628408 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7d30f-017c-4aa3-a18c-1890634b1d76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:49.639377 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7d30f-017c-4aa3-a18c-1890634b1d76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:49.640870 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7d30f-017c-4aa3-a18c-1890634b1d76 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:49.652893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:49.656772 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f80a2-5cb6-46fb-855e-02ca554ea02a None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:49.662812 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-13e7d30f-017c-4aa3-a18c-1890634b1d76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:49.662812 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:49.662812 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:49.662812 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:49.662812 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:49.662812 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:49.662812 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:49.662812 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:49.662812 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:49.662812 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:49.662812 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:49.662812 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:49.662812 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:49.662812 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:49.662812 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:49.663836 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:49.663836 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:49.663836 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:49.663836 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:49.663836 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:49.663836 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:49.663836 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:49.663836 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:49.663836 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:49.663836 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:49.663836 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:49.663836 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:49.663836 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:49.663836 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:49.663836 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:49.663836 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:49.663836 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:49.664750 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:49.664750 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:49.664750 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:49.664750 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:49.667455 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 368/738] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:49.668423 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7d30f-017c-4aa3-a18c-1890634b1d76 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:49.695209 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc3b38-5164-42ba-adcf-2275ff18b191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:49.696154 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc3b38-5164-42ba-adcf-2275ff18b191 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:49.696528 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc3b38-5164-42ba-adcf-2275ff18b191 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:49.696890 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc3b38-5164-42ba-adcf-2275ff18b191 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:49.707435 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc3b38-5164-42ba-adcf-2275ff18b191 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:49.709127 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc3b38-5164-42ba-adcf-2275ff18b191 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:49.726897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-e2fc3b38-5164-42ba-adcf-2275ff18b191 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:49.726897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:49.726897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:49.726897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:49.726897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:49.726897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:49.726897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:49.726897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:49.726897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:49.726897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:49.726897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:49.726897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:49.726897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:49.726897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:49.726897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:49.728086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:49.728086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:49.728086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:49.728086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:49.728086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:49.728086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:49.728086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:49.728086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:49.728086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:49.728086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:49.728086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:49.728086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:49.728086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:49.728086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:49.728086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:49.728086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:49.728086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:49.729239 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:49.729239 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:49.729239 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:49.729239 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:49.730728 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 371/739] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:49.731613 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc3b38-5164-42ba-adcf-2275ff18b191 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:49.787959 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7d30f-017c-4aa3-a18c-1890634b1d76 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:49.826273 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a07a54-aae3-473a-ac76-ac83c2f278b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:49.827094 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a07a54-aae3-473a-ac76-ac83c2f278b8 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:49.827395 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a07a54-aae3-473a-ac76-ac83c2f278b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:49.827666 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a07a54-aae3-473a-ac76-ac83c2f278b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:49.833736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc3b38-5164-42ba-adcf-2275ff18b191 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:49.836769 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:49.842959 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a07a54-aae3-473a-ac76-ac83c2f278b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:49.852208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-e1a07a54-aae3-473a-ac76-ac83c2f278b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:43:49.852208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:49.852208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:49.852208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:49.852208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:49.852208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:49.852208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:49.852208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:49.852208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:49.852208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:49.852208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:49.852208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:49.852208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:49.852208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:49.852208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:49.852208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:49.853153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:49.853153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:49.853153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:49.853153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:49.853153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:49.853153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:49.853153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:49.853153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:49.853153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:49.853153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:49.853153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:49.853153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:49.853153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:49.853153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:49.853153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:49.853153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:49.854032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:49.854032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:49.854032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:49.854032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:49.854032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:49.854032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:49.854032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:49.854032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:49.854032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:49.854032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:49.854032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:43:49.854032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:49.854032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 369/740] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 4 05:43:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:49.854709 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a07a54-aae3-473a-ac76-ac83c2f278b8 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:49.877938 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc227760-444f-4630-8627-079746e438df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:49.878637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc227760-444f-4630-8627-079746e438df None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:49.878920 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc227760-444f-4630-8627-079746e438df None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:49.879224 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc227760-444f-4630-8627-079746e438df None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:49.879960 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc227760-444f-4630-8627-079746e438df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:49.880267 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc227760-444f-4630-8627-079746e438df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:49.881697 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc227760-444f-4630-8627-079746e438df None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:49.894697 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 372/741] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:49.896059 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4bf96-ef0f-4120-ac80-f00694e857a1 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:49.896348 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4bf96-ef0f-4120-ac80-f00694e857a1 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:49.896628 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4bf96-ef0f-4120-ac80-f00694e857a1 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:49.902000 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 373/742] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:49.902000 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4bf96-ef0f-4120-ac80-f00694e857a1 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:49.917793 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:49.964470 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a07a54-aae3-473a-ac76-ac83c2f278b8 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:50.004478 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fef94f-3047-4a20-a248-48bd2ac98e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:50.005066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fef94f-3047-4a20-a248-48bd2ac98e9a None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:50.005351 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fef94f-3047-4a20-a248-48bd2ac98e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:50.005631 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fef94f-3047-4a20-a248-48bd2ac98e9a None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:50.006354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fef94f-3047-4a20-a248-48bd2ac98e9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:50.006665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fef94f-3047-4a20-a248-48bd2ac98e9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:50.008076 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fef94f-3047-4a20-a248-48bd2ac98e9a None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:50.011458 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4bf96-ef0f-4120-ac80-f00694e857a1 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:50.023573 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 370/743] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:50.024596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fef94f-3047-4a20-a248-48bd2ac98e9a None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:50.048716 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5c752-5548-4ee7-8b4a-ef4500721723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:50.049533 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5c752-5548-4ee7-8b4a-ef4500721723 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:50.049884 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5c752-5548-4ee7-8b4a-ef4500721723 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:50.050231 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5c752-5548-4ee7-8b4a-ef4500721723 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:50.051051 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b5c752-5548-4ee7-8b4a-ef4500721723 None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:50.051455 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b5c752-5548-4ee7-8b4a-ef4500721723 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:50.052860 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b5c752-5548-4ee7-8b4a-ef4500721723 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:50.061373 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 374/744] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 4 05:43:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:50.062524 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5146e-4df8-4d4c-9643-632299e6c778 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:50.062812 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5146e-4df8-4d4c-9643-632299e6c778 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:50.063091 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5146e-4df8-4d4c-9643-632299e6c778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:50.079028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-abb5146e-4df8-4d4c-9643-632299e6c778 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:50.080241 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-abb5146e-4df8-4d4c-9643-632299e6c778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:50.090963 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:50.135304 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fef94f-3047-4a20-a248-48bd2ac98e9a None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:50.149027 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 375/745] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:50 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 05:43:50.159663 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5146e-4df8-4d4c-9643-632299e6c778 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:50.161461 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:50.181563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695f582-da5e-47a0-8e0b-a8c88f1a5232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:50.182366 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695f582-da5e-47a0-8e0b-a8c88f1a5232 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:50.182671 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695f582-da5e-47a0-8e0b-a8c88f1a5232 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:50.182950 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695f582-da5e-47a0-8e0b-a8c88f1a5232 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:50.189796 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695f582-da5e-47a0-8e0b-a8c88f1a5232 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:50.191270 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695f582-da5e-47a0-8e0b-a8c88f1a5232 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:50.205608 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-9695f582-da5e-47a0-8e0b-a8c88f1a5232 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:50.205608 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:50.205608 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:50.205608 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:50.205608 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:50.205608 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:50.205608 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:50.205608 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:50.205608 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:50.205608 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:50.205608 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:50.205608 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:50.205608 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:43:50.205608 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:43:50.205608 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:43:50.206482 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:43:50.206482 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:50.206482 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:50.206482 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:50.206482 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:50.206482 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:50.206482 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:50.206482 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:50.206482 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:50.206482 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:50.206482 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:50.206482 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:50.206482 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:50.206482 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:50.206482 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:50.206482 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:50.206482 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:50.207376 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:43:50.207376 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:43:50.207376 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:43:50.207376 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:43:50.207376 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:43:50.207376 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:43:50.207376 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:50.207376 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:50.207376 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 371/746] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:43:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:50.208760 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695f582-da5e-47a0-8e0b-a8c88f1a5232 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:50.270171 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5146e-4df8-4d4c-9643-632299e6c778 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:50.306319 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1083bb7-0a0c-4ba6-a850-1702df77d8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:50.307174 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1083bb7-0a0c-4ba6-a850-1702df77d8d0 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:50.307482 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1083bb7-0a0c-4ba6-a850-1702df77d8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:50.307949 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1083bb7-0a0c-4ba6-a850-1702df77d8d0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:50.314462 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695f582-da5e-47a0-8e0b-a8c88f1a5232 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:50.314824 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1083bb7-0a0c-4ba6-a850-1702df77d8d0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:50.316318 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1083bb7-0a0c-4ba6-a850-1702df77d8d0 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:50.331411 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-b1083bb7-0a0c-4ba6-a850-1702df77d8d0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 05:43:50.331411 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:50.331411 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:50.331411 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:50.331411 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:50.331411 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:50.331411 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:50.331411 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:50.331411 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:50.331411 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:50.331411 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:50.331411 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:50.331411 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:43:50.331411 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:43:50.331411 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:43:50.331411 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:43:50.332437 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:50.332437 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:50.332437 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:43:50.332437 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:50.332437 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:43:50.332437 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:50.332437 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:50.332437 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:50.332437 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:50.332437 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:50.332437 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:50.332437 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:50.332437 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:50.332437 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:50.332437 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:50.332437 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:50.332437 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:50.332437 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:50.333360 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:50.333360 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:50.333360 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:43:50.333360 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:43:50.333360 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:43:50.333360 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:43:50.333360 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:43:50.333360 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:43:50.333360 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 05:43:50.333360 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:50.333360 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 376/747] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jul 4 05:43:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:50.333360 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1083bb7-0a0c-4ba6-a850-1702df77d8d0 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:50.342820 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:50.360876 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584da0f3-72da-4a95-bda9-00d80d5700e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:50.361932 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584da0f3-72da-4a95-bda9-00d80d5700e0 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:50.362217 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584da0f3-72da-4a95-bda9-00d80d5700e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:50.362737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584da0f3-72da-4a95-bda9-00d80d5700e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:50.376290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584da0f3-72da-4a95-bda9-00d80d5700e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:50.378195 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584da0f3-72da-4a95-bda9-00d80d5700e0 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:50.396757 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-584da0f3-72da-4a95-bda9-00d80d5700e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:50.396757 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:50.396757 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:50.396757 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:50.396757 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:50.396757 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:50.396757 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:50.396757 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:50.396757 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:50.396757 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:50.396757 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:50.396757 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:50.396757 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:50.396757 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:50.396757 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:50.397726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:50.397726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:50.397726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:50.397726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:50.397726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:50.397726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:50.397726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:50.397726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:50.397726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:50.397726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:50.397726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:50.397726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:50.397726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:50.397726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:50.397726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:50.397726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:50.397726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:50.398598 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:50.398598 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:50.398598 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:50.398598 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:50.398598 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 372/748] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:50.398870 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584da0f3-72da-4a95-bda9-00d80d5700e0 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:50.405450 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:50.450031 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1083bb7-0a0c-4ba6-a850-1702df77d8d0 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:50.486478 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9eef9f-c140-4886-8922-7cf65ba478b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:50.487053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9eef9f-c140-4886-8922-7cf65ba478b6 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:50.487380 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9eef9f-c140-4886-8922-7cf65ba478b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:50.487654 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9eef9f-c140-4886-8922-7cf65ba478b6 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:50.488371 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9eef9f-c140-4886-8922-7cf65ba478b6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:50.489757 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9eef9f-c140-4886-8922-7cf65ba478b6 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:50.502186 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584da0f3-72da-4a95-bda9-00d80d5700e0 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:50.504307 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 377/749] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 4 05:43:50 2022] POST /identity/v3/services => generated 240 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:43:50.504942 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9eef9f-c140-4886-8922-7cf65ba478b6 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:50.562415 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15866819-c5ad-4cbf-8068-29a2ba6146d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:50.563458 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15866819-c5ad-4cbf-8068-29a2ba6146d9 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:50.563751 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15866819-c5ad-4cbf-8068-29a2ba6146d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:50.564164 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15866819-c5ad-4cbf-8068-29a2ba6146d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:50.565156 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15866819-c5ad-4cbf-8068-29a2ba6146d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:50.565801 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15866819-c5ad-4cbf-8068-29a2ba6146d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:50.567268 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15866819-c5ad-4cbf-8068-29a2ba6146d9 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:50.587374 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 373/750] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:43:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:50.588543 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15866819-c5ad-4cbf-8068-29a2ba6146d9 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:50.621827 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:50.650827 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9eef9f-c140-4886-8922-7cf65ba478b6 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:50.681494 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:50.698845 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec11dc2-034b-44b5-8540-786a5250f2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:50.699552 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec11dc2-034b-44b5-8540-786a5250f2a4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:50.699837 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec11dc2-034b-44b5-8540-786a5250f2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:50.700114 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec11dc2-034b-44b5-8540-786a5250f2a4 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:50.700951 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec11dc2-034b-44b5-8540-786a5250f2a4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:50.701254 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec11dc2-034b-44b5-8540-786a5250f2a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:50.702866 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec11dc2-034b-44b5-8540-786a5250f2a4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:50.720520 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15866819-c5ad-4cbf-8068-29a2ba6146d9 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:50.721434 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 378/751] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jul 4 05:43:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:50.722275 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec11dc2-034b-44b5-8540-786a5250f2a4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:50.771683 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7c617-389c-4b84-8f2f-7ff1a403b4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:50.772798 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7c617-389c-4b84-8f2f-7ff1a403b4e8 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:50.773716 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7c617-389c-4b84-8f2f-7ff1a403b4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:50.774196 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7c617-389c-4b84-8f2f-7ff1a403b4e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:50.775599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7c617-389c-4b84-8f2f-7ff1a403b4e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:50.776364 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7c617-389c-4b84-8f2f-7ff1a403b4e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:50.778722 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7c617-389c-4b84-8f2f-7ff1a403b4e8 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:50.799352 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 374/752] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:50.800187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7c617-389c-4b84-8f2f-7ff1a403b4e8 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:50.841438 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec11dc2-034b-44b5-8540-786a5250f2a4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:50.877506 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b806928-9c5e-41e0-86e4-b4d6cafbac30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:50.878259 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b806928-9c5e-41e0-86e4-b4d6cafbac30 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:50.878548 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b806928-9c5e-41e0-86e4-b4d6cafbac30 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:50.878821 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b806928-9c5e-41e0-86e4-b4d6cafbac30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:50.879680 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b806928-9c5e-41e0-86e4-b4d6cafbac30 None admin] RBAC: Adding query filter params (role.id=6c5b161dbf33447fa1d383915d3c9382, scope.project.id=4bc610fb6724419dac99f2483089c783, user.id=e55a1c343c60428db2d9e5e6ed865e21) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:50.879992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b806928-9c5e-41e0-86e4-b4d6cafbac30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:50.881464 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b806928-9c5e-41e0-86e4-b4d6cafbac30 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:50.891271 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 379/753] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:43:50 2022] GET /identity/v3/role_assignments?user.id=e55a1c343c60428db2d9e5e6ed865e21&scope.project.id=4bc610fb6724419dac99f2483089c783&role.id=6c5b161dbf33447fa1d383915d3c9382 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:50.891271 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71685987-b52a-40f3-94ef-0f84b580a7bc None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:50.891271 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71685987-b52a-40f3-94ef-0f84b580a7bc None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:50.891271 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71685987-b52a-40f3-94ef-0f84b580a7bc None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:50.891271 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 380/754] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:50.891271 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71685987-b52a-40f3-94ef-0f84b580a7bc None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:50.906560 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:50.920606 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7c617-389c-4b84-8f2f-7ff1a403b4e8 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:50.952610 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:50.972078 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b8ca1-54e1-42e5-9bef-266fe03d23a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:50.973187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b8ca1-54e1-42e5-9bef-266fe03d23a4 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:50.973474 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b8ca1-54e1-42e5-9bef-266fe03d23a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:50.973747 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b8ca1-54e1-42e5-9bef-266fe03d23a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:50.988994 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b8ca1-54e1-42e5-9bef-266fe03d23a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:50.990621 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b8ca1-54e1-42e5-9bef-266fe03d23a4 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:51.015456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-6e0b8ca1-54e1-42e5-9bef-266fe03d23a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:51.015456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:51.015456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:51.015456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:51.015456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:51.015456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:51.015456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:51.015456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:51.015456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:51.015456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:51.015456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:51.015456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:51.015456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:51.015456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:51.015456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:51.016563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:51.016563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:51.016563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:51.016563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:51.016563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:51.016563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:51.016563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:51.016563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:51.016563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:51.016563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:51.016563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:51.016563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:51.016563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:51.016563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:51.016563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:51.016563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:51.016563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:51.017429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:51.017429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:51.017429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:51.017429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:51.017917 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 375/755] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:51.020454 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8353c-d013-46f3-9f19-cecd2b56cf15 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:51.020454 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8353c-d013-46f3-9f19-cecd2b56cf15 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:51.020454 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8353c-d013-46f3-9f19-cecd2b56cf15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:51.032049 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71685987-b52a-40f3-94ef-0f84b580a7bc None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:51.040271 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-64a8353c-d013-46f3-9f19-cecd2b56cf15 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:51.041794 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-64a8353c-d013-46f3-9f19-cecd2b56cf15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:51.078292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1487dd-ea08-4913-9356-1399f56f7ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:51.079112 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1487dd-ea08-4913-9356-1399f56f7ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:51.079419 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1487dd-ea08-4913-9356-1399f56f7ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:51.079691 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1487dd-ea08-4913-9356-1399f56f7ac7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:51.087596 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1487dd-ea08-4913-9356-1399f56f7ac7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:51.089222 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1487dd-ea08-4913-9356-1399f56f7ac7 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:51.104997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-fe1487dd-ea08-4913-9356-1399f56f7ac7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 05:43:51.104997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:51.104997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:51.104997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:51.104997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:51.104997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:51.104997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:51.104997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:51.104997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:51.104997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:51.104997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:51.104997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:51.104997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:43:51.104997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:43:51.104997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:43:51.104997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:43:51.106186 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:51.106186 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:51.106186 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:43:51.106186 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:51.106186 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:43:51.106186 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:51.106186 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:51.106186 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:51.106186 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:51.106186 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:51.106186 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:51.106186 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:51.106186 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:51.106186 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:51.106186 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:51.106186 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:51.106186 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:51.106186 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:51.107383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:51.107383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:51.107383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:43:51.107383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:43:51.107383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:43:51.107383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:43:51.107383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:43:51.107383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:43:51.107383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 05:43:51.107383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:51.110827 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 381/756] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jul 4 05:43:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:51.111691 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1487dd-ea08-4913-9356-1399f56f7ac7 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:51.123630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 376/757] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:43:51.127203 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8353c-d013-46f3-9f19-cecd2b56cf15 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:51.203589 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:51.236671 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8353c-d013-46f3-9f19-cecd2b56cf15 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:51.256631 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1487dd-ea08-4913-9356-1399f56f7ac7 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:51.260873 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:51.277959 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78241486-9057-4a8f-b9bf-a027c944deab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:51.278640 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78241486-9057-4a8f-b9bf-a027c944deab None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:51.278923 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78241486-9057-4a8f-b9bf-a027c944deab None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:51.279212 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78241486-9057-4a8f-b9bf-a027c944deab None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:51.280057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78241486-9057-4a8f-b9bf-a027c944deab None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:51.280364 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78241486-9057-4a8f-b9bf-a027c944deab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:51.281808 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78241486-9057-4a8f-b9bf-a027c944deab None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:51.301394 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 377/758] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Jul 4 05:43:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:51.301871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78241486-9057-4a8f-b9bf-a027c944deab None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:51.313810 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497505b8-1e49-4074-95c7-52f7fc4bf440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:51.314886 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497505b8-1e49-4074-95c7-52f7fc4bf440 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:51.315914 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497505b8-1e49-4074-95c7-52f7fc4bf440 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:51.316419 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497505b8-1e49-4074-95c7-52f7fc4bf440 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:51.317762 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497505b8-1e49-4074-95c7-52f7fc4bf440 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:51.318285 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497505b8-1e49-4074-95c7-52f7fc4bf440 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:51.320610 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497505b8-1e49-4074-95c7-52f7fc4bf440 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:51.337066 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 382/759] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:51.338513 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497505b8-1e49-4074-95c7-52f7fc4bf440 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:51.420126 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78241486-9057-4a8f-b9bf-a027c944deab None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:51.453767 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:51.463039 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497505b8-1e49-4074-95c7-52f7fc4bf440 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:51.464863 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb25707-1a80-4328-8fc8-9e7060e12a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:51.466721 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb25707-1a80-4328-8fc8-9e7060e12a3a None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:51.467276 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb25707-1a80-4328-8fc8-9e7060e12a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:51.467776 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb25707-1a80-4328-8fc8-9e7060e12a3a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:51.468649 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb25707-1a80-4328-8fc8-9e7060e12a3a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:51.470681 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb25707-1a80-4328-8fc8-9e7060e12a3a None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:51.487130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-adb25707-1a80-4328-8fc8-9e7060e12a3a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 05:43:51.487130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:51.487130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 05:43:51.487130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 05:43:51.487130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 05:43:51.487130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 05:43:51.487130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 05:43:51.487130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:43:51.487130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 05:43:51.487130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:51.487130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 05:43:51.487130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:51.487130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:51.487130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:51.487130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:51.487130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:51.488147 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:51.488147 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:51.488147 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:51.488147 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:51.488147 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:51.488147 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:51.488147 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:51.488147 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 05:43:51.488147 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 05:43:51.488147 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 05:43:51.488147 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 05:43:51.488147 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:51.488147 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:51.488147 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:51.488147 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:51.488147 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:51.488981 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:51.488981 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:51.488981 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:51.488981 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:51.488981 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:51.488981 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:51.488981 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:51.488981 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:51.488981 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:51.488981 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:51.488981 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:51.488981 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 05:43:51.488981 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:43:51.488981 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 05:43:51.488981 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:51.488981 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 378/760] 10.222.0.16 () {56 vars in 1129 bytes} [Mon Jul 4 05:43:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:51.495434 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb25707-1a80-4328-8fc8-9e7060e12a3a None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:51.510118 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e9b80-d5a3-43c4-9a4a-447d99dbef27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:51.511119 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e9b80-d5a3-43c4-9a4a-447d99dbef27 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:51.511623 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e9b80-d5a3-43c4-9a4a-447d99dbef27 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:51.512305 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e9b80-d5a3-43c4-9a4a-447d99dbef27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:51.552532 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:51.602158 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e9b80-d5a3-43c4-9a4a-447d99dbef27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:51.604830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e9b80-d5a3-43c4-9a4a-447d99dbef27 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:51.613027 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb25707-1a80-4328-8fc8-9e7060e12a3a None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:51.649754 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4e537-c764-4b64-8778-88b7c3e63fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:51.650600 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4e537-c764-4b64-8778-88b7c3e63fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:51.650882 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4e537-c764-4b64-8778-88b7c3e63fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:51.651156 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4e537-c764-4b64-8778-88b7c3e63fa4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:51.658634 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4e537-c764-4b64-8778-88b7c3e63fa4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:51.660145 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4e537-c764-4b64-8778-88b7c3e63fa4 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:51.676083 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-5dc4e537-c764-4b64-8778-88b7c3e63fa4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:51.676083 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:51.676083 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:51.676083 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:51.676083 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:51.676083 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:51.676083 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:51.676083 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:51.676083 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:51.676083 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:51.676083 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:51.676083 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:51.676083 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:43:51.676083 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:43:51.676083 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:43:51.677066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:43:51.677066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:51.677066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:51.677066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:51.677066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:51.677066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:51.677066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:51.677066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:51.677066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:51.677066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:51.677066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:51.677066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:51.677066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:51.677066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:51.677066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:51.677066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:51.677066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:51.677963 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:43:51.677963 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:43:51.677963 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:43:51.677963 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:43:51.677963 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:43:51.677963 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:43:51.677963 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:51.677963 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:51.677963 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 379/761] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:43:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:51.679008 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4e537-c764-4b64-8778-88b7c3e63fa4 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:51.729882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 383/762] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:43:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 05:43:51.730799 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e9b80-d5a3-43c4-9a4a-447d99dbef27 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:51.746159 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:51.802496 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:51.806985 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4e537-c764-4b64-8778-88b7c3e63fa4 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:51.843136 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e9b80-d5a3-43c4-9a4a-447d99dbef27 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:51.853565 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3a76c-34b3-4845-b846-cf0cbafde12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:51.854872 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3a76c-34b3-4845-b846-cf0cbafde12b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:51.855599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3a76c-34b3-4845-b846-cf0cbafde12b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:51.856080 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3a76c-34b3-4845-b846-cf0cbafde12b None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:51.857220 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3a76c-34b3-4845-b846-cf0cbafde12b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:51.858136 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3a76c-34b3-4845-b846-cf0cbafde12b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:51.859987 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3a76c-34b3-4845-b846-cf0cbafde12b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:51.871703 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 380/763] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Jul 4 05:43:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:51.872772 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3a76c-34b3-4845-b846-cf0cbafde12b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:51.880918 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fde61f-16c7-4bbb-898e-93b68321691d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:51.881584 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fde61f-16c7-4bbb-898e-93b68321691d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:51.881869 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fde61f-16c7-4bbb-898e-93b68321691d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:51.882145 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fde61f-16c7-4bbb-898e-93b68321691d None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:51.882937 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fde61f-16c7-4bbb-898e-93b68321691d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:51.883281 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fde61f-16c7-4bbb-898e-93b68321691d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:51.884774 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fde61f-16c7-4bbb-898e-93b68321691d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:51.897614 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 384/764] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:43:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:51.898423 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fde61f-16c7-4bbb-898e-93b68321691d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:51.976783 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3a76c-34b3-4845-b846-cf0cbafde12b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:51.994375 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:52.002258 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fde61f-16c7-4bbb-898e-93b68321691d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:52.014670 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf30550-1601-43ab-a53c-957ee92240c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:52.015891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf30550-1601-43ab-a53c-957ee92240c8 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:52.016384 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf30550-1601-43ab-a53c-957ee92240c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:52.016894 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf30550-1601-43ab-a53c-957ee92240c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:52.028931 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf30550-1601-43ab-a53c-957ee92240c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:52.030132 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:52.031010 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf30550-1601-43ab-a53c-957ee92240c8 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:52.043547 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042c457-b875-48d2-9c43-26eace159853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:52.044272 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042c457-b875-48d2-9c43-26eace159853 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:52.044558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042c457-b875-48d2-9c43-26eace159853 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:52.044837 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042c457-b875-48d2-9c43-26eace159853 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:52.045598 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d042c457-b875-48d2-9c43-26eace159853 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:52.045903 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d042c457-b875-48d2-9c43-26eace159853 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:52.047395 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d042c457-b875-48d2-9c43-26eace159853 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:52.057508 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-9bf30550-1601-43ab-a53c-957ee92240c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:52.057508 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:52.057508 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:52.057508 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:52.057508 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:52.057508 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:52.057508 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:52.057508 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:52.057508 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:52.057508 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:52.057508 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:52.057508 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:52.057508 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:52.057508 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:52.057508 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:52.058451 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:52.058451 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:52.058451 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:52.058451 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:52.058451 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:52.058451 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:52.058451 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:52.058451 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:52.058451 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:52.058451 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:52.058451 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:52.058451 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:52.058451 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:52.058451 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:52.058451 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:52.058451 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:52.058451 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:52.059366 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:52.059366 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:52.059366 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:52.059366 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:52.059613 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 385/765] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Jul 4 05:43:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:52.059613 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042c457-b875-48d2-9c43-26eace159853 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:52.059758 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 381/766] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:52.062432 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf30550-1601-43ab-a53c-957ee92240c8 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:52.184839 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042c457-b875-48d2-9c43-26eace159853 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:52.192397 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf30550-1601-43ab-a53c-957ee92240c8 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:52.227061 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823697f-2a02-4e68-bee6-16bcf7684594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:52.228538 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823697f-2a02-4e68-bee6-16bcf7684594 None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:52.229322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823697f-2a02-4e68-bee6-16bcf7684594 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:52.230054 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823697f-2a02-4e68-bee6-16bcf7684594 None admin] PATH_INFO: `/v3/projects/4bc610fb6724419dac99f2483089c783/users/6f638cc70c994a529a48cb2c92b70384/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:52.232741 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b823697f-2a02-4e68-bee6-16bcf7684594 None admin] RBAC: Authorizing `identity:create_grant(project_id=4bc610fb6724419dac99f2483089c783, user_id=6f638cc70c994a529a48cb2c92b70384, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:52.233668 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04538c-c4b1-4de0-9d28-9f34dd8ea0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:52.234334 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04538c-c4b1-4de0-9d28-9f34dd8ea0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:52.234619 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04538c-c4b1-4de0-9d28-9f34dd8ea0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:52.234897 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04538c-c4b1-4de0-9d28-9f34dd8ea0d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:52.235388 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b823697f-2a02-4e68-bee6-16bcf7684594 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:52.235724 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b04538c-c4b1-4de0-9d28-9f34dd8ea0d7 None admin] RBAC: Adding query filter params (interface=public, service_id=57a86fde9d68416fa2d5ecceba596b7c, region_id=RegionOne) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:52.236036 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b04538c-c4b1-4de0-9d28-9f34dd8ea0d7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:52.237411 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b04538c-c4b1-4de0-9d28-9f34dd8ea0d7 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:52.253041 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 382/767] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Jul 4 05:43:52 2022] GET /identity/v3/endpoints?service_id=57a86fde9d68416fa2d5ecceba596b7c&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:52.253041 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04538c-c4b1-4de0-9d28-9f34dd8ea0d7 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:52.256539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 386/768] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 4 05:43:52 2022] PUT /identity/v3/projects/4bc610fb6724419dac99f2483089c783/users/6f638cc70c994a529a48cb2c92b70384/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:43:52.257899 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823697f-2a02-4e68-bee6-16bcf7684594 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:52.290239 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:52.317468 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:52.366908 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04538c-c4b1-4de0-9d28-9f34dd8ea0d7 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:52.379778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823697f-2a02-4e68-bee6-16bcf7684594 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:52.404066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bae86-92bb-469e-ad3d-3e5cfdb2cd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:52.405173 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bae86-92bb-469e-ad3d-3e5cfdb2cd8f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:52.405674 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bae86-92bb-469e-ad3d-3e5cfdb2cd8f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:52.406185 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bae86-92bb-469e-ad3d-3e5cfdb2cd8f None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:52.407263 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02bae86-92bb-469e-ad3d-3e5cfdb2cd8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:52.407945 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02bae86-92bb-469e-ad3d-3e5cfdb2cd8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:52.409565 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02bae86-92bb-469e-ad3d-3e5cfdb2cd8f None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:52.418987 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2befc5d-5d98-447d-8ec8-0fa0b97fd4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:52.420066 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2befc5d-5d98-447d-8ec8-0fa0b97fd4ea None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:52.420066 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2befc5d-5d98-447d-8ec8-0fa0b97fd4ea None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:52.420369 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2befc5d-5d98-447d-8ec8-0fa0b97fd4ea None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:52.421009 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2befc5d-5d98-447d-8ec8-0fa0b97fd4ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:52.422388 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2befc5d-5d98-447d-8ec8-0fa0b97fd4ea None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:52.424326 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 383/769] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:52.431239 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bae86-92bb-469e-ad3d-3e5cfdb2cd8f None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:52.434602 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 387/770] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jul 4 05:43:52 2022] GET /identity/v3/services => generated 772 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:52.604151 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:52.614436 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bae86-92bb-469e-ad3d-3e5cfdb2cd8f None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:52.651626 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad8f8a-86b0-4048-8a6d-89122270f6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:52.652721 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad8f8a-86b0-4048-8a6d-89122270f6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:52.653153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad8f8a-86b0-4048-8a6d-89122270f6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:52.653573 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad8f8a-86b0-4048-8a6d-89122270f6a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:52.660937 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ad8f8a-86b0-4048-8a6d-89122270f6a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:52.662563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ad8f8a-86b0-4048-8a6d-89122270f6a1 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:52.743859 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf46148-4c7f-4d60-8113-b19b2dfd1c4e None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:52.744220 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf46148-4c7f-4d60-8113-b19b2dfd1c4e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:52.744508 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf46148-4c7f-4d60-8113-b19b2dfd1c4e None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:52.746172 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 388/771] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:43:52.753063 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c5904-d98e-42d3-95de-ccaf0cffa5a9 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:52.753352 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c5904-d98e-42d3-95de-ccaf0cffa5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:52.753634 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c5904-d98e-42d3-95de-ccaf0cffa5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:52.771796 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-399c5904-d98e-42d3-95de-ccaf0cffa5a9 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:52.772998 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-399c5904-d98e-42d3-95de-ccaf0cffa5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:52.809869 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-63ad8f8a-86b0-4048-8a6d-89122270f6a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:52.809869 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:52.809869 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:52.809869 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:52.809869 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:52.809869 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:52.809869 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:52.809869 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:52.809869 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:52.809869 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:52.809869 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:52.809869 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:52.809869 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:43:52.809869 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:43:52.809869 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:43:52.811001 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:43:52.811001 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:52.811001 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:52.811001 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:52.811001 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:52.811001 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:52.811001 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:52.811001 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:52.811001 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:52.811001 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:52.811001 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:52.811001 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:52.811001 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:52.811001 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:52.811001 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:52.811001 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:52.811001 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:52.812139 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:43:52.812139 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:43:52.812139 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:43:52.812139 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:43:52.812139 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:43:52.812139 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:43:52.812139 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:52.812139 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:52.815523 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 384/772] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:43:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:52.822330 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad8f8a-86b0-4048-8a6d-89122270f6a1 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:52.857122 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 389/773] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 05:43:52.904882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c5904-d98e-42d3-95de-ccaf0cffa5a9 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:52.970258 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:52.989993 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad8f8a-86b0-4048-8a6d-89122270f6a1 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:53.032949 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c5904-d98e-42d3-95de-ccaf0cffa5a9 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:53.034065 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7052d-f2e3-423b-8ecd-431dd0bca6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:53.035820 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7052d-f2e3-423b-8ecd-431dd0bca6b2 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:53.036258 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7052d-f2e3-423b-8ecd-431dd0bca6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:53.036679 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7052d-f2e3-423b-8ecd-431dd0bca6b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:53.037611 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7052d-f2e3-423b-8ecd-431dd0bca6b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:53.038087 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7052d-f2e3-423b-8ecd-431dd0bca6b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:53.039713 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7052d-f2e3-423b-8ecd-431dd0bca6b2 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:53.061196 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 385/774] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:43:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:43:53.061196 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58804fbc-85b9-4e1f-b309-8bfc0332c517 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:53.061196 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58804fbc-85b9-4e1f-b309-8bfc0332c517 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:53.061196 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58804fbc-85b9-4e1f-b309-8bfc0332c517 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:53.061196 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 386/775] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:53.061987 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58804fbc-85b9-4e1f-b309-8bfc0332c517 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:53.077566 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:53.084714 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6f6e2-b7b7-46f8-8664-f715031f175e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:53.086820 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6f6e2-b7b7-46f8-8664-f715031f175e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:53.087345 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6f6e2-b7b7-46f8-8664-f715031f175e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:53.088129 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6f6e2-b7b7-46f8-8664-f715031f175e None admin] PATH_INFO: `/v3/services/network` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:53.089279 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6f6e2-b7b7-46f8-8664-f715031f175e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:53.091700 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6f6e2-b7b7-46f8-8664-f715031f175e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:53.107796 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-fba6f6e2-b7b7-46f8-8664-f715031f175e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 05:43:53.107796 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:53.107796 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 05:43:53.107796 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 05:43:53.107796 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 05:43:53.107796 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 05:43:53.107796 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 05:43:53.107796 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:43:53.107796 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 05:43:53.107796 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:53.107796 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 05:43:53.107796 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:53.107796 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:53.107796 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:53.107796 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:53.107796 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:53.107796 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:53.108819 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:53.108819 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:53.108819 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:53.108819 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:53.108819 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:53.108819 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:53.108819 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 05:43:53.108819 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 05:43:53.108819 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 05:43:53.108819 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 05:43:53.108819 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:53.108819 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:53.108819 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:53.108819 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:53.108819 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:53.108819 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:53.109654 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:53.109654 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:53.109654 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:53.109654 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:53.109654 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:53.109654 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:53.109654 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:53.109654 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:53.109654 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:53.109654 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:53.109654 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 05:43:53.109654 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:43:53.109654 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 05:43:53.109654 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:53.112558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 390/776] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:43:52 2022] GET /identity/v3/services/network => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:43:53.114025 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8c6e1-5b3b-47a8-92e3-3fe098cd2d56 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:53.114692 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8c6e1-5b3b-47a8-92e3-3fe098cd2d56 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:53.115286 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8c6e1-5b3b-47a8-92e3-3fe098cd2d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:53.138476 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-bcb8c6e1-5b3b-47a8-92e3-3fe098cd2d56 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:53.140268 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-bcb8c6e1-5b3b-47a8-92e3-3fe098cd2d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:53.177644 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58804fbc-85b9-4e1f-b309-8bfc0332c517 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:53.222152 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 391/777] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:43:53.222904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8c6e1-5b3b-47a8-92e3-3fe098cd2d56 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:53.223816 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b1f5e-1ec2-4b77-8a2f-00eec923f52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:53.224719 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b1f5e-1ec2-4b77-8a2f-00eec923f52b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:53.225438 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b1f5e-1ec2-4b77-8a2f-00eec923f52b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:53.225919 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b1f5e-1ec2-4b77-8a2f-00eec923f52b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:53.227884 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b1f5e-1ec2-4b77-8a2f-00eec923f52b None admin] RBAC: Adding query filter params (role.id=d775f350758d4eb8bfceeeb91e54351f, scope.project.id=4bc610fb6724419dac99f2483089c783, user.id=3ed779ae7e0f4c90aaed6d1f9e86a4d0) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:53.228445 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b1f5e-1ec2-4b77-8a2f-00eec923f52b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:53.230072 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b1f5e-1ec2-4b77-8a2f-00eec923f52b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:53.238645 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 387/778] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:43:53 2022] GET /identity/v3/role_assignments?user.id=3ed779ae7e0f4c90aaed6d1f9e86a4d0&scope.project.id=4bc610fb6724419dac99f2483089c783&role.id=d775f350758d4eb8bfceeeb91e54351f => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:53.256289 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b1f5e-1ec2-4b77-8a2f-00eec923f52b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:53.302273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:53.423493 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:53.435486 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8c6e1-5b3b-47a8-92e3-3fe098cd2d56 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:53.451068 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b1f5e-1ec2-4b77-8a2f-00eec923f52b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:53.479525 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84e262-af87-4a90-b063-ce1953f5b881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:53.480611 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84e262-af87-4a90-b063-ce1953f5b881 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:53.481117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84e262-af87-4a90-b063-ce1953f5b881 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:53.481591 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84e262-af87-4a90-b063-ce1953f5b881 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:53.482661 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef84e262-af87-4a90-b063-ce1953f5b881 None admin] RBAC: Adding query filter params (name=network) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:53.483164 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef84e262-af87-4a90-b063-ce1953f5b881 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:53.484840 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef84e262-af87-4a90-b063-ce1953f5b881 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:53.487351 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090d38f-f746-4305-bc32-f20a7a37d062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:53.488197 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090d38f-f746-4305-bc32-f20a7a37d062 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:53.488480 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090d38f-f746-4305-bc32-f20a7a37d062 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:53.488754 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090d38f-f746-4305-bc32-f20a7a37d062 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:53.491491 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 392/779] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 4 05:43:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:53.498960 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84e262-af87-4a90-b063-ce1953f5b881 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:53.500384 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090d38f-f746-4305-bc32-f20a7a37d062 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:53.508254 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-1090d38f-f746-4305-bc32-f20a7a37d062 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:43:53.508254 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:53.508254 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:53.508254 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:53.508254 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:53.508254 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:53.508254 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:53.508254 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:53.508254 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:53.508254 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:53.508254 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:53.508254 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:53.508254 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:53.508254 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:53.508254 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:53.508254 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:53.509305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:53.509305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:53.509305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:53.509305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:53.509305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:53.509305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:53.509305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:53.509305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:53.509305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:53.509305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:53.509305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:53.509305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:53.509305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:53.509305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:53.509305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:53.509305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:53.510198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:53.510198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:53.510198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:53.510198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:53.510198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:53.510198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:53.510198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:53.510198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:53.510198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:53.510198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:53.510198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:43:53.510198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:53.510198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 388/780] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:43:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:53.518760 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090d38f-f746-4305-bc32-f20a7a37d062 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:53.620562 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090d38f-f746-4305-bc32-f20a7a37d062 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:53.673907 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ca84b-d9b2-47d4-82ff-9f88f0020e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:53.674548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ca84b-d9b2-47d4-82ff-9f88f0020e1f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:53.674828 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ca84b-d9b2-47d4-82ff-9f88f0020e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:53.675102 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ca84b-d9b2-47d4-82ff-9f88f0020e1f None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:53.675872 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ca84b-d9b2-47d4-82ff-9f88f0020e1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:53.676170 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ca84b-d9b2-47d4-82ff-9f88f0020e1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:53.677538 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ca84b-d9b2-47d4-82ff-9f88f0020e1f None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:53.685691 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:53.696049 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 389/781] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:43:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:43:53.702734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ca84b-d9b2-47d4-82ff-9f88f0020e1f None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:53.711598 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:53.714900 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84e262-af87-4a90-b063-ce1953f5b881 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:53.752887 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82bea4-47ab-4f1a-a2a0-ea4f21db1ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:53.753615 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82bea4-47ab-4f1a-a2a0-ea4f21db1ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:53.753896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82bea4-47ab-4f1a-a2a0-ea4f21db1ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:53.754208 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82bea4-47ab-4f1a-a2a0-ea4f21db1ba0 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:53.754927 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b82bea4-47ab-4f1a-a2a0-ea4f21db1ba0 None admin] RBAC: Adding query filter params (type=network) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:53.755252 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b82bea4-47ab-4f1a-a2a0-ea4f21db1ba0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:53.756648 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b82bea4-47ab-4f1a-a2a0-ea4f21db1ba0 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:53.764527 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 393/782] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 4 05:43:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:53.770446 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82bea4-47ab-4f1a-a2a0-ea4f21db1ba0 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:53.846304 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ca84b-d9b2-47d4-82ff-9f88f0020e1f None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:53.882086 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7cd15-1579-43ad-9b0d-7ed3a13aaa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:53.883054 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7cd15-1579-43ad-9b0d-7ed3a13aaa9c None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:53.883363 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7cd15-1579-43ad-9b0d-7ed3a13aaa9c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:53.883636 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7cd15-1579-43ad-9b0d-7ed3a13aaa9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:53.896491 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7cd15-1579-43ad-9b0d-7ed3a13aaa9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:53.897955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7cd15-1579-43ad-9b0d-7ed3a13aaa9c None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:53.917729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-05b7cd15-1579-43ad-9b0d-7ed3a13aaa9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:53.917729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:53.917729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:53.917729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:53.917729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:53.917729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:53.917729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:53.917729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:53.917729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:53.917729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:53.917729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:53.917729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:53.917729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:53.917729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:53.917729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:53.918615 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:53.918615 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:53.918615 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:53.918615 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:53.918615 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:53.918615 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:53.918615 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:53.918615 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:53.918615 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:53.918615 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:53.918615 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:53.918615 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:53.918615 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:53.918615 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:53.918615 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:53.918615 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:53.918615 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:53.919539 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:53.919539 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:53.919539 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:53.919539 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:53.919539 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 390/783] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:53.924937 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7cd15-1579-43ad-9b0d-7ed3a13aaa9c None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:53.987331 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:54.006229 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82bea4-47ab-4f1a-a2a0-ea4f21db1ba0 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:54.043260 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7cd15-1579-43ad-9b0d-7ed3a13aaa9c None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:54.065859 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96165de9-2e33-42ab-9112-fbae3094101e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:54.066913 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96165de9-2e33-42ab-9112-fbae3094101e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:54.067425 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96165de9-2e33-42ab-9112-fbae3094101e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:54.067924 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96165de9-2e33-42ab-9112-fbae3094101e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:54.068919 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96165de9-2e33-42ab-9112-fbae3094101e None admin] RBAC: Adding query filter params (interface=public, service_id=e6a15f033ce848c0888620b2f176c40d, region_id=RegionOne) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:54.069430 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96165de9-2e33-42ab-9112-fbae3094101e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:54.071034 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96165de9-2e33-42ab-9112-fbae3094101e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:54.083006 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 394/784] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Jul 4 05:43:53 2022] GET /identity/v3/endpoints?service_id=e6a15f033ce848c0888620b2f176c40d&interface=public®ion_id=RegionOne => generated 194 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:43:54.092170 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96165de9-2e33-42ab-9112-fbae3094101e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:54.097100 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e2af0-f4c2-40f8-bfa1-0400c3ca8475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:54.097982 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e2af0-f4c2-40f8-bfa1-0400c3ca8475 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:54.098472 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e2af0-f4c2-40f8-bfa1-0400c3ca8475 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:54.098920 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e2af0-f4c2-40f8-bfa1-0400c3ca8475 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:54.099915 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e2af0-f4c2-40f8-bfa1-0400c3ca8475 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:54.100397 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e2af0-f4c2-40f8-bfa1-0400c3ca8475 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:54.102154 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e2af0-f4c2-40f8-bfa1-0400c3ca8475 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:54.115154 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 391/785] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:54.120789 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e2af0-f4c2-40f8-bfa1-0400c3ca8475 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:54.139146 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:54.224935 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e2af0-f4c2-40f8-bfa1-0400c3ca8475 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:54.237806 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:54.265929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27be9ea-bc53-4c31-a13c-40f136545247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:54.267237 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27be9ea-bc53-4c31-a13c-40f136545247 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:54.267702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27be9ea-bc53-4c31-a13c-40f136545247 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:54.268155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27be9ea-bc53-4c31-a13c-40f136545247 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:54.276702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27be9ea-bc53-4c31-a13c-40f136545247 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:54.279131 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27be9ea-bc53-4c31-a13c-40f136545247 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:54.296392 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-a27be9ea-bc53-4c31-a13c-40f136545247 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 04 05:43:54.296392 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:54.296392 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:54.296392 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:54.296392 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:54.296392 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:54.296392 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:54.296392 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:54.296392 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:54.296392 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:54.296392 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:54.296392 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:54.296392 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:43:54.296392 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:43:54.296392 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:43:54.296392 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:43:54.297360 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:54.297360 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:54.297360 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:43:54.297360 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:54.297360 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:43:54.297360 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:54.297360 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:54.297360 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:54.297360 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:54.297360 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:54.297360 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:54.297360 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:54.297360 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:54.297360 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:54.297360 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:54.297360 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:54.297360 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:54.297360 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:54.298324 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:54.298324 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:54.298324 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:43:54.298324 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:43:54.298324 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:43:54.298324 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:43:54.298324 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:43:54.298324 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:43:54.298324 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 04 05:43:54.298324 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:54.301309 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 392/786] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:43:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:54.307557 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27be9ea-bc53-4c31-a13c-40f136545247 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:54.317153 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96165de9-2e33-42ab-9112-fbae3094101e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:54.407896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd2fc5-2593-4f42-a2ef-efaadc1ccf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:54.408587 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd2fc5-2593-4f42-a2ef-efaadc1ccf61 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:54.408880 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd2fc5-2593-4f42-a2ef-efaadc1ccf61 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:54.409163 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd2fc5-2593-4f42-a2ef-efaadc1ccf61 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:54.409858 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd2fc5-2593-4f42-a2ef-efaadc1ccf61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:54.411273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd2fc5-2593-4f42-a2ef-efaadc1ccf61 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:54.421444 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 395/787] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jul 4 05:43:54 2022] GET /identity/v3/services => generated 772 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:54.431478 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27be9ea-bc53-4c31-a13c-40f136545247 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:54.482136 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596bbad-f09f-489e-9899-fce5eb77192a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:54.483111 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596bbad-f09f-489e-9899-fce5eb77192a None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:54.483570 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596bbad-f09f-489e-9899-fce5eb77192a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:54.483988 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596bbad-f09f-489e-9899-fce5eb77192a None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:54.485003 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596bbad-f09f-489e-9899-fce5eb77192a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:54.485478 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596bbad-f09f-489e-9899-fce5eb77192a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:54.487108 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596bbad-f09f-489e-9899-fce5eb77192a None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:54.510957 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 393/788] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Jul 4 05:43:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:43:54.516505 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd2fc5-2593-4f42-a2ef-efaadc1ccf61 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:54.662159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:54.671536 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd2fc5-2593-4f42-a2ef-efaadc1ccf61 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:54.724418 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ffd06-c791-46b2-9545-7f3db0d82f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:54.725224 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ffd06-c791-46b2-9545-7f3db0d82f4c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:54.725509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ffd06-c791-46b2-9545-7f3db0d82f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:54.725785 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ffd06-c791-46b2-9545-7f3db0d82f4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:54.736787 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ffd06-c791-46b2-9545-7f3db0d82f4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:54.738202 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ffd06-c791-46b2-9545-7f3db0d82f4c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:54.765235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-cb0ffd06-c791-46b2-9545-7f3db0d82f4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:54.765235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:54.765235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:54.765235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:54.765235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:54.765235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:54.765235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:54.765235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:54.765235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:54.765235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:54.765235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:54.765235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:54.765235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:54.765235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:54.765235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:54.766197 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:54.766197 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:54.766197 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:54.766197 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:54.766197 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:54.766197 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:54.766197 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:54.766197 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:54.766197 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:54.766197 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:54.766197 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:54.766197 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:54.766197 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:54.766197 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:54.766197 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:54.766197 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:54.766197 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:54.767172 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:54.767172 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:54.767172 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:54.767172 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:54.767172 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 396/789] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:54.772539 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596bbad-f09f-489e-9899-fce5eb77192a None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:54.824979 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:54.900787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596bbad-f09f-489e-9899-fce5eb77192a None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:54.925780 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371619e5-76a8-464a-9012-c917ddf0c362 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:54.926395 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371619e5-76a8-464a-9012-c917ddf0c362 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:54.926901 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371619e5-76a8-464a-9012-c917ddf0c362 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:54.928772 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 397/790] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:54.935444 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa59ebb-74d9-4cb3-be28-7006daaef60b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:54.935732 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa59ebb-74d9-4cb3-be28-7006daaef60b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:54.936012 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa59ebb-74d9-4cb3-be28-7006daaef60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:54.940688 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9096c81-d266-492b-b855-98b1ba3a4088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:54.941362 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9096c81-d266-492b-b855-98b1ba3a4088 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:54.941645 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9096c81-d266-492b-b855-98b1ba3a4088 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:54.941916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9096c81-d266-492b-b855-98b1ba3a4088 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:54.942634 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9096c81-d266-492b-b855-98b1ba3a4088 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:54.942935 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9096c81-d266-492b-b855-98b1ba3a4088 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:54.944333 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9096c81-d266-492b-b855-98b1ba3a4088 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:54.955576 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6fa59ebb-74d9-4cb3-be28-7006daaef60b None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:54.956774 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6fa59ebb-74d9-4cb3-be28-7006daaef60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:54.957414 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 394/791] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:54.958980 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6694be-4f86-47ac-a573-313e0609c753 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:54.959530 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6694be-4f86-47ac-a573-313e0609c753 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:54.960010 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6694be-4f86-47ac-a573-313e0609c753 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:54.967549 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 395/792] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:54.968637 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6694be-4f86-47ac-a573-313e0609c753 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:55.026784 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 398/793] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 05:43:55.032217 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088e1cc-86e4-48b1-9349-5b78dc542fb0 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:55.032508 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088e1cc-86e4-48b1-9349-5b78dc542fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:55.032788 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088e1cc-86e4-48b1-9349-5b78dc542fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:55.064403 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6088e1cc-86e4-48b1-9349-5b78dc542fb0 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:55.065529 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6088e1cc-86e4-48b1-9349-5b78dc542fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:55.077862 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6694be-4f86-47ac-a573-313e0609c753 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:55.081542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:55.128419 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c56a9-a332-46cc-b91b-6d40b227cd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:55.129610 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c56a9-a332-46cc-b91b-6d40b227cd5b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:55.130090 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c56a9-a332-46cc-b91b-6d40b227cd5b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:55.130575 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c56a9-a332-46cc-b91b-6d40b227cd5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:55.138019 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c56a9-a332-46cc-b91b-6d40b227cd5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:55.139816 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c56a9-a332-46cc-b91b-6d40b227cd5b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:55.154665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-9f2c56a9-a332-46cc-b91b-6d40b227cd5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:55.154665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:55.154665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:55.154665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:55.154665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:55.154665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:55.154665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:55.154665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:55.154665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:55.154665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:55.154665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:55.154665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:55.154665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:43:55.154665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:43:55.154665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:43:55.155643 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:43:55.155643 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:55.155643 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:55.155643 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:55.155643 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:55.155643 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:55.155643 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:55.155643 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:55.155643 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:55.155643 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:55.155643 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:55.155643 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:55.155643 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:55.155643 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:55.155643 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:55.155643 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:55.155643 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:55.156511 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:43:55.156511 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:43:55.156511 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:43:55.156511 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:43:55.156511 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:43:55.156511 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:43:55.156511 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:55.156511 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:55.156936 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 399/794] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:43:55.156936 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088e1cc-86e4-48b1-9349-5b78dc542fb0 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:55.159867 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:55.167041 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 396/795] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:43:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:55.172774 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c56a9-a332-46cc-b91b-6d40b227cd5b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:55.269714 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088e1cc-86e4-48b1-9349-5b78dc542fb0 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:55.300886 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c56a9-a332-46cc-b91b-6d40b227cd5b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:55.307419 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ebbc9-1708-4f81-b658-3c3bff248611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:55.308464 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ebbc9-1708-4f81-b658-3c3bff248611 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:55.308893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ebbc9-1708-4f81-b658-3c3bff248611 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:55.309311 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ebbc9-1708-4f81-b658-3c3bff248611 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:55.322458 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ebbc9-1708-4f81-b658-3c3bff248611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:55.331490 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-8d6ebbc9-1708-4f81-b658-3c3bff248611 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:43:55.331490 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:55.331490 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:55.331490 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:55.331490 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:55.331490 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:55.331490 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:55.331490 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:55.331490 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:55.331490 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:55.331490 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:55.331490 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:55.331490 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:55.331490 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:55.331490 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:55.331490 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:55.332427 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:55.332427 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:55.332427 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:55.332427 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:55.332427 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:55.332427 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:55.332427 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:55.332427 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:55.332427 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:55.332427 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:55.332427 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:55.332427 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:55.332427 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:55.332427 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:55.332427 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:55.332427 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:55.333273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:55.333273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:55.333273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:55.333273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:55.333273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:55.333273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:55.333273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:55.333273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:55.333273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:55.333273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:55.333273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:43:55.333273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:55.340770 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 400/796] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:43:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:55.341694 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fd5de-4188-45e5-b809-bd0ffe3c87ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:55.342387 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ebbc9-1708-4f81-b658-3c3bff248611 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:55.342943 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fd5de-4188-45e5-b809-bd0ffe3c87ff None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:55.343633 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fd5de-4188-45e5-b809-bd0ffe3c87ff None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:55.344162 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fd5de-4188-45e5-b809-bd0ffe3c87ff None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:55.345224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89fd5de-4188-45e5-b809-bd0ffe3c87ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:55.345714 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89fd5de-4188-45e5-b809-bd0ffe3c87ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:55.348118 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89fd5de-4188-45e5-b809-bd0ffe3c87ff None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:55.366275 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 397/797] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:43:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:43:55.367688 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fd5de-4188-45e5-b809-bd0ffe3c87ff None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:55.379038 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:55.416628 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:55.458988 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ebbc9-1708-4f81-b658-3c3bff248611 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:55.477700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fd5de-4188-45e5-b809-bd0ffe3c87ff None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:55.492176 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502fcdb-7a85-40b6-90bf-2f134292d3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:55.493057 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502fcdb-7a85-40b6-90bf-2f134292d3b1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:55.493347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502fcdb-7a85-40b6-90bf-2f134292d3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:55.493621 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502fcdb-7a85-40b6-90bf-2f134292d3b1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:55.494299 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502fcdb-7a85-40b6-90bf-2f134292d3b1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:55.495731 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502fcdb-7a85-40b6-90bf-2f134292d3b1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:55.509292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-5502fcdb-7a85-40b6-90bf-2f134292d3b1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 05:43:55.509292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:55.509292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 05:43:55.509292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 05:43:55.509292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 05:43:55.509292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 05:43:55.509292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 05:43:55.509292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:43:55.509292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 05:43:55.509292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:55.509292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 05:43:55.509292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:55.509292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:55.509292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:55.509292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:55.509292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:55.510331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:55.510331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:55.510331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:55.510331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:55.510331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:55.510331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:55.510331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:55.510331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 05:43:55.510331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 05:43:55.510331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 05:43:55.510331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 05:43:55.510331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:55.510331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:55.510331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:55.510331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:55.510331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:55.511144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:55.511144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:55.511144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:55.511144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:55.511144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:55.511144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:55.511144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:55.511144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:55.511144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:55.511144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:55.511144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:55.511144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 05:43:55.511144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:43:55.511144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 05:43:55.511144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:55.511144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 401/798] 10.222.0.16 () {56 vars in 1129 bytes} [Mon Jul 4 05:43:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:55.512489 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502fcdb-7a85-40b6-90bf-2f134292d3b1 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:55.524788 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c2182-a6b6-4802-b6d6-c4d9321cf452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:55.525509 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c2182-a6b6-4802-b6d6-c4d9321cf452 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:55.525784 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c2182-a6b6-4802-b6d6-c4d9321cf452 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:55.526049 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c2182-a6b6-4802-b6d6-c4d9321cf452 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:55.526792 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c2182-a6b6-4802-b6d6-c4d9321cf452 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:55.527095 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c2182-a6b6-4802-b6d6-c4d9321cf452 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:55.528512 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c2182-a6b6-4802-b6d6-c4d9321cf452 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:55.537903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 398/799] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:43:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:55.539227 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee1f0d-086d-4fef-8d26-bbcfc0dd49e5 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:55.539510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee1f0d-086d-4fef-8d26-bbcfc0dd49e5 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:55.539780 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee1f0d-086d-4fef-8d26-bbcfc0dd49e5 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:55.541359 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 399/800] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:55.542043 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee1f0d-086d-4fef-8d26-bbcfc0dd49e5 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:55.616502 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:55.629360 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502fcdb-7a85-40b6-90bf-2f134292d3b1 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:55.654666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:55.655036 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee1f0d-086d-4fef-8d26-bbcfc0dd49e5 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:55.664732 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07b783-e4e8-4881-9dab-61dd6075b1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:55.665597 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07b783-e4e8-4881-9dab-61dd6075b1e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:55.665907 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07b783-e4e8-4881-9dab-61dd6075b1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:55.666376 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07b783-e4e8-4881-9dab-61dd6075b1e6 None admin] PATH_INFO: `/v3/projects/4bc610fb6724419dac99f2483089c783/users/e55a1c343c60428db2d9e5e6ed865e21/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:55.668230 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc07b783-e4e8-4881-9dab-61dd6075b1e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=4bc610fb6724419dac99f2483089c783, user_id=e55a1c343c60428db2d9e5e6ed865e21, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:55.669690 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc07b783-e4e8-4881-9dab-61dd6075b1e6 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:55.683565 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 402/801] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 4 05:43:55 2022] PUT /identity/v3/projects/4bc610fb6724419dac99f2483089c783/users/e55a1c343c60428db2d9e5e6ed865e21/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:43:55.684587 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07b783-e4e8-4881-9dab-61dd6075b1e6 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:55.711374 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4aa420-2926-4dc5-bd65-bdd86623dc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:55.712932 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4aa420-2926-4dc5-bd65-bdd86623dc0b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:55.713449 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4aa420-2926-4dc5-bd65-bdd86623dc0b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:55.713798 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4aa420-2926-4dc5-bd65-bdd86623dc0b None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:55.714952 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4aa420-2926-4dc5-bd65-bdd86623dc0b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:55.715350 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4aa420-2926-4dc5-bd65-bdd86623dc0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:55.717672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4aa420-2926-4dc5-bd65-bdd86623dc0b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:55.725900 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 400/802] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Jul 4 05:43:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:55.727437 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834d639-c4ff-4d14-a91a-8449a0488e40 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:55.727795 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834d639-c4ff-4d14-a91a-8449a0488e40 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:55.728141 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834d639-c4ff-4d14-a91a-8449a0488e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:55.751236 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-b834d639-c4ff-4d14-a91a-8449a0488e40 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:55.753352 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b834d639-c4ff-4d14-a91a-8449a0488e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:55.801515 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07b783-e4e8-4881-9dab-61dd6075b1e6 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:55.847230 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d31a3e-7ec1-444a-be16-d1fc79b7533e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:55.847230 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d31a3e-7ec1-444a-be16-d1fc79b7533e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:55.847230 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d31a3e-7ec1-444a-be16-d1fc79b7533e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:55.847230 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d31a3e-7ec1-444a-be16-d1fc79b7533e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:55.848886 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 401/803] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:43:55.849753 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834d639-c4ff-4d14-a91a-8449a0488e40 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:55.857378 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d31a3e-7ec1-444a-be16-d1fc79b7533e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:55.858879 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d31a3e-7ec1-444a-be16-d1fc79b7533e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:55.877291 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-54d31a3e-7ec1-444a-be16-d1fc79b7533e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:55.877291 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:55.877291 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:55.877291 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:55.877291 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:55.877291 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:55.877291 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:55.877291 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:55.877291 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:55.877291 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:55.877291 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:55.877291 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:55.877291 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:55.877291 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:55.877291 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:55.878395 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:55.878395 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:55.878395 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:55.878395 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:55.878395 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:55.878395 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:55.878395 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:55.878395 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:55.878395 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:55.878395 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:55.878395 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:55.878395 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:55.878395 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:55.878395 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:55.878395 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:55.878395 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:55.878395 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:55.879555 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:55.879555 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:55.879555 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:55.879555 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:55.879555 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 403/804] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:55.884143 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d31a3e-7ec1-444a-be16-d1fc79b7533e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:55.932883 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:55.939547 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:55.983417 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834d639-c4ff-4d14-a91a-8449a0488e40 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:55.999291 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d31a3e-7ec1-444a-be16-d1fc79b7533e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:56.020647 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393610da-ed6d-4923-9627-7c910421b4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:56.021335 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393610da-ed6d-4923-9627-7c910421b4e1 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:56.021624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393610da-ed6d-4923-9627-7c910421b4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:56.021907 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393610da-ed6d-4923-9627-7c910421b4e1 None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:56.022621 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393610da-ed6d-4923-9627-7c910421b4e1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:56.022935 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393610da-ed6d-4923-9627-7c910421b4e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:56.024362 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393610da-ed6d-4923-9627-7c910421b4e1 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:56.029711 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 402/805] 10.222.0.16 () {56 vars in 1124 bytes} [Mon Jul 4 05:43:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:56.030804 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393610da-ed6d-4923-9627-7c910421b4e1 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:56.039858 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03f19d-6108-4b18-b046-7bff816975db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:56.040530 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03f19d-6108-4b18-b046-7bff816975db None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:56.040968 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03f19d-6108-4b18-b046-7bff816975db None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:56.041253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03f19d-6108-4b18-b046-7bff816975db None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:56.041982 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de03f19d-6108-4b18-b046-7bff816975db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:56.042288 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de03f19d-6108-4b18-b046-7bff816975db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:56.043713 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de03f19d-6108-4b18-b046-7bff816975db None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:56.061092 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 404/806] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:43:56.061955 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03f19d-6108-4b18-b046-7bff816975db None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:56.134965 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393610da-ed6d-4923-9627-7c910421b4e1 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:56.162707 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:56.167913 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03f19d-6108-4b18-b046-7bff816975db None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:56.170587 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0bfa7-6089-4cda-8396-09200232d659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:56.171534 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0bfa7-6089-4cda-8396-09200232d659 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:56.171822 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0bfa7-6089-4cda-8396-09200232d659 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:56.172102 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0bfa7-6089-4cda-8396-09200232d659 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:56.183677 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0bfa7-6089-4cda-8396-09200232d659 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:56.191795 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-48f0bfa7-6089-4cda-8396-09200232d659 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:43:56.191795 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:56.191795 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:56.191795 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:56.191795 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:56.191795 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:56.191795 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:56.191795 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:56.191795 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:56.191795 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:56.191795 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:56.191795 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:56.191795 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:56.191795 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:56.191795 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:56.191795 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:56.192997 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:56.192997 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:56.192997 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:56.192997 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:56.192997 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:56.192997 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:56.192997 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:56.192997 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:56.192997 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:56.192997 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:56.192997 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:56.192997 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:56.192997 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:56.192997 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:56.192997 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:56.192997 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:56.194160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:56.194160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:56.194160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:56.194160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:56.194160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:56.194160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:56.194160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:56.194160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:56.194160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:56.194160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:56.194160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:43:56.194160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:56.194160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 403/807] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 4 05:43:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:56.195015 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0bfa7-6089-4cda-8396-09200232d659 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:56.199572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:56.306553 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0bfa7-6089-4cda-8396-09200232d659 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:56.326937 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9a56e-8a89-4660-9e99-1ea200788232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:56.327645 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9a56e-8a89-4660-9e99-1ea200788232 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:56.327926 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9a56e-8a89-4660-9e99-1ea200788232 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:56.328200 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9a56e-8a89-4660-9e99-1ea200788232 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:56.328940 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9a56e-8a89-4660-9e99-1ea200788232 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:56.330387 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9a56e-8a89-4660-9e99-1ea200788232 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:56.343275 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a86f13-6559-45d7-882e-11ce68e3f9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:56.344310 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a86f13-6559-45d7-882e-11ce68e3f9d3 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:56.344671 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a86f13-6559-45d7-882e-11ce68e3f9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:56.345015 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a86f13-6559-45d7-882e-11ce68e3f9d3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:56.354057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a86f13-6559-45d7-882e-11ce68e3f9d3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:56.355600 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a86f13-6559-45d7-882e-11ce68e3f9d3 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:56.359376 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 405/808] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jul 4 05:43:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:43:56.360344 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9a56e-8a89-4660-9e99-1ea200788232 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:56.389192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-98a86f13-6559-45d7-882e-11ce68e3f9d3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 05:43:56.389192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:56.389192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:56.389192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:56.389192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:56.389192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:56.389192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:56.389192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:56.389192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:56.389192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:56.389192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:56.389192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:56.389192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:43:56.389192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:43:56.389192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:43:56.389192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:43:56.390168 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:56.390168 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:56.390168 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:43:56.390168 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:56.390168 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:43:56.390168 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:56.390168 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:56.390168 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:56.390168 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:56.390168 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:56.390168 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:56.390168 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:56.390168 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:56.390168 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:56.390168 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:56.390168 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:56.390168 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:56.390168 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:56.391101 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:56.391101 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:56.391101 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:43:56.391101 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:43:56.391101 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:43:56.391101 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:43:56.391101 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:43:56.391101 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:43:56.391101 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 05:43:56.391101 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:56.392254 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 404/809] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jul 4 05:43:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:56.399034 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a86f13-6559-45d7-882e-11ce68e3f9d3 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:56.504844 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:56.583357 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a86f13-6559-45d7-882e-11ce68e3f9d3 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:56.587211 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9a56e-8a89-4660-9e99-1ea200788232 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:56.620184 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cceef5d-0ec7-4789-8d80-1d38c19cbf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:56.620866 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cceef5d-0ec7-4789-8d80-1d38c19cbf59 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:56.621554 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cceef5d-0ec7-4789-8d80-1d38c19cbf59 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:56.621833 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cceef5d-0ec7-4789-8d80-1d38c19cbf59 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:56.622778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cceef5d-0ec7-4789-8d80-1d38c19cbf59 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:56.623093 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cceef5d-0ec7-4789-8d80-1d38c19cbf59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:56.624686 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cceef5d-0ec7-4789-8d80-1d38c19cbf59 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:56.630949 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d905fa-ec5a-4e5e-bd93-1a0b4634be69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:56.631689 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d905fa-ec5a-4e5e-bd93-1a0b4634be69 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:56.631973 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d905fa-ec5a-4e5e-bd93-1a0b4634be69 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:56.632249 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d905fa-ec5a-4e5e-bd93-1a0b4634be69 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:56.632997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d905fa-ec5a-4e5e-bd93-1a0b4634be69 None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:56.633575 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d905fa-ec5a-4e5e-bd93-1a0b4634be69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:56.635301 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d905fa-ec5a-4e5e-bd93-1a0b4634be69 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:56.645931 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 405/811] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jul 4 05:43:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:56.646194 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 406/811] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 4 05:43:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:56.651065 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cceef5d-0ec7-4789-8d80-1d38c19cbf59 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:56.656116 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d905fa-ec5a-4e5e-bd93-1a0b4634be69 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:56.674486 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:56.768576 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cceef5d-0ec7-4789-8d80-1d38c19cbf59 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:56.778226 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:56.789863 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d905fa-ec5a-4e5e-bd93-1a0b4634be69 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:56.810007 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d68d7-8d36-477b-b273-063c6e2f44c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:56.810904 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d68d7-8d36-477b-b273-063c6e2f44c3 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:56.811411 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d68d7-8d36-477b-b273-063c6e2f44c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:56.811756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d68d7-8d36-477b-b273-063c6e2f44c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:56.823295 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d68d7-8d36-477b-b273-063c6e2f44c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:56.824969 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d68d7-8d36-477b-b273-063c6e2f44c3 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:56.838837 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84898a-4481-467d-a93c-7ff3fdf9a3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:56.839528 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84898a-4481-467d-a93c-7ff3fdf9a3ef None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:56.839814 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84898a-4481-467d-a93c-7ff3fdf9a3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:56.840088 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84898a-4481-467d-a93c-7ff3fdf9a3ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:56.868778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-005d68d7-8d36-477b-b273-063c6e2f44c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:56.868778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:56.868778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:56.868778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:56.868778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:56.868778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:56.868778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:56.868778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:56.868778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:56.868778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:56.868778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:56.868778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:56.868778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:56.868778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:56.868778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:56.871586 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:56.871586 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:56.871586 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:56.871586 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:56.871586 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:56.871586 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:56.871586 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:56.871586 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:56.871586 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:56.871586 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:56.871586 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:56.871586 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:56.871586 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:56.871586 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:56.871586 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:56.871586 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:56.871586 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:56.873652 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:56.873652 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:56.873652 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:56.873652 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:56.873652 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 406/812] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:56.873652 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ae7e0-530e-4092-ad66-faa114058dad None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:56.873652 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ae7e0-530e-4092-ad66-faa114058dad None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:56.874529 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ae7e0-530e-4092-ad66-faa114058dad None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:56.879309 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 407/813] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:56.881282 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ae7e0-530e-4092-ad66-faa114058dad None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:56.932423 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84898a-4481-467d-a93c-7ff3fdf9a3ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:56.933898 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84898a-4481-467d-a93c-7ff3fdf9a3ef None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:56.952469 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:57.031733 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ae7e0-530e-4092-ad66-faa114058dad None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:57.058664 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 407/814] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:43:56 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 05:43:57.060150 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d771b-89e6-423f-be9f-5a0e948a4ab9 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:57.060434 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d771b-89e6-423f-be9f-5a0e948a4ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:57.060710 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d771b-89e6-423f-be9f-5a0e948a4ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:57.077845 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b355d6b-45da-420b-8126-348992e593f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:57.078373 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-245d771b-89e6-423f-be9f-5a0e948a4ab9 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:57.078589 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b355d6b-45da-420b-8126-348992e593f4 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:57.078863 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b355d6b-45da-420b-8126-348992e593f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:57.079141 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b355d6b-45da-420b-8126-348992e593f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:57.079576 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-245d771b-89e6-423f-be9f-5a0e948a4ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:57.079913 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b355d6b-45da-420b-8126-348992e593f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:57.080278 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b355d6b-45da-420b-8126-348992e593f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:57.081975 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b355d6b-45da-420b-8126-348992e593f4 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:57.098583 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 408/815] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:57.099500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b355d6b-45da-420b-8126-348992e593f4 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:57.129542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:57.163350 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 408/816] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:43:57.164560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d771b-89e6-423f-be9f-5a0e948a4ab9 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:57.227087 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:57.235173 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b355d6b-45da-420b-8126-348992e593f4 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:57.286644 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24731d8-6a67-4a67-a2f7-b63b30f37030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:57.287483 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24731d8-6a67-4a67-a2f7-b63b30f37030 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:57.287768 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24731d8-6a67-4a67-a2f7-b63b30f37030 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:57.288045 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24731d8-6a67-4a67-a2f7-b63b30f37030 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:57.288898 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d771b-89e6-423f-be9f-5a0e948a4ab9 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:57.301971 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24731d8-6a67-4a67-a2f7-b63b30f37030 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:57.304238 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24731d8-6a67-4a67-a2f7-b63b30f37030 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:57.324678 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1e964-e84e-4c78-92e8-e9e9b471c885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:57.325811 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1e964-e84e-4c78-92e8-e9e9b471c885 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:57.326299 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1e964-e84e-4c78-92e8-e9e9b471c885 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:57.326777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-a24731d8-6a67-4a67-a2f7-b63b30f37030 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:57.326777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:57.326777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:57.326777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:57.326777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:57.326777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:57.326777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:57.326777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:57.326777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:57.326777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:57.326777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:57.326777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:57.326777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:57.326777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:57.326777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:57.327734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:57.327734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:57.327734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:57.327734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:57.327734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:57.327734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:57.327734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:57.327734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:57.327734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:57.327734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:57.327734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:57.327734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:57.327734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:57.327734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:57.327734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:57.327734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:57.327734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:57.328801 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:57.328801 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:57.328801 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:57.328801 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:57.329076 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1e964-e84e-4c78-92e8-e9e9b471c885 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:57.329677 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 409/817] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:57.330375 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24731d8-6a67-4a67-a2f7-b63b30f37030 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:57.338504 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d1e964-e84e-4c78-92e8-e9e9b471c885 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:57.340383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d1e964-e84e-4c78-92e8-e9e9b471c885 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:57.358998 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-98d1e964-e84e-4c78-92e8-e9e9b471c885 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 05:43:57.358998 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:57.358998 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:57.358998 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:57.358998 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:57.358998 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:57.358998 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:57.358998 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:57.358998 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:57.358998 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:57.358998 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:57.358998 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:57.358998 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:43:57.358998 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:43:57.358998 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:43:57.358998 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:43:57.360736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:57.360736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:57.360736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:43:57.360736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:57.360736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:43:57.360736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:57.360736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:57.360736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:57.360736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:57.360736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:57.360736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:57.360736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:57.360736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:57.360736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:57.360736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:57.360736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:57.360736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:57.360736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:57.361763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:57.361763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:57.361763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:43:57.361763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:43:57.361763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:43:57.361763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:43:57.361763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:43:57.361763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:43:57.361763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 05:43:57.361763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:57.369492 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 409/818] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jul 4 05:43:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:57.370788 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1e964-e84e-4c78-92e8-e9e9b471c885 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:57.410610 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:57.457889 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24731d8-6a67-4a67-a2f7-b63b30f37030 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:57.486301 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1e964-e84e-4c78-92e8-e9e9b471c885 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:57.489704 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:57.504351 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae47f25-a33f-4e7a-9789-3bddf3160f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:57.505427 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae47f25-a33f-4e7a-9789-3bddf3160f75 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:57.505713 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae47f25-a33f-4e7a-9789-3bddf3160f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:57.505991 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae47f25-a33f-4e7a-9789-3bddf3160f75 None admin] PATH_INFO: `/v3/services/network` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:57.506656 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae47f25-a33f-4e7a-9789-3bddf3160f75 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:57.508731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae47f25-a33f-4e7a-9789-3bddf3160f75 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:57.522899 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-3ae47f25-a33f-4e7a-9789-3bddf3160f75 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 05:43:57.522899 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:57.522899 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 05:43:57.522899 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 05:43:57.522899 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 05:43:57.522899 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 05:43:57.522899 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 05:43:57.522899 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:43:57.522899 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 05:43:57.522899 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:57.522899 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 05:43:57.522899 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:57.522899 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:57.522899 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:57.522899 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:57.522899 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:57.522899 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:57.524078 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:57.524078 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:57.524078 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:57.524078 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:57.524078 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:57.524078 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:57.524078 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 05:43:57.524078 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 05:43:57.524078 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 05:43:57.524078 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 05:43:57.524078 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:57.524078 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:57.524078 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:57.524078 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:57.524078 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:57.524078 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:57.524903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:57.524903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:57.524903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:57.524903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:57.524903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:57.524903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:57.524903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:57.524903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:57.524903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:57.524903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:57.524903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 05:43:57.524903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:43:57.524903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 05:43:57.524903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:57.529507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0bf4d-1421-4346-81a4-d2273bc2f129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:57.529507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0bf4d-1421-4346-81a4-d2273bc2f129 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:57.529507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0bf4d-1421-4346-81a4-d2273bc2f129 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:57.529507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0bf4d-1421-4346-81a4-d2273bc2f129 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:57.529906 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0bf4d-1421-4346-81a4-d2273bc2f129 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:57.529906 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0bf4d-1421-4346-81a4-d2273bc2f129 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:57.530533 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0bf4d-1421-4346-81a4-d2273bc2f129 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:57.541635 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 410/819] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:43:57 2022] GET /identity/v3/services/network => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:57.542824 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae47f25-a33f-4e7a-9789-3bddf3160f75 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:57.543631 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 410/820] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:57.543978 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0bf4d-1421-4346-81a4-d2273bc2f129 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:57.646316 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae47f25-a33f-4e7a-9789-3bddf3160f75 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:57.678729 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0bf4d-1421-4346-81a4-d2273bc2f129 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:57.684441 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e34f6-9add-4cfe-abed-b0903ccc69d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:57.685127 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e34f6-9add-4cfe-abed-b0903ccc69d0 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:57.685414 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e34f6-9add-4cfe-abed-b0903ccc69d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:57.685693 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e34f6-9add-4cfe-abed-b0903ccc69d0 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:57.686539 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e34f6-9add-4cfe-abed-b0903ccc69d0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:57.686848 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e34f6-9add-4cfe-abed-b0903ccc69d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:57.688836 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e34f6-9add-4cfe-abed-b0903ccc69d0 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:57.691037 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:57.718994 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 411/821] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Jul 4 05:43:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:57.718994 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e34f6-9add-4cfe-abed-b0903ccc69d0 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:57.721819 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2634a-80cd-4a92-acf1-4794a1a9bacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:57.722736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2634a-80cd-4a92-acf1-4794a1a9bacf None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:57.723262 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2634a-80cd-4a92-acf1-4794a1a9bacf None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:57.723752 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2634a-80cd-4a92-acf1-4794a1a9bacf None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:57.724651 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2634a-80cd-4a92-acf1-4794a1a9bacf None admin] RBAC: Adding query filter params (name=network) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:57.725143 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2634a-80cd-4a92-acf1-4794a1a9bacf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:57.726716 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2634a-80cd-4a92-acf1-4794a1a9bacf None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:57.736858 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 411/822] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 4 05:43:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:57.738190 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2634a-80cd-4a92-acf1-4794a1a9bacf None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:57.775658 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:57.833302 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e34f6-9add-4cfe-abed-b0903ccc69d0 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:57.839657 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2634a-80cd-4a92-acf1-4794a1a9bacf None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:57.872021 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09bade-4e6d-478c-a700-b9beeff36830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:57.872992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09bade-4e6d-478c-a700-b9beeff36830 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:57.873369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09bade-4e6d-478c-a700-b9beeff36830 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:57.873644 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09bade-4e6d-478c-a700-b9beeff36830 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:57.874411 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f078b95-d0ae-49f4-ba34-2c3a648c10a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:57.875324 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f078b95-d0ae-49f4-ba34-2c3a648c10a5 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:57.875678 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f078b95-d0ae-49f4-ba34-2c3a648c10a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:57.876073 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f078b95-d0ae-49f4-ba34-2c3a648c10a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:57.881572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09bade-4e6d-478c-a700-b9beeff36830 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:57.883570 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09bade-4e6d-478c-a700-b9beeff36830 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:57.886576 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f078b95-d0ae-49f4-ba34-2c3a648c10a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:57.888134 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f078b95-d0ae-49f4-ba34-2c3a648c10a5 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:57.900499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-bb09bade-4e6d-478c-a700-b9beeff36830 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:57.900499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:57.900499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:57.900499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:57.900499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:57.900499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:57.900499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:57.900499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:57.900499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:57.900499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:57.900499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:57.900499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:57.900499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:43:57.900499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:43:57.900499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:43:57.901498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:43:57.901498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:57.901498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:57.901498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:57.901498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:57.901498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:57.901498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:57.901498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:57.901498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:57.901498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:57.901498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:57.901498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:57.901498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:57.901498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:57.901498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:57.901498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:57.901498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:57.902594 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:43:57.902594 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:43:57.902594 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:43:57.902594 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:43:57.902594 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:43:57.902594 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:43:57.902594 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:57.902594 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:57.909932 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 412/823] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:43:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:57.909932 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09bade-4e6d-478c-a700-b9beeff36830 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:57.910125 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-5f078b95-d0ae-49f4-ba34-2c3a648c10a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:57.910125 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:57.910125 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:57.910125 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:57.910125 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:57.910125 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:57.910125 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:57.910125 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:57.910125 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:57.910125 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:57.910125 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:57.910125 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:57.910125 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:57.910125 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:57.910125 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:57.910933 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:57.910933 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:57.910933 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:57.910933 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:57.910933 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:57.910933 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:57.910933 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:57.910933 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:57.910933 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:57.910933 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:57.910933 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:57.910933 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:57.910933 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:57.910933 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:57.910933 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:57.910933 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:57.910933 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:57.911893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:57.911893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:57.911893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:57.911893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:57.911893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 412/824] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:57.911893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fded7dd-b6d1-416c-9327-05c1952468c7 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:57.911893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fded7dd-b6d1-416c-9327-05c1952468c7 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:57.911893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fded7dd-b6d1-416c-9327-05c1952468c7 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:57.912440 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 413/825] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:57.913086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fded7dd-b6d1-416c-9327-05c1952468c7 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:57.975586 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:57.998215 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:58.019167 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fded7dd-b6d1-416c-9327-05c1952468c7 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:58.024397 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09bade-4e6d-478c-a700-b9beeff36830 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:58.053766 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431b35a-166d-4ff7-8662-f5c676a45edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:58.054742 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431b35a-166d-4ff7-8662-f5c676a45edc None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:58.055013 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431b35a-166d-4ff7-8662-f5c676a45edc None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:58.055306 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431b35a-166d-4ff7-8662-f5c676a45edc None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:58.056083 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431b35a-166d-4ff7-8662-f5c676a45edc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:58.056433 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431b35a-166d-4ff7-8662-f5c676a45edc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:58.057867 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431b35a-166d-4ff7-8662-f5c676a45edc None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:58.062431 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893aeeef-d174-4960-b6e6-07c231f1d30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:58.063346 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893aeeef-d174-4960-b6e6-07c231f1d30c None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:58.063808 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893aeeef-d174-4960-b6e6-07c231f1d30c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:58.064282 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893aeeef-d174-4960-b6e6-07c231f1d30c None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:58.065600 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893aeeef-d174-4960-b6e6-07c231f1d30c None admin] RBAC: Adding query filter params (type=network) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:58.066090 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893aeeef-d174-4960-b6e6-07c231f1d30c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:58.068332 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893aeeef-d174-4960-b6e6-07c231f1d30c None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:58.069443 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 414/826] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:43:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:58.070212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431b35a-166d-4ff7-8662-f5c676a45edc None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:58.084800 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 413/827] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 4 05:43:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:58.084800 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768502a6-d1db-4094-94b9-118f85b98fde None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:58.084800 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768502a6-d1db-4094-94b9-118f85b98fde None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:58.084800 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768502a6-d1db-4094-94b9-118f85b98fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:58.099199 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-768502a6-d1db-4094-94b9-118f85b98fde None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:58.100418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-768502a6-d1db-4094-94b9-118f85b98fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:58.173269 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 414/828] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:43:58.174116 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768502a6-d1db-4094-94b9-118f85b98fde None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:58.182882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431b35a-166d-4ff7-8662-f5c676a45edc None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:58.220200 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9e734-04ed-4cd0-b9e2-15c9f56dbc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:58.221204 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9e734-04ed-4cd0-b9e2-15c9f56dbc44 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:58.221696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9e734-04ed-4cd0-b9e2-15c9f56dbc44 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:58.222152 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9e734-04ed-4cd0-b9e2-15c9f56dbc44 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:58.223043 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f9e734-04ed-4cd0-b9e2-15c9f56dbc44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:58.223557 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f9e734-04ed-4cd0-b9e2-15c9f56dbc44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:58.225105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f9e734-04ed-4cd0-b9e2-15c9f56dbc44 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:58.231005 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:58.234655 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:58.240030 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 415/829] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:58.240820 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9e734-04ed-4cd0-b9e2-15c9f56dbc44 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:58.292141 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768502a6-d1db-4094-94b9-118f85b98fde None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:58.328642 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb61346-d264-4dcf-b641-40c78845ac63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:58.329706 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb61346-d264-4dcf-b641-40c78845ac63 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:58.329990 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb61346-d264-4dcf-b641-40c78845ac63 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:58.330410 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb61346-d264-4dcf-b641-40c78845ac63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:58.331399 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb61346-d264-4dcf-b641-40c78845ac63 None admin] RBAC: Adding query filter params (role.id=6c5b161dbf33447fa1d383915d3c9382, scope.project.id=4bc610fb6724419dac99f2483089c783, user.id=6f638cc70c994a529a48cb2c92b70384) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:58.331872 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb61346-d264-4dcf-b641-40c78845ac63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:58.333948 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb61346-d264-4dcf-b641-40c78845ac63 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:58.340991 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 415/830] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:43:58 2022] GET /identity/v3/role_assignments?user.id=6f638cc70c994a529a48cb2c92b70384&scope.project.id=4bc610fb6724419dac99f2483089c783&role.id=6c5b161dbf33447fa1d383915d3c9382 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:58.341252 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9e734-04ed-4cd0-b9e2-15c9f56dbc44 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:58.341779 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb61346-d264-4dcf-b641-40c78845ac63 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:58.405521 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829dcdf9-09d7-45b5-9b8c-cf0f9db90b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:58.406204 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dcdf9-09d7-45b5-9b8c-cf0f9db90b8a None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:58.406483 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dcdf9-09d7-45b5-9b8c-cf0f9db90b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:58.406754 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dcdf9-09d7-45b5-9b8c-cf0f9db90b8a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:58.407550 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829dcdf9-09d7-45b5-9b8c-cf0f9db90b8a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:58.409167 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829dcdf9-09d7-45b5-9b8c-cf0f9db90b8a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:58.433605 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 416/831] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jul 4 05:43:58 2022] POST /identity/v3/endpoints => generated 327 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:43:58.434611 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829dcdf9-09d7-45b5-9b8c-cf0f9db90b8a None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:58.474103 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb61346-d264-4dcf-b641-40c78845ac63 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:58.488147 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:58.516253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:58.539057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef3ea5-9e10-4765-97fb-ebbeaf77b33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:58.539057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef3ea5-9e10-4765-97fb-ebbeaf77b33f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:58.539057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef3ea5-9e10-4765-97fb-ebbeaf77b33f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:58.539057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef3ea5-9e10-4765-97fb-ebbeaf77b33f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:58.560886 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef3ea5-9e10-4765-97fb-ebbeaf77b33f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:43:58.571089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-7fef3ea5-9e10-4765-97fb-ebbeaf77b33f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:43:58.571089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:58.571089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:58.571089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:58.571089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:58.571089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:58.571089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:58.571089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:58.571089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:58.571089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:58.571089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:58.571089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:58.571089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:43:58.571089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:43:58.571089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:43:58.571089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:43:58.572322 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:43:58.572322 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:43:58.572322 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:43:58.572322 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:43:58.572322 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:58.572322 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:58.572322 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:58.572322 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:58.572322 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:58.572322 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:58.572322 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:58.572322 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:58.572322 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:58.572322 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:58.572322 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:58.572322 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:58.573180 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:58.573180 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:58.573180 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:58.573180 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:58.573180 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:43:58.573180 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:43:58.573180 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:43:58.573180 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:43:58.573180 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:43:58.573180 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:43:58.573180 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:43:58.573180 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:58.573821 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 416/832] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:43:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:58.579277 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef3ea5-9e10-4765-97fb-ebbeaf77b33f None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:58.602385 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829dcdf9-09d7-45b5-9b8c-cf0f9db90b8a None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:58.654487 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc104ebe-4bce-4e51-a7f0-9ad8f68c7fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:58.655362 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc104ebe-4bce-4e51-a7f0-9ad8f68c7fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:58.655647 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc104ebe-4bce-4e51-a7f0-9ad8f68c7fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:58.655922 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc104ebe-4bce-4e51-a7f0-9ad8f68c7fb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:58.670686 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc104ebe-4bce-4e51-a7f0-9ad8f68c7fb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:58.672335 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc104ebe-4bce-4e51-a7f0-9ad8f68c7fb9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:58.688253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-dc104ebe-4bce-4e51-a7f0-9ad8f68c7fb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:58.688253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:58.688253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:58.688253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:58.688253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:58.688253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:58.688253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:58.688253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:58.688253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:58.688253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:58.688253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:58.688253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:58.688253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:43:58.688253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:43:58.688253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:43:58.689212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:43:58.689212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:58.689212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:58.689212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:58.689212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:58.689212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:58.689212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:58.689212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:58.689212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:58.689212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:58.689212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:58.689212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:58.689212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:58.689212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:58.689212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:58.689212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:58.689212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:58.690105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:43:58.690105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:43:58.690105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:43:58.690105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:43:58.690105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:43:58.690105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:43:58.690105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:43:58.690105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:58.692591 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 417/833] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:43:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:58.699247 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7fb6b-02fe-4a46-93ed-24e9964dd994 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:58.700076 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7fb6b-02fe-4a46-93ed-24e9964dd994 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:58.700524 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7fb6b-02fe-4a46-93ed-24e9964dd994 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:58.702084 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 418/834] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:43:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:43:58.702947 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7fb6b-02fe-4a46-93ed-24e9964dd994 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:58.714519 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef3ea5-9e10-4765-97fb-ebbeaf77b33f None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:58.753583 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8dd521-6852-47ef-8114-fcca3ee3ffe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:58.754260 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dd521-6852-47ef-8114-fcca3ee3ffe7 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:58.754541 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dd521-6852-47ef-8114-fcca3ee3ffe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:58.754812 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dd521-6852-47ef-8114-fcca3ee3ffe7 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:58.755620 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8dd521-6852-47ef-8114-fcca3ee3ffe7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:58.755925 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8dd521-6852-47ef-8114-fcca3ee3ffe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:58.757435 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8dd521-6852-47ef-8114-fcca3ee3ffe7 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:58.766609 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 417/835] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:43:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:58.771217 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf8ffa-e0aa-44ee-b633-0deb733962bb None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:58.771217 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf8ffa-e0aa-44ee-b633-0deb733962bb None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:58.771217 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf8ffa-e0aa-44ee-b633-0deb733962bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:58.786310 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-96bf8ffa-e0aa-44ee-b633-0deb733962bb None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:43:58.787520 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-96bf8ffa-e0aa-44ee-b633-0deb733962bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:43:58.811756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:58.830810 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7fb6b-02fe-4a46-93ed-24e9964dd994 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:58.847110 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:58.866522 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 418/836] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:43:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:43:58.866522 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf8ffa-e0aa-44ee-b633-0deb733962bb None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:58.877091 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b29a2a-aeb2-4b4a-9294-ab69eeb2317b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:58.878621 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b29a2a-aeb2-4b4a-9294-ab69eeb2317b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:58.879113 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b29a2a-aeb2-4b4a-9294-ab69eeb2317b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:58.879615 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b29a2a-aeb2-4b4a-9294-ab69eeb2317b None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:58.880589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b29a2a-aeb2-4b4a-9294-ab69eeb2317b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:58.881613 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b29a2a-aeb2-4b4a-9294-ab69eeb2317b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:58.883624 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b29a2a-aeb2-4b4a-9294-ab69eeb2317b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:58.896440 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 419/837] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:43:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:58.899304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b29a2a-aeb2-4b4a-9294-ab69eeb2317b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:58.966385 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf8ffa-e0aa-44ee-b633-0deb733962bb None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:59.000312 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b29a2a-aeb2-4b4a-9294-ab69eeb2317b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:59.002116 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57101a6d-4cb8-4dfc-9fa8-a8f85f136174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:59.002925 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57101a6d-4cb8-4dfc-9fa8-a8f85f136174 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:59.003226 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57101a6d-4cb8-4dfc-9fa8-a8f85f136174 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:59.003510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57101a6d-4cb8-4dfc-9fa8-a8f85f136174 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:59.014073 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57101a6d-4cb8-4dfc-9fa8-a8f85f136174 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:59.015554 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57101a6d-4cb8-4dfc-9fa8-a8f85f136174 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:59.033499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-57101a6d-4cb8-4dfc-9fa8-a8f85f136174 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:59.033499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:59.033499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:59.033499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:59.033499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:59.033499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:59.033499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:59.033499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:59.033499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:59.033499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:59.033499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:59.033499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:59.033499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:43:59.033499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:43:59.033499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:43:59.034402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:43:59.034402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:59.034402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:59.034402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:59.034402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:59.034402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:59.034402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:59.034402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:59.034402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:59.034402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:59.034402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:59.034402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:59.034402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:59.034402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:59.034402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:59.034402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:59.034402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:59.035340 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:43:59.035340 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:43:59.035340 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:43:59.035340 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:43:59.035340 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 419/838] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:59.035612 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57101a6d-4cb8-4dfc-9fa8-a8f85f136174 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:59.041097 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baeca4a-55f5-47ac-8d80-f004d2075e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:59.041898 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baeca4a-55f5-47ac-8d80-f004d2075e78 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:59.042175 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baeca4a-55f5-47ac-8d80-f004d2075e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:59.042442 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baeca4a-55f5-47ac-8d80-f004d2075e78 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:59.043085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baeca4a-55f5-47ac-8d80-f004d2075e78 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:59.044492 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baeca4a-55f5-47ac-8d80-f004d2075e78 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:59.048401 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:59.056516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-2baeca4a-55f5-47ac-8d80-f004d2075e78 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 05:43:59.056516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:59.056516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 05:43:59.056516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 05:43:59.056516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 05:43:59.056516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 05:43:59.056516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 05:43:59.056516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:43:59.056516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 05:43:59.056516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:59.056516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 05:43:59.056516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:59.056516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:59.056516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:59.056516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:59.056516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:59.056516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:59.057479 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:59.057479 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:59.057479 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:59.057479 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:59.057479 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:59.057479 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:59.057479 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 05:43:59.057479 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 05:43:59.057479 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 05:43:59.057479 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 05:43:59.057479 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:59.057479 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:59.057479 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:59.057479 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:59.057479 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:59.057479 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:59.058908 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:59.058908 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:59.058908 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:59.058908 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:59.058908 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:59.058908 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:59.058908 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:59.058908 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:59.058908 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:59.058908 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:59.058908 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 05:43:59.058908 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:43:59.058908 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 05:43:59.058908 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:59.058908 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 420/839] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 4 05:43:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:59.059745 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baeca4a-55f5-47ac-8d80-f004d2075e78 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:59.104424 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:59.142904 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57101a6d-4cb8-4dfc-9fa8-a8f85f136174 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:59.169438 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baeca4a-55f5-47ac-8d80-f004d2075e78 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:59.179126 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2c4ed-b79f-4114-9b4a-55fe34e6a3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:59.180573 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2c4ed-b79f-4114-9b4a-55fe34e6a3ed None admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:59.180855 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2c4ed-b79f-4114-9b4a-55fe34e6a3ed None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:59.181162 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2c4ed-b79f-4114-9b4a-55fe34e6a3ed None admin] PATH_INFO: `/v3/projects/4bc610fb6724419dac99f2483089c783/users/3ed779ae7e0f4c90aaed6d1f9e86a4d0/roles/d775f350758d4eb8bfceeeb91e54351f` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:59.196332 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2c4ed-b79f-4114-9b4a-55fe34e6a3ed None admin] RBAC: Authorizing `identity:create_grant(project_id=4bc610fb6724419dac99f2483089c783, user_id=3ed779ae7e0f4c90aaed6d1f9e86a4d0, role_id=d775f350758d4eb8bfceeeb91e54351f)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:59.197904 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2c4ed-b79f-4114-9b4a-55fe34e6a3ed None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:59.204109 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53f342-6f18-4b37-b86d-5d1efdc07500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:59.204811 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53f342-6f18-4b37-b86d-5d1efdc07500 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:59.205083 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53f342-6f18-4b37-b86d-5d1efdc07500 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:59.205352 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53f342-6f18-4b37-b86d-5d1efdc07500 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:59.206058 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53f342-6f18-4b37-b86d-5d1efdc07500 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:59.206359 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53f342-6f18-4b37-b86d-5d1efdc07500 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:59.207832 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53f342-6f18-4b37-b86d-5d1efdc07500 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:59.219207 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 420/840] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 4 05:43:59 2022] PUT /identity/v3/projects/4bc610fb6724419dac99f2483089c783/users/3ed779ae7e0f4c90aaed6d1f9e86a4d0/roles/d775f350758d4eb8bfceeeb91e54351f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:43:59.219207 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2c4ed-b79f-4114-9b4a-55fe34e6a3ed None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:59.222691 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 421/841] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:59.228083 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53f342-6f18-4b37-b86d-5d1efdc07500 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:59.321177 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:59.353062 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:59.357418 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53f342-6f18-4b37-b86d-5d1efdc07500 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:59.373003 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2c4ed-b79f-4114-9b4a-55fe34e6a3ed None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:59.400683 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc4fc2-435d-4a0d-ae30-3c8826640a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:59.401759 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc4fc2-435d-4a0d-ae30-3c8826640a24 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:59.402184 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc4fc2-435d-4a0d-ae30-3c8826640a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:59.402598 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc4fc2-435d-4a0d-ae30-3c8826640a24 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:59.411526 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc4fc2-435d-4a0d-ae30-3c8826640a24 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:59.413181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc4fc2-435d-4a0d-ae30-3c8826640a24 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:59.415867 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5039ebb-e5eb-43c1-bcf6-7e630d7235f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:59.416608 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5039ebb-e5eb-43c1-bcf6-7e630d7235f6 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:59.416890 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5039ebb-e5eb-43c1-bcf6-7e630d7235f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:59.417159 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5039ebb-e5eb-43c1-bcf6-7e630d7235f6 None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:59.417860 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5039ebb-e5eb-43c1-bcf6-7e630d7235f6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:59.418186 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5039ebb-e5eb-43c1-bcf6-7e630d7235f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:59.419577 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5039ebb-e5eb-43c1-bcf6-7e630d7235f6 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:59.425014 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 421/842] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 4 05:43:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:59.429848 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-16cc4fc2-435d-4a0d-ae30-3c8826640a24 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 04 05:43:59.429848 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:43:59.429848 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:43:59.429848 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:43:59.429848 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:43:59.429848 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:43:59.429848 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:43:59.429848 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:43:59.429848 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:43:59.429848 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:43:59.429848 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:43:59.429848 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:43:59.429848 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:43:59.429848 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:43:59.429848 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:43:59.429848 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:43:59.430999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:43:59.430999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:43:59.430999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:43:59.430999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:59.430999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:43:59.430999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:43:59.430999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:43:59.430999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:43:59.430999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:43:59.430999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:43:59.430999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:43:59.430999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:43:59.430999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:43:59.430999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:43:59.430999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:43:59.430999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:43:59.430999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:43:59.430999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:43:59.432267 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:43:59.432267 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:43:59.432267 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:43:59.432267 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:43:59.432267 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:43:59.432267 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:43:59.432267 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:43:59.432267 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:43:59.432267 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 04 05:43:59.432267 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:43:59.432922 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5039ebb-e5eb-43c1-bcf6-7e630d7235f6 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:59.434517 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 422/843] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:43:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:43:59.440890 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc4fc2-435d-4a0d-ae30-3c8826640a24 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:59.550448 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5039ebb-e5eb-43c1-bcf6-7e630d7235f6 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:59.556527 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc4fc2-435d-4a0d-ae30-3c8826640a24 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:59.582429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:59.600118 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7c9c1-12d9-428b-869d-4642f4b1c1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:59.600802 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7c9c1-12d9-428b-869d-4642f4b1c1dc None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:59.601068 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7c9c1-12d9-428b-869d-4642f4b1c1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:59.601335 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7c9c1-12d9-428b-869d-4642f4b1c1dc None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:59.602171 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7c9c1-12d9-428b-869d-4642f4b1c1dc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:59.602473 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7c9c1-12d9-428b-869d-4642f4b1c1dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:59.603895 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed0dd1-ed3d-4b4e-aa6b-b778ad3a247f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:59.604286 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7c9c1-12d9-428b-869d-4642f4b1c1dc None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:59.604551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed0dd1-ed3d-4b4e-aa6b-b778ad3a247f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:59.604822 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed0dd1-ed3d-4b4e-aa6b-b778ad3a247f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:59.605086 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed0dd1-ed3d-4b4e-aa6b-b778ad3a247f None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:59.605788 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed0dd1-ed3d-4b4e-aa6b-b778ad3a247f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:43:59.606086 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed0dd1-ed3d-4b4e-aa6b-b778ad3a247f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:59.607518 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed0dd1-ed3d-4b4e-aa6b-b778ad3a247f None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:59.619638 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 422/844] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 4 05:43:59 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:43:59.627247 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 423/845] 10.222.0.16 () {56 vars in 1135 bytes} [Mon Jul 4 05:43:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:43:59.635317 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed0dd1-ed3d-4b4e-aa6b-b778ad3a247f None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:59.745310 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed0dd1-ed3d-4b4e-aa6b-b778ad3a247f None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:43:59.782230 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694fb4b-029d-41e1-9a09-31c55414b8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:43:59.782902 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694fb4b-029d-41e1-9a09-31c55414b8fd None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:43:59.783197 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694fb4b-029d-41e1-9a09-31c55414b8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:43:59.783483 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694fb4b-029d-41e1-9a09-31c55414b8fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:43:59.838264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:43:59.851557 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694fb4b-029d-41e1-9a09-31c55414b8fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:43:59.853082 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694fb4b-029d-41e1-9a09-31c55414b8fd None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:43:59.952130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 423/846] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:43:59 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 05:43:59.960295 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7c9c1-12d9-428b-869d-4642f4b1c1dc None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:43:59.983495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:00.065745 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7c9c1-12d9-428b-869d-4642f4b1c1dc None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:00.104907 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88080ef-de5d-45d4-aa21-782a5742c21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:00.105753 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88080ef-de5d-45d4-aa21-782a5742c21d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:00.106036 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88080ef-de5d-45d4-aa21-782a5742c21d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:00.106306 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88080ef-de5d-45d4-aa21-782a5742c21d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:00.116783 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88080ef-de5d-45d4-aa21-782a5742c21d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:00.118238 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88080ef-de5d-45d4-aa21-782a5742c21d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:00.136159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-a88080ef-de5d-45d4-aa21-782a5742c21d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:44:00.136159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:00.136159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:00.136159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:00.136159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:00.136159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:00.136159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:00.136159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:00.136159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:00.136159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:00.136159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:00.136159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:00.136159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:44:00.136159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:44:00.136159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:44:00.137080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:44:00.137080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:00.137080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:00.137080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:00.137080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:00.137080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:00.137080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:00.137080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:00.137080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:00.137080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:00.137080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:00.137080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:00.137080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:00.137080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:00.137080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:00.137080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:00.137080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:00.138115 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:44:00.138115 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:44:00.138115 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:44:00.138115 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:00.138115 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 424/847] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:43:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:00.143204 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694fb4b-029d-41e1-9a09-31c55414b8fd None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:00.231848 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:00.244062 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694fb4b-029d-41e1-9a09-31c55414b8fd None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:00.280522 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ef2f2-5b71-450e-aa9c-b7ef8bef4084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:00.281193 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ef2f2-5b71-450e-aa9c-b7ef8bef4084 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:00.281475 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ef2f2-5b71-450e-aa9c-b7ef8bef4084 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:00.281750 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ef2f2-5b71-450e-aa9c-b7ef8bef4084 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:00.282473 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ef2f2-5b71-450e-aa9c-b7ef8bef4084 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:00.282777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ef2f2-5b71-450e-aa9c-b7ef8bef4084 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:00.284197 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ef2f2-5b71-450e-aa9c-b7ef8bef4084 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:00.295951 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 424/848] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:00.301448 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88080ef-de5d-45d4-aa21-782a5742c21d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:00.373533 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:00.405896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88080ef-de5d-45d4-aa21-782a5742c21d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:00.441002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34440a-15c6-4140-8fd7-7de2be7923a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:00.441805 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34440a-15c6-4140-8fd7-7de2be7923a8 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:00.442080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34440a-15c6-4140-8fd7-7de2be7923a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:00.442351 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34440a-15c6-4140-8fd7-7de2be7923a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:00.449396 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34440a-15c6-4140-8fd7-7de2be7923a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:00.450842 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34440a-15c6-4140-8fd7-7de2be7923a8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:00.464456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-4b34440a-15c6-4140-8fd7-7de2be7923a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:44:00.464456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:00.464456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:00.464456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:00.464456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:00.464456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:00.464456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:00.464456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:00.464456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:00.464456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:00.464456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:00.464456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:00.464456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:44:00.464456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:44:00.464456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:44:00.465331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:44:00.465331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:00.465331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:00.465331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:00.465331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:00.465331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:00.465331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:00.465331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:00.465331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:00.465331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:00.465331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:00.465331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:00.465331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:00.465331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:00.465331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:00.465331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:00.465331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:00.466206 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:44:00.466206 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:44:00.466206 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:44:00.466206 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:44:00.466206 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:44:00.466206 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:44:00.466206 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:44:00.466206 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:00.466206 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 425/849] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:44:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:00.471592 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ef2f2-5b71-450e-aa9c-b7ef8bef4084 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:00.573319 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ef2f2-5b71-450e-aa9c-b7ef8bef4084 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:00.606986 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0dcee-1edb-43b6-9c58-36ce736547cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:00.607739 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0dcee-1edb-43b6-9c58-36ce736547cb None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:00.608024 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0dcee-1edb-43b6-9c58-36ce736547cb None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:00.608297 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0dcee-1edb-43b6-9c58-36ce736547cb None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:00.609144 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0dcee-1edb-43b6-9c58-36ce736547cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:00.609453 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0dcee-1edb-43b6-9c58-36ce736547cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:00.610895 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0dcee-1edb-43b6-9c58-36ce736547cb None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:00.623652 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 425/850] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:44:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:00.629634 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34440a-15c6-4140-8fd7-7de2be7923a8 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:00.649889 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808af2c-ab03-4a98-bcbf-37b1266d45e4 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:00.650180 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808af2c-ab03-4a98-bcbf-37b1266d45e4 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:00.650448 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808af2c-ab03-4a98-bcbf-37b1266d45e4 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:00.652203 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 426/851] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:44:00.660215 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b5ad1-d2ab-448c-abeb-bbb86f849ad0 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:00.660517 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b5ad1-d2ab-448c-abeb-bbb86f849ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:00.660771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b5ad1-d2ab-448c-abeb-bbb86f849ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:00.678290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-da9b5ad1-d2ab-448c-abeb-bbb86f849ad0 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:00.679466 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-da9b5ad1-d2ab-448c-abeb-bbb86f849ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:00.691525 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:00.735773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34440a-15c6-4140-8fd7-7de2be7923a8 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:00.759662 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 427/852] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 05:44:00.765571 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:00.771588 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9b6a1-7137-4767-9232-179b38ec70ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:00.772463 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9b6a1-7137-4767-9232-179b38ec70ac None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:00.773027 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9b6a1-7137-4767-9232-179b38ec70ac None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:00.773534 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9b6a1-7137-4767-9232-179b38ec70ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:00.774573 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9b6a1-7137-4767-9232-179b38ec70ac None admin] RBAC: Adding query filter params (role.id=6c5b161dbf33447fa1d383915d3c9382, scope.project.id=4bc610fb6724419dac99f2483089c783, user.id=e55a1c343c60428db2d9e5e6ed865e21) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:00.775107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9b6a1-7137-4767-9232-179b38ec70ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:00.776797 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9b6a1-7137-4767-9232-179b38ec70ac None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:00.783633 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 426/853] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:44:00 2022] GET /identity/v3/role_assignments?user.id=e55a1c343c60428db2d9e5e6ed865e21&scope.project.id=4bc610fb6724419dac99f2483089c783&role.id=6c5b161dbf33447fa1d383915d3c9382 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:00.790206 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b5ad1-d2ab-448c-abeb-bbb86f849ad0 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:00.911979 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b5ad1-d2ab-448c-abeb-bbb86f849ad0 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:00.950189 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fcaf9-5ef7-4cc3-8022-664c0639cb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:00.951019 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fcaf9-5ef7-4cc3-8022-664c0639cb44 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:00.951335 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fcaf9-5ef7-4cc3-8022-664c0639cb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:00.951609 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fcaf9-5ef7-4cc3-8022-664c0639cb44 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:00.952270 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773fcaf9-5ef7-4cc3-8022-664c0639cb44 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:00.953655 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773fcaf9-5ef7-4cc3-8022-664c0639cb44 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:00.966373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-773fcaf9-5ef7-4cc3-8022-664c0639cb44 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 05:44:00.966373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:00.966373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 05:44:00.966373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 05:44:00.966373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 05:44:00.966373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 05:44:00.966373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 05:44:00.966373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:44:00.966373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 05:44:00.966373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:00.966373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 05:44:00.966373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:00.966373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:00.966373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:00.966373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:00.966373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:00.967327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:00.967327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:00.967327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:00.967327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:00.967327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:00.967327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:00.967327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:00.967327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 05:44:00.967327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 05:44:00.967327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 05:44:00.967327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 05:44:00.967327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:00.967327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:00.967327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:00.967327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:00.967327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:00.968167 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:00.968167 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:00.968167 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:00.968167 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:00.968167 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:00.968167 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:00.968167 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:00.968167 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:00.968167 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:00.968167 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:00.968167 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:00.968167 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 05:44:00.968167 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:44:00.968167 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 05:44:00.968167 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:00.968167 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 428/854] 10.222.0.16 () {56 vars in 1132 bytes} [Mon Jul 4 05:44:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:00.975222 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9b6a1-7137-4767-9232-179b38ec70ac None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:01.081056 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9b6a1-7137-4767-9232-179b38ec70ac None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:01.114951 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41224eb-7df5-4b03-b32d-c21041dbdef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:01.116018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41224eb-7df5-4b03-b32d-c21041dbdef7 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:01.116537 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41224eb-7df5-4b03-b32d-c21041dbdef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:01.117041 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41224eb-7df5-4b03-b32d-c21041dbdef7 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:01.117940 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41224eb-7df5-4b03-b32d-c21041dbdef7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:01.118468 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41224eb-7df5-4b03-b32d-c21041dbdef7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:01.120091 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41224eb-7df5-4b03-b32d-c21041dbdef7 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:01.125513 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 427/855] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jul 4 05:44:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:44:01.131228 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fcaf9-5ef7-4cc3-8022-664c0639cb44 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:01.134374 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:01.236855 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fcaf9-5ef7-4cc3-8022-664c0639cb44 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:01.272558 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd93da1-ce6a-435f-8b01-edbec97153f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:01.273599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd93da1-ce6a-435f-8b01-edbec97153f8 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:01.274107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd93da1-ce6a-435f-8b01-edbec97153f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:01.274576 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd93da1-ce6a-435f-8b01-edbec97153f8 None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:01.275543 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd93da1-ce6a-435f-8b01-edbec97153f8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:01.276063 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd93da1-ce6a-435f-8b01-edbec97153f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:01.277631 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd93da1-ce6a-435f-8b01-edbec97153f8 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:01.283072 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 429/856] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jul 4 05:44:01 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:01.338026 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424562f-beed-4323-bb0a-7d3c648a447c None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:01.338557 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424562f-beed-4323-bb0a-7d3c648a447c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:01.339047 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424562f-beed-4323-bb0a-7d3c648a447c None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:01.341147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 428/857] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:44:01.347125 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5022ad-b42e-45b3-a654-96490cce25bc None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:01.347767 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5022ad-b42e-45b3-a654-96490cce25bc None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:01.348255 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5022ad-b42e-45b3-a654-96490cce25bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:01.366444 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-8c5022ad-b42e-45b3-a654-96490cce25bc None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:01.368096 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-8c5022ad-b42e-45b3-a654-96490cce25bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:01.437397 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:01.451313 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 430/858] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:44:01.470890 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424562f-beed-4323-bb0a-7d3c648a447c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:01.534103 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:01.577380 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424562f-beed-4323-bb0a-7d3c648a447c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:01.611098 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda7a96-0e4d-4132-bfeb-f1672befc451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:01.612292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda7a96-0e4d-4132-bfeb-f1672befc451 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:01.612791 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda7a96-0e4d-4132-bfeb-f1672befc451 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:01.613254 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda7a96-0e4d-4132-bfeb-f1672befc451 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:01.624746 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda7a96-0e4d-4132-bfeb-f1672befc451 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:44:01.632875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-9cda7a96-0e4d-4132-bfeb-f1672befc451 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:44:01.632875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:01.632875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:01.632875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:01.632875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:01.632875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:01.632875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:01.632875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:01.632875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:01.632875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:01.632875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:01.632875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:01.632875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:44:01.632875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:44:01.632875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:44:01.632875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:44:01.633844 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:44:01.633844 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:44:01.633844 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:44:01.633844 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:44:01.633844 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:01.633844 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:01.633844 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:01.633844 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:01.633844 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:01.633844 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:01.633844 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:01.633844 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:01.633844 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:01.633844 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:01.633844 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:01.633844 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:01.634740 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:01.634740 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:01.634740 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:01.634740 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:01.634740 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:44:01.634740 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:44:01.634740 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:44:01.634740 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:44:01.634740 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:44:01.634740 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:44:01.634740 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:44:01.634740 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:01.641760 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 429/859] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 4 05:44:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:01.643374 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5022ad-b42e-45b3-a654-96490cce25bc None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:01.742050 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5022ad-b42e-45b3-a654-96490cce25bc None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:01.756516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbae166-3d90-4bcc-8b1e-1ebee3bed4ef None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:01.756778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbae166-3d90-4bcc-8b1e-1ebee3bed4ef None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:01.757048 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbae166-3d90-4bcc-8b1e-1ebee3bed4ef None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:01.758634 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 430/860] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:44:01.763507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d66a89-e77c-4fea-8680-c05b66d8039b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:01.763789 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d66a89-e77c-4fea-8680-c05b66d8039b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:01.764060 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d66a89-e77c-4fea-8680-c05b66d8039b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:01.779034 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c48683-fc38-4373-a2e1-ddad4816d99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:01.780117 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c48683-fc38-4373-a2e1-ddad4816d99a None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:01.780441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-33d66a89-e77c-4fea-8680-c05b66d8039b None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:01.780728 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c48683-fc38-4373-a2e1-ddad4816d99a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:01.781156 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c48683-fc38-4373-a2e1-ddad4816d99a None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:01.781736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-33d66a89-e77c-4fea-8680-c05b66d8039b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:01.782198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c48683-fc38-4373-a2e1-ddad4816d99a None admin] RBAC: Adding query filter params (name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:01.782644 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c48683-fc38-4373-a2e1-ddad4816d99a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:01.784194 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c48683-fc38-4373-a2e1-ddad4816d99a None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:01.792813 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 431/861] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 4 05:44:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:01.798565 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c48683-fc38-4373-a2e1-ddad4816d99a None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:01.860085 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:01.872286 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 431/862] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 05:44:01.889110 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d66a89-e77c-4fea-8680-c05b66d8039b None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:01.922406 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c48683-fc38-4373-a2e1-ddad4816d99a None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:01.938455 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:01.967892 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04c61c-98d1-4ecf-aef4-b7968fc4879d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:01.969363 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04c61c-98d1-4ecf-aef4-b7968fc4879d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:01.969804 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04c61c-98d1-4ecf-aef4-b7968fc4879d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:01.970553 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04c61c-98d1-4ecf-aef4-b7968fc4879d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:01.984533 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04c61c-98d1-4ecf-aef4-b7968fc4879d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:01.986854 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04c61c-98d1-4ecf-aef4-b7968fc4879d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:01.991653 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d66a89-e77c-4fea-8680-c05b66d8039b None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:02.009552 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-8f04c61c-98d1-4ecf-aef4-b7968fc4879d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:44:02.009552 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:02.009552 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:02.009552 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:02.009552 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:02.009552 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:02.009552 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:02.009552 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:02.009552 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:02.009552 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:02.009552 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:02.009552 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:02.009552 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:44:02.009552 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:44:02.009552 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:44:02.010500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:44:02.010500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:02.010500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:02.010500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:02.010500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:02.010500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:02.010500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:02.010500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:02.010500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:02.010500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:02.010500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:02.010500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:02.010500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:02.010500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:02.010500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:02.010500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:02.010500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:02.011400 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:44:02.011400 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:44:02.011400 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:44:02.011400 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:02.017526 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 432/863] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:44:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:02.018245 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04c61c-98d1-4ecf-aef4-b7968fc4879d None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:02.036862 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e78ea-170d-4aa5-ba9c-49e46e73d3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:02.037540 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e78ea-170d-4aa5-ba9c-49e46e73d3cb None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:02.037823 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e78ea-170d-4aa5-ba9c-49e46e73d3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:02.038101 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e78ea-170d-4aa5-ba9c-49e46e73d3cb None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:02.038885 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e78ea-170d-4aa5-ba9c-49e46e73d3cb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:02.040589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e78ea-170d-4aa5-ba9c-49e46e73d3cb None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:02.059223 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 432/864] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 4 05:44:01 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 05:44:02.140074 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04c61c-98d1-4ecf-aef4-b7968fc4879d None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:02.153810 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:02.188361 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822cf79-bf75-4c1e-9b75-d325a8c60742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:02.189383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822cf79-bf75-4c1e-9b75-d325a8c60742 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:02.189848 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822cf79-bf75-4c1e-9b75-d325a8c60742 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:02.190320 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822cf79-bf75-4c1e-9b75-d325a8c60742 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:02.191268 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822cf79-bf75-4c1e-9b75-d325a8c60742 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:02.191756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822cf79-bf75-4c1e-9b75-d325a8c60742 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:02.193586 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822cf79-bf75-4c1e-9b75-d325a8c60742 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:02.208276 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 433/865] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:02.216320 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e78ea-170d-4aa5-ba9c-49e46e73d3cb None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:02.324978 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e78ea-170d-4aa5-ba9c-49e46e73d3cb None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:02.334323 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:02.360782 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583792b-fa94-40e0-8b1f-94d00d4c9798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:02.361604 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583792b-fa94-40e0-8b1f-94d00d4c9798 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:02.361886 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583792b-fa94-40e0-8b1f-94d00d4c9798 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:02.362158 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583792b-fa94-40e0-8b1f-94d00d4c9798 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:02.370084 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583792b-fa94-40e0-8b1f-94d00d4c9798 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:02.371890 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583792b-fa94-40e0-8b1f-94d00d4c9798 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:02.386509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-0583792b-fa94-40e0-8b1f-94d00d4c9798 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 05:44:02.386509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:02.386509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:02.386509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:02.386509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:02.386509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:02.386509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:02.386509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:02.386509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:02.386509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:02.386509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:02.386509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:02.386509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:44:02.386509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:44:02.386509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:44:02.386509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:44:02.387484 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:02.387484 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:02.387484 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:44:02.387484 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:44:02.387484 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:44:02.387484 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:44:02.387484 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:02.387484 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:02.387484 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:02.387484 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:02.387484 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:02.387484 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:02.387484 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:02.387484 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:02.387484 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:02.387484 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:02.387484 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:02.387484 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:02.388399 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:02.388399 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:02.388399 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:44:02.388399 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:44:02.388399 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:44:02.388399 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:44:02.388399 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:44:02.388399 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:44:02.388399 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 05:44:02.388399 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:02.388399 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 433/866] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jul 4 05:44:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:02.395217 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822cf79-bf75-4c1e-9b75-d325a8c60742 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:02.499981 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822cf79-bf75-4c1e-9b75-d325a8c60742 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:02.537939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed22c0-8a7c-44e5-8352-e922f28e053e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:02.539006 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed22c0-8a7c-44e5-8352-e922f28e053e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:02.539526 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed22c0-8a7c-44e5-8352-e922f28e053e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:02.539989 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed22c0-8a7c-44e5-8352-e922f28e053e None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:02.541459 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed22c0-8a7c-44e5-8352-e922f28e053e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:02.541923 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed22c0-8a7c-44e5-8352-e922f28e053e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:02.543973 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed22c0-8a7c-44e5-8352-e922f28e053e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:02.562902 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 434/867] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Jul 4 05:44:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:02.568460 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583792b-fa94-40e0-8b1f-94d00d4c9798 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:02.670896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583792b-fa94-40e0-8b1f-94d00d4c9798 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:02.704789 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb19f3b-9d19-4f26-ba56-c7181def1829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:02.705451 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb19f3b-9d19-4f26-ba56-c7181def1829 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:02.705736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb19f3b-9d19-4f26-ba56-c7181def1829 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:02.706014 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb19f3b-9d19-4f26-ba56-c7181def1829 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:02.747515 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:02.776817 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb19f3b-9d19-4f26-ba56-c7181def1829 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:02.778288 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb19f3b-9d19-4f26-ba56-c7181def1829 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:02.877677 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 434/868] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:44:02 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 05:44:02.883323 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed22c0-8a7c-44e5-8352-e922f28e053e None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:02.919640 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:02.953522 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce789914-a3c0-4cc3-a569-56679cecd310 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:02.953810 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce789914-a3c0-4cc3-a569-56679cecd310 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:02.953995 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce789914-a3c0-4cc3-a569-56679cecd310 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:02.956619 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 435/869] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:44:02.960610 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0631e-0dd5-481c-9259-3a2a2de30320 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:02.960891 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0631e-0dd5-481c-9259-3a2a2de30320 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:02.961167 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0631e-0dd5-481c-9259-3a2a2de30320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:02.977909 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-42d0631e-0dd5-481c-9259-3a2a2de30320 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:02.979094 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-42d0631e-0dd5-481c-9259-3a2a2de30320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:02.989544 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed22c0-8a7c-44e5-8352-e922f28e053e None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:03.029606 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748d09b-567d-427a-bbf3-c9e678aad872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:03.030502 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748d09b-567d-427a-bbf3-c9e678aad872 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:03.030788 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748d09b-567d-427a-bbf3-c9e678aad872 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:03.031068 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748d09b-567d-427a-bbf3-c9e678aad872 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:03.041853 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748d09b-567d-427a-bbf3-c9e678aad872 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:03.043391 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748d09b-567d-427a-bbf3-c9e678aad872 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:03.050492 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:03.057679 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 436/870] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:02 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 05:44:03.069427 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-6748d09b-567d-427a-bbf3-c9e678aad872 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:44:03.069427 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:03.069427 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:03.069427 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:03.069427 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:03.069427 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:03.069427 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:03.069427 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:03.069427 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:03.069427 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:03.069427 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:03.069427 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:03.069427 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:44:03.069427 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:44:03.069427 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:44:03.071450 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:44:03.071450 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:03.071450 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:03.071450 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:03.071450 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:03.071450 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:03.071450 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:03.071450 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:03.071450 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:03.071450 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:03.071450 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:03.071450 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:03.071450 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:03.071450 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:03.071450 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:03.071450 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:03.071450 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:03.073551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:44:03.073551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:44:03.073551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:44:03.073551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:03.073551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 435/871] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:03.079228 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0631e-0dd5-481c-9259-3a2a2de30320 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:03.080230 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748d09b-567d-427a-bbf3-c9e678aad872 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:03.160379 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:03.186244 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748d09b-567d-427a-bbf3-c9e678aad872 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:03.196972 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0631e-0dd5-481c-9259-3a2a2de30320 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:03.223058 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add19cd-cefc-4878-9a4c-3084ad62cc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:03.224150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add19cd-cefc-4878-9a4c-3084ad62cc48 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:03.224580 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add19cd-cefc-4878-9a4c-3084ad62cc48 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:03.225000 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add19cd-cefc-4878-9a4c-3084ad62cc48 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:03.225851 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add19cd-cefc-4878-9a4c-3084ad62cc48 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:03.227514 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add19cd-cefc-4878-9a4c-3084ad62cc48 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:03.237430 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed511b3-d8d0-4213-9688-3c8234b8dec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:03.238100 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed511b3-d8d0-4213-9688-3c8234b8dec2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:03.238384 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed511b3-d8d0-4213-9688-3c8234b8dec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:03.238664 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed511b3-d8d0-4213-9688-3c8234b8dec2 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:03.239419 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed511b3-d8d0-4213-9688-3c8234b8dec2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:03.239728 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed511b3-d8d0-4213-9688-3c8234b8dec2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:03.241240 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed511b3-d8d0-4213-9688-3c8234b8dec2 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:03.246799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-7add19cd-cefc-4878-9a4c-3084ad62cc48 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 05:44:03.246799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:03.246799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 05:44:03.246799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 05:44:03.246799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 05:44:03.246799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 05:44:03.246799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 05:44:03.246799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:44:03.246799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 05:44:03.246799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:03.246799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 05:44:03.246799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:03.246799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:03.246799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:03.246799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:03.246799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:03.246799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:03.247794 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:03.247794 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:03.247794 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:03.247794 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:03.247794 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:03.247794 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:03.247794 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 05:44:03.247794 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 05:44:03.247794 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 05:44:03.247794 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 05:44:03.247794 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:03.247794 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:03.247794 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:03.247794 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:03.247794 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:03.247794 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:03.248621 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:03.248621 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:03.248621 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:03.248621 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:03.248621 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:03.248621 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:03.248621 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:03.248621 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:03.248621 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:03.248621 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:03.248621 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 05:44:03.248621 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:44:03.248621 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 05:44:03.248621 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:03.257301 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 437/873] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:03.257470 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 436/873] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jul 4 05:44:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:03.258928 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed511b3-d8d0-4213-9688-3c8234b8dec2 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:03.260153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add19cd-cefc-4878-9a4c-3084ad62cc48 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:03.332727 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:03.378823 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add19cd-cefc-4878-9a4c-3084ad62cc48 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:03.379625 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed511b3-d8d0-4213-9688-3c8234b8dec2 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:03.415395 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9acce-b288-494f-b298-1a24478835ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:03.416486 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9acce-b288-494f-b298-1a24478835ba None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:03.417011 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9acce-b288-494f-b298-1a24478835ba None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:03.417507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9acce-b288-494f-b298-1a24478835ba None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:03.418413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a9acce-b288-494f-b298-1a24478835ba None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:03.418911 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a9acce-b288-494f-b298-1a24478835ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:03.419737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6836c1-ae50-4c95-977b-6cac61c64033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:03.420545 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6836c1-ae50-4c95-977b-6cac61c64033 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:03.420829 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6836c1-ae50-4c95-977b-6cac61c64033 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:03.421107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6836c1-ae50-4c95-977b-6cac61c64033 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:03.421333 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a9acce-b288-494f-b298-1a24478835ba None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:03.426160 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 438/874] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jul 4 05:44:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:03.427402 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0caa454-3b21-4d56-a968-4f8f13f1d86a None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:03.429304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0caa454-3b21-4d56-a968-4f8f13f1d86a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:03.429304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0caa454-3b21-4d56-a968-4f8f13f1d86a None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:03.429567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6836c1-ae50-4c95-977b-6cac61c64033 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:03.429656 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 439/875] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:44:03.429987 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6836c1-ae50-4c95-977b-6cac61c64033 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:03.433285 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0caa454-3b21-4d56-a968-4f8f13f1d86a None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:03.434847 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:03.449248 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-ae6836c1-ae50-4c95-977b-6cac61c64033 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:44:03.449248 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:03.449248 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:03.449248 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:03.449248 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:03.449248 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:03.449248 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:03.449248 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:03.449248 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:03.449248 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:03.449248 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:03.449248 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:03.449248 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:44:03.449248 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:44:03.449248 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:44:03.450349 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:44:03.450349 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:03.450349 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:03.450349 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:03.450349 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:03.450349 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:03.450349 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:03.450349 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:03.450349 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:03.450349 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:03.450349 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:03.450349 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:03.450349 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:03.450349 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:03.450349 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:03.450349 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:03.450349 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:03.451452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:44:03.451452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:44:03.451452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:44:03.451452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:44:03.451452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:44:03.451452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:44:03.451452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:44:03.451452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:03.453305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 437/876] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:44:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:03.454764 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de697b5-6722-4ceb-a6d6-5b0142ab6f3b None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:03.455051 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de697b5-6722-4ceb-a6d6-5b0142ab6f3b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:03.455363 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de697b5-6722-4ceb-a6d6-5b0142ab6f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:03.474873 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-2de697b5-6722-4ceb-a6d6-5b0142ab6f3b None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:03.476026 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-2de697b5-6722-4ceb-a6d6-5b0142ab6f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:03.547221 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 438/877] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:03 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:44:03.547221 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de697b5-6722-4ceb-a6d6-5b0142ab6f3b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:03.565428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0caa454-3b21-4d56-a968-4f8f13f1d86a None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:03.589078 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:03.602216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c683f-24fb-4e67-9990-599a16d5e2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:03.602935 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c683f-24fb-4e67-9990-599a16d5e2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:03.603274 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c683f-24fb-4e67-9990-599a16d5e2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:03.603523 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c683f-24fb-4e67-9990-599a16d5e2c9 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:03.604230 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c683f-24fb-4e67-9990-599a16d5e2c9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:03.604537 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c683f-24fb-4e67-9990-599a16d5e2c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:03.605920 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c683f-24fb-4e67-9990-599a16d5e2c9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:03.619213 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 440/878] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jul 4 05:44:03 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:44:03.619213 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c683f-24fb-4e67-9990-599a16d5e2c9 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:03.675442 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de697b5-6722-4ceb-a6d6-5b0142ab6f3b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:03.707721 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:03.714219 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89762c-caa5-4eaf-a175-1cf2667abe96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:03.715050 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89762c-caa5-4eaf-a175-1cf2667abe96 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:03.715457 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89762c-caa5-4eaf-a175-1cf2667abe96 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:03.715831 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89762c-caa5-4eaf-a175-1cf2667abe96 None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:03.716731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89762c-caa5-4eaf-a175-1cf2667abe96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:03.717160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89762c-caa5-4eaf-a175-1cf2667abe96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:03.718795 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89762c-caa5-4eaf-a175-1cf2667abe96 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:03.732183 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 439/879] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:44:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:03.739239 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89762c-caa5-4eaf-a175-1cf2667abe96 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:03.753920 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c683f-24fb-4e67-9990-599a16d5e2c9 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:03.802392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4027f3-3bd8-4f73-aff7-886fd5c71b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:03.803063 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4027f3-3bd8-4f73-aff7-886fd5c71b0b None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:03.803374 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4027f3-3bd8-4f73-aff7-886fd5c71b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:03.803653 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4027f3-3bd8-4f73-aff7-886fd5c71b0b None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:03.804369 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4027f3-3bd8-4f73-aff7-886fd5c71b0b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:03.805752 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4027f3-3bd8-4f73-aff7-886fd5c71b0b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:03.823160 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 441/880] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 4 05:44:03 2022] POST /identity/v3/services => generated 269 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:44:03.861055 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89762c-caa5-4eaf-a175-1cf2667abe96 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:03.908777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f56734-b6c0-4f34-83e9-bc1f50629cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:03.909790 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f56734-b6c0-4f34-83e9-bc1f50629cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:03.910305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f56734-b6c0-4f34-83e9-bc1f50629cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:03.910752 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f56734-b6c0-4f34-83e9-bc1f50629cf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:03.911842 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f56734-b6c0-4f34-83e9-bc1f50629cf0 None admin] RBAC: Adding query filter params (role.id=d775f350758d4eb8bfceeeb91e54351f, scope.project.id=4bc610fb6724419dac99f2483089c783, user.id=3ed779ae7e0f4c90aaed6d1f9e86a4d0) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:03.912339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f56734-b6c0-4f34-83e9-bc1f50629cf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:03.913993 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f56734-b6c0-4f34-83e9-bc1f50629cf0 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:03.921768 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 440/881] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:44:03 2022] GET /identity/v3/role_assignments?user.id=3ed779ae7e0f4c90aaed6d1f9e86a4d0&scope.project.id=4bc610fb6724419dac99f2483089c783&role.id=d775f350758d4eb8bfceeeb91e54351f => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:04.247656 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15760595-979d-4a36-96fe-2ebd4695aaff None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:04.248068 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15760595-979d-4a36-96fe-2ebd4695aaff None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:04.248243 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15760595-979d-4a36-96fe-2ebd4695aaff None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:04.249854 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 442/882] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:44:04.254934 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acba34-f2cd-4bef-9faa-c6739131c2f0 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:04.255245 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acba34-f2cd-4bef-9faa-c6739131c2f0 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:04.255520 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acba34-f2cd-4bef-9faa-c6739131c2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:04.273517 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-76acba34-f2cd-4bef-9faa-c6739131c2f0 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:04.274716 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-76acba34-f2cd-4bef-9faa-c6739131c2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:04.323219 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:04.346034 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 441/883] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:44:04.368625 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15760595-979d-4a36-96fe-2ebd4695aaff None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:04.423028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:04.479670 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15760595-979d-4a36-96fe-2ebd4695aaff None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:04.513947 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040ffb4-29b2-45e8-898f-658be3e80413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:04.515093 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040ffb4-29b2-45e8-898f-658be3e80413 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:04.515593 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040ffb4-29b2-45e8-898f-658be3e80413 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:04.516077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040ffb4-29b2-45e8-898f-658be3e80413 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:04.516918 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040ffb4-29b2-45e8-898f-658be3e80413 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:04.518503 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040ffb4-29b2-45e8-898f-658be3e80413 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:04.530838 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-a040ffb4-29b2-45e8-898f-658be3e80413 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 05:44:04.530838 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:04.530838 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 05:44:04.530838 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 05:44:04.530838 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 05:44:04.530838 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 05:44:04.530838 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 05:44:04.530838 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:44:04.530838 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 05:44:04.530838 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:04.530838 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 05:44:04.530838 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:04.530838 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:04.530838 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:04.530838 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:04.530838 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:04.530838 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:04.531881 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:04.531881 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:04.531881 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:04.531881 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:04.531881 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:04.531881 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:04.531881 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 05:44:04.531881 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 05:44:04.531881 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 05:44:04.531881 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 05:44:04.531881 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:04.531881 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:04.531881 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:04.531881 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:04.531881 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:04.531881 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:04.532719 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:04.532719 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:04.532719 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:04.532719 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:04.532719 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:04.532719 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:04.532719 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:04.532719 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:04.532719 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:04.532719 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:04.532719 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 05:44:04.532719 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:44:04.532719 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 05:44:04.532719 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:04.536080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 443/884] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 4 05:44:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:04.541613 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acba34-f2cd-4bef-9faa-c6739131c2f0 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:04.643134 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acba34-f2cd-4bef-9faa-c6739131c2f0 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:04.677633 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee8cf5-92e8-4e3d-a99f-c446c623a2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:04.678298 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee8cf5-92e8-4e3d-a99f-c446c623a2b5 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:04.678576 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee8cf5-92e8-4e3d-a99f-c446c623a2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:04.678849 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee8cf5-92e8-4e3d-a99f-c446c623a2b5 None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:04.679578 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee8cf5-92e8-4e3d-a99f-c446c623a2b5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:04.679881 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee8cf5-92e8-4e3d-a99f-c446c623a2b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:04.681362 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee8cf5-92e8-4e3d-a99f-c446c623a2b5 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:04.686607 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 442/885] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 4 05:44:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:04.692230 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040ffb4-29b2-45e8-898f-658be3e80413 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:04.800631 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040ffb4-29b2-45e8-898f-658be3e80413 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:04.811566 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:04.834899 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a978c-8552-48bd-8812-0e8eaaade27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:04.835894 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a978c-8552-48bd-8812-0e8eaaade27e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:04.836378 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a978c-8552-48bd-8812-0e8eaaade27e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:04.836850 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a978c-8552-48bd-8812-0e8eaaade27e None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:04.837832 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a978c-8552-48bd-8812-0e8eaaade27e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:04.838331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a978c-8552-48bd-8812-0e8eaaade27e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:04.839963 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a978c-8552-48bd-8812-0e8eaaade27e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:04.845336 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 444/886] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 4 05:44:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:04.850953 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee8cf5-92e8-4e3d-a99f-c446c623a2b5 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:04.896915 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:04.950811 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee8cf5-92e8-4e3d-a99f-c446c623a2b5 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:04.984664 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be034ba-42b8-4a38-adf0-691be2cbeace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:04.985328 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be034ba-42b8-4a38-adf0-691be2cbeace None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:04.985610 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be034ba-42b8-4a38-adf0-691be2cbeace None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:04.985886 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be034ba-42b8-4a38-adf0-691be2cbeace None admin] PATH_INFO: `/v3/endpoints` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:04.986736 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be034ba-42b8-4a38-adf0-691be2cbeace None admin] RBAC: Adding query filter params (interface=public, service_id=b44d74d1d99745f58a68d6f43dc09fc2, region_id=RegionOne) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:04.987049 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be034ba-42b8-4a38-adf0-691be2cbeace None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:04.988446 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be034ba-42b8-4a38-adf0-691be2cbeace None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:04.993899 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 443/887] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Jul 4 05:44:04 2022] GET /identity/v3/endpoints?service_id=b44d74d1d99745f58a68d6f43dc09fc2&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:05.000279 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a978c-8552-48bd-8812-0e8eaaade27e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:05.107145 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a978c-8552-48bd-8812-0e8eaaade27e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:05.148225 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca621b-b24c-4048-bf40-9a52091aeeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:05.148952 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca621b-b24c-4048-bf40-9a52091aeeec None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:05.149237 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca621b-b24c-4048-bf40-9a52091aeeec None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:05.149545 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca621b-b24c-4048-bf40-9a52091aeeec None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:05.150275 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca621b-b24c-4048-bf40-9a52091aeeec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:05.151699 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca621b-b24c-4048-bf40-9a52091aeeec None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:05.158289 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 445/888] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jul 4 05:44:04 2022] GET /identity/v3/services => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:44:05.719122 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cdcc4-ed11-4d85-ac84-56f6a1668a33 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:05.719705 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cdcc4-ed11-4d85-ac84-56f6a1668a33 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:05.719705 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cdcc4-ed11-4d85-ac84-56f6a1668a33 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:05.721331 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 444/889] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:44:05.726994 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ef611-5ecd-4814-96ae-b4b9ff651061 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:05.727465 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ef611-5ecd-4814-96ae-b4b9ff651061 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:05.727589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ef611-5ecd-4814-96ae-b4b9ff651061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:05.744625 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-278ef611-5ecd-4814-96ae-b4b9ff651061 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:05.745802 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-278ef611-5ecd-4814-96ae-b4b9ff651061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:05.776723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:05.820844 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 446/890] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:44:05.843514 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2cdcc4-ed11-4d85-ac84-56f6a1668a33 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:05.949285 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2cdcc4-ed11-4d85-ac84-56f6a1668a33 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:05.959265 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:05.985272 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87f45a-467a-4545-a59b-60f2168b3e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:05.985945 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87f45a-467a-4545-a59b-60f2168b3e87 None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:05.986226 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87f45a-467a-4545-a59b-60f2168b3e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:05.986497 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87f45a-467a-4545-a59b-60f2168b3e87 None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:05.987331 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87f45a-467a-4545-a59b-60f2168b3e87 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:05.988706 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87f45a-467a-4545-a59b-60f2168b3e87 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:06.006177 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 445/891] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 4 05:44:05 2022] POST /identity/v3/services => generated 241 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:44:06.026200 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9d29c-44a2-4994-8bb1-c2416d9cc3a8 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:06.026508 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9d29c-44a2-4994-8bb1-c2416d9cc3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:06.026759 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9d29c-44a2-4994-8bb1-c2416d9cc3a8 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:06.028533 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 447/892] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:44:06.034391 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77223a-9ada-42db-96b2-0ab33460ce3a None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:06.034676 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77223a-9ada-42db-96b2-0ab33460ce3a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:06.034951 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77223a-9ada-42db-96b2-0ab33460ce3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:06.052890 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-9e77223a-9ada-42db-96b2-0ab33460ce3a None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:06.054119 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9e77223a-9ada-42db-96b2-0ab33460ce3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:06.059738 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26323293-77d2-47dd-a032-f4fafe2fc287 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:06.060058 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26323293-77d2-47dd-a032-f4fafe2fc287 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:06.060283 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26323293-77d2-47dd-a032-f4fafe2fc287 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:06.061995 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 448/893] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:44:06.068899 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6d04d-80e1-4988-b712-fc0b1250ea3a None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:06.069353 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6d04d-80e1-4988-b712-fc0b1250ea3a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:06.069730 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6d04d-80e1-4988-b712-fc0b1250ea3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:06.092130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-21a6d04d-80e1-4988-b712-fc0b1250ea3a None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:06.093428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-21a6d04d-80e1-4988-b712-fc0b1250ea3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:06.139083 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 446/894] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:44:06.166567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77223a-9ada-42db-96b2-0ab33460ce3a None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:06.190996 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 449/895] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 05:44:06.214011 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6d04d-80e1-4988-b712-fc0b1250ea3a None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:06.273218 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:06.282766 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77223a-9ada-42db-96b2-0ab33460ce3a None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:06.320900 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872f9b0-1584-40b0-9aa7-e88d45f9b9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:06.321875 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872f9b0-1584-40b0-9aa7-e88d45f9b9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:06.322155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872f9b0-1584-40b0-9aa7-e88d45f9b9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:06.322427 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872f9b0-1584-40b0-9aa7-e88d45f9b9c3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:06.323076 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872f9b0-1584-40b0-9aa7-e88d45f9b9c3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:06.324589 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872f9b0-1584-40b0-9aa7-e88d45f9b9c3 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:06.334499 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:06.336842 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-0872f9b0-1584-40b0-9aa7-e88d45f9b9c3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 05:44:06.336842 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:06.336842 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 05:44:06.336842 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 05:44:06.336842 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 05:44:06.336842 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 05:44:06.336842 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 05:44:06.336842 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:44:06.336842 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 05:44:06.336842 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:06.336842 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 05:44:06.336842 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:06.336842 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:06.336842 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:06.336842 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:06.336842 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:06.337799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:06.337799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:06.337799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:06.337799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:06.337799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:06.337799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:06.337799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:06.337799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 05:44:06.337799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 05:44:06.337799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 05:44:06.337799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 05:44:06.337799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:06.337799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:06.337799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:06.337799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:06.337799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:06.338613 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:06.338613 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:06.338613 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:06.338613 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:06.338613 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:06.338613 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:06.338613 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:06.338613 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:06.338613 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:06.338613 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:06.338613 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:06.338613 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 05:44:06.338613 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:44:06.338613 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 05:44:06.338613 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:06.338613 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 447/896] 10.222.0.16 () {56 vars in 1132 bytes} [Mon Jul 4 05:44:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:44:06.342848 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6d04d-80e1-4988-b712-fc0b1250ea3a None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:06.344894 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872f9b0-1584-40b0-9aa7-e88d45f9b9c3 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:06.388807 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e3263-ccd2-46e7-867a-566a15c908ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:06.390437 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e3263-ccd2-46e7-867a-566a15c908ee None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:06.391364 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e3263-ccd2-46e7-867a-566a15c908ee None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:06.392149 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e3263-ccd2-46e7-867a-566a15c908ee None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:06.406567 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e3263-ccd2-46e7-867a-566a15c908ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:44:06.415557 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-9a4e3263-ccd2-46e7-867a-566a15c908ee None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 05:44:06.415557 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:06.415557 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:06.415557 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:06.415557 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:06.415557 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:06.415557 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:06.415557 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:06.415557 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:06.415557 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:06.415557 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:06.415557 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:06.415557 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:44:06.415557 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:44:06.415557 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:44:06.415557 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:44:06.416495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:44:06.416495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:44:06.416495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:44:06.416495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:44:06.416495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:06.416495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:06.416495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:06.416495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:06.416495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:06.416495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:06.416495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:06.416495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:06.416495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:06.416495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:06.416495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:06.416495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:06.417328 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:06.417328 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:06.417328 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:06.417328 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:06.417328 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:44:06.417328 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:44:06.417328 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:44:06.417328 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:44:06.417328 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:44:06.417328 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:44:06.417328 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 05:44:06.417328 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:06.422098 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 450/897] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Jul 4 05:44:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:44:06.422883 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e3263-ccd2-46e7-867a-566a15c908ee None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:06.457234 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872f9b0-1584-40b0-9aa7-e88d45f9b9c3 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:06.494658 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6617e-6167-4a82-b7d5-9f67cf295af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:06.495717 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6617e-6167-4a82-b7d5-9f67cf295af5 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:06.496507 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6617e-6167-4a82-b7d5-9f67cf295af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:06.497062 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6617e-6167-4a82-b7d5-9f67cf295af5 None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:06.498059 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e6617e-6167-4a82-b7d5-9f67cf295af5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:06.498590 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e6617e-6167-4a82-b7d5-9f67cf295af5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:06.500280 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e6617e-6167-4a82-b7d5-9f67cf295af5 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:06.510613 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 448/898] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jul 4 05:44:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:44:06.511857 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6617e-6167-4a82-b7d5-9f67cf295af5 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:06.543599 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e3263-ccd2-46e7-867a-566a15c908ee None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:06.547871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:06.589251 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a61de-5ef8-4941-b8b7-16b0dd718b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:06.590163 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a61de-5ef8-4941-b8b7-16b0dd718b01 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:06.590819 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a61de-5ef8-4941-b8b7-16b0dd718b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:06.591097 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a61de-5ef8-4941-b8b7-16b0dd718b01 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:06.592115 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a61de-5ef8-4941-b8b7-16b0dd718b01 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:06.592418 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a61de-5ef8-4941-b8b7-16b0dd718b01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:06.594084 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a61de-5ef8-4941-b8b7-16b0dd718b01 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:06.607487 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 451/899] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Jul 4 05:44:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:06.610416 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a61de-5ef8-4941-b8b7-16b0dd718b01 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:06.635111 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6617e-6167-4a82-b7d5-9f67cf295af5 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:06.640618 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:06.672933 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b3d04-a874-4844-a20f-94540b189e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:06.673738 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b3d04-a874-4844-a20f-94540b189e29 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:06.674027 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b3d04-a874-4844-a20f-94540b189e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:06.674351 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b3d04-a874-4844-a20f-94540b189e29 None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:06.675147 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b3d04-a874-4844-a20f-94540b189e29 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:06.675480 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b3d04-a874-4844-a20f-94540b189e29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:06.676953 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b3d04-a874-4844-a20f-94540b189e29 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:06.689909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 449/900] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jul 4 05:44:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:06.690916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b3d04-a874-4844-a20f-94540b189e29 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:06.759209 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a61de-5ef8-4941-b8b7-16b0dd718b01 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:06.783236 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:06.801077 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b3d04-a874-4844-a20f-94540b189e29 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:06.807283 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65fdc7-ecf1-47ce-a924-db309018ea29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:06.808380 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65fdc7-ecf1-47ce-a924-db309018ea29 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:06.808851 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65fdc7-ecf1-47ce-a924-db309018ea29 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:06.809312 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65fdc7-ecf1-47ce-a924-db309018ea29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:06.824231 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65fdc7-ecf1-47ce-a924-db309018ea29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:06.826630 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65fdc7-ecf1-47ce-a924-db309018ea29 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:06.841587 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4902d-8f90-4516-9336-fd59154425ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:06.842261 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4902d-8f90-4516-9336-fd59154425ca None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:06.842593 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4902d-8f90-4516-9336-fd59154425ca None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:06.842874 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4902d-8f90-4516-9336-fd59154425ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:06.843716 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4902d-8f90-4516-9336-fd59154425ca None admin] RBAC: Adding query filter params (interface=public, service_id=305e3b681013490c83ca6ec7069f707e, region_id=RegionOne) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:06.844139 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4902d-8f90-4516-9336-fd59154425ca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:06.845536 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4902d-8f90-4516-9336-fd59154425ca None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:06.850146 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-fa65fdc7-ecf1-47ce-a924-db309018ea29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:44:06.850146 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:06.850146 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:06.850146 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:06.850146 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:06.850146 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:06.850146 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:06.850146 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:06.850146 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:06.850146 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:06.850146 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:06.850146 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:06.850146 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:44:06.850146 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:44:06.850146 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:44:06.851096 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:44:06.851096 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:06.851096 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:06.851096 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:06.851096 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:06.851096 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:06.851096 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:06.851096 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:06.851096 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:06.851096 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:06.851096 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:06.851096 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:06.851096 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:06.851096 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:06.851096 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:06.851096 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:06.851096 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:06.852000 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:44:06.852000 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:44:06.852000 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:44:06.852000 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:06.858763 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 450/902] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Jul 4 05:44:06 2022] GET /identity/v3/endpoints?service_id=305e3b681013490c83ca6ec7069f707e&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:44:06.858763 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4902d-8f90-4516-9336-fd59154425ca None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:06.859091 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 452/902] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:44:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:44:06.860446 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65fdc7-ecf1-47ce-a924-db309018ea29 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:06.943454 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:06.975145 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65fdc7-ecf1-47ce-a924-db309018ea29 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:06.980657 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4902d-8f90-4516-9336-fd59154425ca None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:07.017935 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886ccfb-59df-4045-837b-0bb2487b5366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:07.018843 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174a257-abc1-437e-82a0-d46bb0753ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:07.019057 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886ccfb-59df-4045-837b-0bb2487b5366 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:07.019516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886ccfb-59df-4045-837b-0bb2487b5366 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:07.019827 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174a257-abc1-437e-82a0-d46bb0753ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:07.020072 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886ccfb-59df-4045-837b-0bb2487b5366 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:07.020285 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174a257-abc1-437e-82a0-d46bb0753ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:07.020688 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174a257-abc1-437e-82a0-d46bb0753ad0 None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:07.021233 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a886ccfb-59df-4045-837b-0bb2487b5366 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:07.021564 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174a257-abc1-437e-82a0-d46bb0753ad0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:07.021823 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a886ccfb-59df-4045-837b-0bb2487b5366 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:07.023239 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174a257-abc1-437e-82a0-d46bb0753ad0 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:07.023479 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a886ccfb-59df-4045-837b-0bb2487b5366 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:07.035329 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 451/903] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jul 4 05:44:06 2022] GET /identity/v3/services => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:44:07.041959 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 453/904] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:07.043374 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174a257-abc1-437e-82a0-d46bb0753ad0 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:07.061625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:07.163572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174a257-abc1-437e-82a0-d46bb0753ad0 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:07.205940 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4656b9-1908-47ef-b8d0-3eb045bf3a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:07.207202 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4656b9-1908-47ef-b8d0-3eb045bf3a1c None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:07.207625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4656b9-1908-47ef-b8d0-3eb045bf3a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:07.208035 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4656b9-1908-47ef-b8d0-3eb045bf3a1c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:07.219839 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4656b9-1908-47ef-b8d0-3eb045bf3a1c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:07.222600 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4656b9-1908-47ef-b8d0-3eb045bf3a1c None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:07.230294 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b0084-26e6-44bd-80d7-0213a099e0ed None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:07.230575 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b0084-26e6-44bd-80d7-0213a099e0ed None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:07.230854 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b0084-26e6-44bd-80d7-0213a099e0ed None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:07.232618 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 454/905] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:44:07.238169 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ccb42-f79e-40dc-b4b1-281dd6cb36ad None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:07.238464 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ccb42-f79e-40dc-b4b1-281dd6cb36ad None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:07.238734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ccb42-f79e-40dc-b4b1-281dd6cb36ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:07.241534 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-db4656b9-1908-47ef-b8d0-3eb045bf3a1c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 05:44:07.241534 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:07.241534 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:07.241534 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:07.241534 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:07.241534 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:07.241534 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:07.241534 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:07.241534 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:07.241534 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:07.241534 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:07.241534 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:07.241534 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:44:07.241534 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:44:07.241534 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:44:07.241534 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:44:07.242456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:07.242456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:07.242456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:44:07.242456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:44:07.242456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:44:07.242456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:44:07.242456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:07.242456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:07.242456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:07.242456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:07.242456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:07.242456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:07.242456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:07.242456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:07.242456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:07.242456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:07.242456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:07.242456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:07.243903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:07.243903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:07.243903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:44:07.243903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:44:07.243903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:44:07.243903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:44:07.243903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:44:07.243903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:44:07.243903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 05:44:07.243903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:07.243903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 452/906] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jul 4 05:44:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:07.250262 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4656b9-1908-47ef-b8d0-3eb045bf3a1c None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:07.260765 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-955ccb42-f79e-40dc-b4b1-281dd6cb36ad None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:07.261661 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-955ccb42-f79e-40dc-b4b1-281dd6cb36ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:07.335675 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:07.363268 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 455/907] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:44:07.370380 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4656b9-1908-47ef-b8d0-3eb045bf3a1c None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:07.387979 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ccb42-f79e-40dc-b4b1-281dd6cb36ad None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:07.421348 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7e77e-a9db-498d-8916-47a54f748f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:07.422611 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7e77e-a9db-498d-8916-47a54f748f5d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:07.423567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7e77e-a9db-498d-8916-47a54f748f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:07.423846 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7e77e-a9db-498d-8916-47a54f748f5d None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:07.424703 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7e77e-a9db-498d-8916-47a54f748f5d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:07.425011 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7e77e-a9db-498d-8916-47a54f748f5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:07.426451 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7e77e-a9db-498d-8916-47a54f748f5d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:07.444887 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 453/908] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Jul 4 05:44:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:44:07.450563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7e77e-a9db-498d-8916-47a54f748f5d None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:07.462699 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:07.522616 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ccb42-f79e-40dc-b4b1-281dd6cb36ad None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:07.563826 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7e77e-a9db-498d-8916-47a54f748f5d None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:07.567650 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ea144-bff9-421a-9dc8-9ce2af5b5e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:07.568545 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ea144-bff9-421a-9dc8-9ce2af5b5e33 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:07.568898 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ea144-bff9-421a-9dc8-9ce2af5b5e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:07.569265 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ea144-bff9-421a-9dc8-9ce2af5b5e33 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:07.569987 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ea144-bff9-421a-9dc8-9ce2af5b5e33 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:07.571512 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ea144-bff9-421a-9dc8-9ce2af5b5e33 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:07.587558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-b68ea144-bff9-421a-9dc8-9ce2af5b5e33 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 05:44:07.587558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:07.587558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 05:44:07.587558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 05:44:07.587558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 05:44:07.587558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 05:44:07.587558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 05:44:07.587558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:44:07.587558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 05:44:07.587558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:07.587558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 05:44:07.587558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:07.587558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:07.587558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:07.587558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:07.587558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:07.587558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:07.588558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:07.588558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:07.588558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:07.588558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:07.588558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:07.588558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:07.588558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 05:44:07.588558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 05:44:07.588558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 05:44:07.588558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 05:44:07.588558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:07.588558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:07.588558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:07.588558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:07.588558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:07.588558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:07.589381 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:07.589381 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:07.589381 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:07.589381 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:07.589381 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:07.589381 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:07.589381 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:07.589381 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:07.589381 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:07.589381 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:07.589381 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 05:44:07.589381 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:44:07.589381 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 05:44:07.589381 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:07.591332 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 456/909] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 4 05:44:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:44:07.596017 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ea144-bff9-421a-9dc8-9ce2af5b5e33 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:07.600517 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:07.606254 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ada6d-97c8-4091-8659-8ffc1e6739a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:07.607085 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ada6d-97c8-4091-8659-8ffc1e6739a3 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:07.607529 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ada6d-97c8-4091-8659-8ffc1e6739a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:07.607925 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ada6d-97c8-4091-8659-8ffc1e6739a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:07.684679 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ada6d-97c8-4091-8659-8ffc1e6739a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:07.686104 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ada6d-97c8-4091-8659-8ffc1e6739a3 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:07.706560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ea144-bff9-421a-9dc8-9ce2af5b5e33 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:07.732536 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:07.742401 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15a7b3-b05a-422c-a1b5-10c3b083fcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:07.743662 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15a7b3-b05a-422c-a1b5-10c3b083fcd4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:07.743948 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15a7b3-b05a-422c-a1b5-10c3b083fcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:07.744222 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15a7b3-b05a-422c-a1b5-10c3b083fcd4 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:07.744926 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15a7b3-b05a-422c-a1b5-10c3b083fcd4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:07.745226 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15a7b3-b05a-422c-a1b5-10c3b083fcd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:07.747120 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15a7b3-b05a-422c-a1b5-10c3b083fcd4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:07.752703 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 457/910] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 4 05:44:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:44:07.758795 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15a7b3-b05a-422c-a1b5-10c3b083fcd4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:07.807365 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 454/911] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:44:07 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 04 05:44:07.808283 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ada6d-97c8-4091-8659-8ffc1e6739a3 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:07.850611 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:07.883397 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15a7b3-b05a-422c-a1b5-10c3b083fcd4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:07.921048 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8e70b-f5e9-4dc4-85b2-6ad67a5b88fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:07.921727 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8e70b-f5e9-4dc4-85b2-6ad67a5b88fa None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:07.922008 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8e70b-f5e9-4dc4-85b2-6ad67a5b88fa None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:07.922285 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8e70b-f5e9-4dc4-85b2-6ad67a5b88fa None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:07.922998 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8e70b-f5e9-4dc4-85b2-6ad67a5b88fa None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:07.923349 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8e70b-f5e9-4dc4-85b2-6ad67a5b88fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:07.924828 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8e70b-f5e9-4dc4-85b2-6ad67a5b88fa None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:07.934811 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 458/912] 10.222.0.16 () {56 vars in 1114 bytes} [Mon Jul 4 05:44:07 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:44:07.936020 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8e70b-f5e9-4dc4-85b2-6ad67a5b88fa None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:07.947872 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ada6d-97c8-4091-8659-8ffc1e6739a3 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:07.986820 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1814d-0d81-4e9b-977f-3dfe3b28d846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:07.989754 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1814d-0d81-4e9b-977f-3dfe3b28d846 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:07.990038 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1814d-0d81-4e9b-977f-3dfe3b28d846 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:07.990319 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1814d-0d81-4e9b-977f-3dfe3b28d846 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:08.002040 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e1814d-0d81-4e9b-977f-3dfe3b28d846 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:08.002842 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:08.004838 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e1814d-0d81-4e9b-977f-3dfe3b28d846 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:08.027489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-21e1814d-0d81-4e9b-977f-3dfe3b28d846 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:44:08.027489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:08.027489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:08.027489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:08.027489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:08.027489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:08.027489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:08.027489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:08.027489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:08.027489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:08.027489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:08.027489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:08.027489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:44:08.027489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:44:08.027489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:44:08.029452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:44:08.029452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:08.029452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:08.029452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:08.029452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:08.029452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:08.029452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:08.029452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:08.029452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:08.029452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:08.029452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:08.029452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:08.029452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:08.029452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:08.029452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:08.029452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:08.029452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:08.031596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:44:08.031596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:44:08.031596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:44:08.031596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:08.031596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 455/913] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:44:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:08.035955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1814d-0d81-4e9b-977f-3dfe3b28d846 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:08.061950 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8e70b-f5e9-4dc4-85b2-6ad67a5b88fa None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:08.108995 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99794e1-2d2d-479d-82f3-fffe1a07751b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:08.108995 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99794e1-2d2d-479d-82f3-fffe1a07751b None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:08.108995 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99794e1-2d2d-479d-82f3-fffe1a07751b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:08.108995 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99794e1-2d2d-479d-82f3-fffe1a07751b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:08.110119 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99794e1-2d2d-479d-82f3-fffe1a07751b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:08.111684 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99794e1-2d2d-479d-82f3-fffe1a07751b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:08.136049 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 459/914] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jul 4 05:44:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 05:44:08.158364 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:08.177201 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb217c-6573-49e4-9ce5-1f80aeb02dfb None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:08.177527 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb217c-6573-49e4-9ce5-1f80aeb02dfb None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:08.177625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1814d-0d81-4e9b-977f-3dfe3b28d846 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:08.177799 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb217c-6573-49e4-9ce5-1f80aeb02dfb None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:08.179295 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 460/915] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:44:08.185116 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac77a9-49fb-4e9d-a2f1-7c377d270346 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:08.185400 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac77a9-49fb-4e9d-a2f1-7c377d270346 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:08.185580 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac77a9-49fb-4e9d-a2f1-7c377d270346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:08.204005 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-1bac77a9-49fb-4e9d-a2f1-7c377d270346 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:08.205379 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1bac77a9-49fb-4e9d-a2f1-7c377d270346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:08.226028 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16e27f-5259-49a7-932d-e56f419659f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:08.226956 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16e27f-5259-49a7-932d-e56f419659f2 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:08.227256 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16e27f-5259-49a7-932d-e56f419659f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:08.227584 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16e27f-5259-49a7-932d-e56f419659f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:08.228407 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16e27f-5259-49a7-932d-e56f419659f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:08.228713 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16e27f-5259-49a7-932d-e56f419659f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:08.230386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16e27f-5259-49a7-932d-e56f419659f2 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:08.246178 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 456/916] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:08.251601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16e27f-5259-49a7-932d-e56f419659f2 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:08.284427 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 461/917] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:44:08.309215 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac77a9-49fb-4e9d-a2f1-7c377d270346 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:08.366479 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:08.381384 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16e27f-5259-49a7-932d-e56f419659f2 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:08.421678 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40f446-0942-4ad6-b7bf-7326c6b51260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:08.422486 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40f446-0942-4ad6-b7bf-7326c6b51260 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:08.422768 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40f446-0942-4ad6-b7bf-7326c6b51260 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:08.423041 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40f446-0942-4ad6-b7bf-7326c6b51260 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:08.429916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab40f446-0942-4ad6-b7bf-7326c6b51260 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:08.431452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab40f446-0942-4ad6-b7bf-7326c6b51260 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:08.433942 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:08.437256 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac77a9-49fb-4e9d-a2f1-7c377d270346 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:08.449947 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-ab40f446-0942-4ad6-b7bf-7326c6b51260 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:44:08.449947 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:08.449947 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:08.449947 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:08.449947 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:08.449947 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:08.449947 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:08.449947 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:08.449947 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:08.449947 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:08.449947 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:08.449947 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:08.449947 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:44:08.449947 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:44:08.449947 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:44:08.451074 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:44:08.451074 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:08.451074 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:08.451074 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:08.451074 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:08.451074 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:08.451074 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:08.451074 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:08.451074 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:08.451074 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:08.451074 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:08.451074 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:08.451074 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:08.451074 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:08.451074 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:08.451074 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:08.451074 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:08.452007 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:44:08.452007 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:44:08.452007 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:44:08.452007 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:44:08.452007 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:44:08.452007 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:44:08.452007 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:44:08.452007 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:08.452007 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 457/918] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:44:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:08.457692 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40f446-0942-4ad6-b7bf-7326c6b51260 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:08.483521 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82151c0a-17a4-4856-b001-eb2f8f483cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:08.484574 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82151c0a-17a4-4856-b001-eb2f8f483cbf None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:08.484861 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82151c0a-17a4-4856-b001-eb2f8f483cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:08.485154 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82151c0a-17a4-4856-b001-eb2f8f483cbf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:08.486312 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82151c0a-17a4-4856-b001-eb2f8f483cbf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:08.488101 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82151c0a-17a4-4856-b001-eb2f8f483cbf None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:08.503507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-82151c0a-17a4-4856-b001-eb2f8f483cbf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 05:44:08.503507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:08.503507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 05:44:08.503507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 05:44:08.503507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 05:44:08.503507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 05:44:08.503507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 05:44:08.503507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:44:08.503507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 05:44:08.503507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:08.503507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 05:44:08.503507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:08.503507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:08.503507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:08.503507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:08.503507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:08.503507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:08.504535 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:08.504535 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:08.504535 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:08.504535 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:08.504535 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:08.504535 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:08.504535 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 05:44:08.504535 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 05:44:08.504535 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 05:44:08.504535 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 05:44:08.504535 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:08.504535 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:08.504535 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:08.504535 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:08.504535 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:08.504535 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:08.505362 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:08.505362 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:08.505362 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:08.505362 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:08.505362 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:08.505362 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:08.505362 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:08.505362 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:08.505362 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:08.505362 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:08.505362 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 05:44:08.505362 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:44:08.505362 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 05:44:08.505362 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:08.506084 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 462/919] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jul 4 05:44:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:44:08.512630 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82151c0a-17a4-4856-b001-eb2f8f483cbf None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:08.577061 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40f446-0942-4ad6-b7bf-7326c6b51260 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:08.612226 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f8e93-2bec-44d8-8d99-2b2860fb333e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:08.613257 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f8e93-2bec-44d8-8d99-2b2860fb333e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:08.613739 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f8e93-2bec-44d8-8d99-2b2860fb333e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:08.614207 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f8e93-2bec-44d8-8d99-2b2860fb333e None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:08.615249 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f8e93-2bec-44d8-8d99-2b2860fb333e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:08.615783 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f8e93-2bec-44d8-8d99-2b2860fb333e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:08.617424 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f8e93-2bec-44d8-8d99-2b2860fb333e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:08.635139 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 458/920] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:44:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:08.636381 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f8e93-2bec-44d8-8d99-2b2860fb333e None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:08.640405 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82151c0a-17a4-4856-b001-eb2f8f483cbf None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:08.644609 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:08.683440 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aea20f-c6f5-4129-aa3f-4a4a1b2008e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:08.684533 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aea20f-c6f5-4129-aa3f-4a4a1b2008e0 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:08.685015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aea20f-c6f5-4129-aa3f-4a4a1b2008e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:08.685646 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aea20f-c6f5-4129-aa3f-4a4a1b2008e0 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:08.686653 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aea20f-c6f5-4129-aa3f-4a4a1b2008e0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:08.687322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aea20f-c6f5-4129-aa3f-4a4a1b2008e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:08.688996 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aea20f-c6f5-4129-aa3f-4a4a1b2008e0 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:08.694992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 463/921] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jul 4 05:44:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:08.696573 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:08.703552 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aea20f-c6f5-4129-aa3f-4a4a1b2008e0 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:08.748291 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f8e93-2bec-44d8-8d99-2b2860fb333e None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:08.790186 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c32e6b-4698-4e31-8e3f-62e622b09e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:08.791354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c32e6b-4698-4e31-8e3f-62e622b09e5b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:08.791808 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c32e6b-4698-4e31-8e3f-62e622b09e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:08.792225 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c32e6b-4698-4e31-8e3f-62e622b09e5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:08.793442 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c32e6b-4698-4e31-8e3f-62e622b09e5b None admin] RBAC: Adding query filter params (role.id=3cf148f1bf7444adb9c10cf415dac532, scope.project.id=4bc610fb6724419dac99f2483089c783, user.id=3ed779ae7e0f4c90aaed6d1f9e86a4d0) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:08.793900 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c32e6b-4698-4e31-8e3f-62e622b09e5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:08.796491 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c32e6b-4698-4e31-8e3f-62e622b09e5b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:08.811885 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 459/922] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:44:08 2022] GET /identity/v3/role_assignments?user.id=3ed779ae7e0f4c90aaed6d1f9e86a4d0&scope.project.id=4bc610fb6724419dac99f2483089c783&role.id=3cf148f1bf7444adb9c10cf415dac532 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:08.841852 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aea20f-c6f5-4129-aa3f-4a4a1b2008e0 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:08.881495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738095c-05f7-4113-a5a2-94514296f512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:08.882529 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738095c-05f7-4113-a5a2-94514296f512 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:08.883032 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738095c-05f7-4113-a5a2-94514296f512 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:08.883598 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738095c-05f7-4113-a5a2-94514296f512 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:08.884812 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738095c-05f7-4113-a5a2-94514296f512 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:08.885124 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738095c-05f7-4113-a5a2-94514296f512 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:08.886611 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738095c-05f7-4113-a5a2-94514296f512 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:08.894016 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 464/923] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jul 4 05:44:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:08.904359 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c32e6b-4698-4e31-8e3f-62e622b09e5b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:09.022527 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c32e6b-4698-4e31-8e3f-62e622b09e5b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:09.047369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:09.058302 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7c5ac-8d51-4b27-aa27-572fbe29d459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:09.058971 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7c5ac-8d51-4b27-aa27-572fbe29d459 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:09.059275 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7c5ac-8d51-4b27-aa27-572fbe29d459 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:09.059554 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7c5ac-8d51-4b27-aa27-572fbe29d459 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:09.060413 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7c5ac-8d51-4b27-aa27-572fbe29d459 None admin] RBAC: Adding query filter params (interface=public, service_id=d454e06e259244b3b7546b3ed78605f8, region_id=RegionOne) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:09.060723 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7c5ac-8d51-4b27-aa27-572fbe29d459 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:09.062170 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7c5ac-8d51-4b27-aa27-572fbe29d459 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:09.068163 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 460/924] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Jul 4 05:44:08 2022] GET /identity/v3/endpoints?service_id=d454e06e259244b3b7546b3ed78605f8&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:09.073702 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738095c-05f7-4113-a5a2-94514296f512 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:09.106442 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:09.178384 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738095c-05f7-4113-a5a2-94514296f512 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:09.213411 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e9615-89de-44f4-bebe-1d98fe45622d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:09.214430 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e9615-89de-44f4-bebe-1d98fe45622d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:09.214821 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c2112-0330-40f4-8907-686ad1c6298b None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:09.215111 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c2112-0330-40f4-8907-686ad1c6298b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:09.215404 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e9615-89de-44f4-bebe-1d98fe45622d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:09.215506 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c2112-0330-40f4-8907-686ad1c6298b None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:09.215973 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e9615-89de-44f4-bebe-1d98fe45622d None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:09.216909 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e9615-89de-44f4-bebe-1d98fe45622d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:09.218317 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 461/925] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:44:09.218803 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e9615-89de-44f4-bebe-1d98fe45622d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:09.222592 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30e026-c24b-4748-a58a-a83d0c73d5f2 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:09.222879 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30e026-c24b-4748-a58a-a83d0c73d5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:09.223159 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30e026-c24b-4748-a58a-a83d0c73d5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:09.227590 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 465/926] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jul 4 05:44:09 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:44:09.244783 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-3e30e026-c24b-4748-a58a-a83d0c73d5f2 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:09.246923 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-3e30e026-c24b-4748-a58a-a83d0c73d5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:09.339305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 462/927] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 05:44:09.356082 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e9615-89de-44f4-bebe-1d98fe45622d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:09.457621 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:09.463957 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e9615-89de-44f4-bebe-1d98fe45622d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:09.498622 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36479de4-fda9-4f28-8760-2645ac6ef68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:09.499466 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36479de4-fda9-4f28-8760-2645ac6ef68e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:09.499742 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36479de4-fda9-4f28-8760-2645ac6ef68e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:09.500010 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36479de4-fda9-4f28-8760-2645ac6ef68e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:09.500658 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36479de4-fda9-4f28-8760-2645ac6ef68e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:09.502206 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36479de4-fda9-4f28-8760-2645ac6ef68e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:09.514678 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-36479de4-fda9-4f28-8760-2645ac6ef68e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 05:44:09.514678 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:09.514678 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 05:44:09.514678 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 05:44:09.514678 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 05:44:09.514678 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 05:44:09.514678 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 05:44:09.514678 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:44:09.514678 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 05:44:09.514678 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:09.514678 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 05:44:09.514678 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:09.514678 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:09.514678 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:09.514678 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:09.514678 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:09.515665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:09.515665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:09.515665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:09.515665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:09.515665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:09.515665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:09.515665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:09.515665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 05:44:09.515665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 05:44:09.515665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 05:44:09.515665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 05:44:09.515665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:09.515665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:09.515665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:09.515665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:09.515665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:09.516640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:09.516640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:09.516640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:09.516640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:09.516640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:09.516640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:09.516640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:09.516640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:09.516640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:09.516640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:09.516640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:09.516640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 05:44:09.516640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:44:09.516640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 05:44:09.516640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:09.516640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 466/928] 10.222.0.16 () {56 vars in 1132 bytes} [Mon Jul 4 05:44:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:09.523989 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30e026-c24b-4748-a58a-a83d0c73d5f2 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:09.628476 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30e026-c24b-4748-a58a-a83d0c73d5f2 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:09.646585 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:09.663435 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d152d-a1d1-4edc-8a4f-b77bccd44c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:09.664104 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d152d-a1d1-4edc-8a4f-b77bccd44c8b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:09.664383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d152d-a1d1-4edc-8a4f-b77bccd44c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:09.664655 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d152d-a1d1-4edc-8a4f-b77bccd44c8b None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:09.665425 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d152d-a1d1-4edc-8a4f-b77bccd44c8b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:09.665728 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d152d-a1d1-4edc-8a4f-b77bccd44c8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:09.667107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d152d-a1d1-4edc-8a4f-b77bccd44c8b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:09.672231 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 463/929] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jul 4 05:44:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:09.680296 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36479de4-fda9-4f28-8760-2645ac6ef68e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:09.786901 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36479de4-fda9-4f28-8760-2645ac6ef68e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:09.820277 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd9d48-f32b-48b0-a015-bd9c0e516d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:09.820938 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd9d48-f32b-48b0-a015-bd9c0e516d07 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:09.821248 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd9d48-f32b-48b0-a015-bd9c0e516d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:09.821520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd9d48-f32b-48b0-a015-bd9c0e516d07 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:09.822222 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd9d48-f32b-48b0-a015-bd9c0e516d07 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:09.822526 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd9d48-f32b-48b0-a015-bd9c0e516d07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:09.823933 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd9d48-f32b-48b0-a015-bd9c0e516d07 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:09.829159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 467/930] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jul 4 05:44:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:09.834791 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d152d-a1d1-4edc-8a4f-b77bccd44c8b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:09.938833 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d152d-a1d1-4edc-8a4f-b77bccd44c8b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:09.972957 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b7bc0-d23e-4403-8aaf-3034dc580829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:09.973626 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b7bc0-d23e-4403-8aaf-3034dc580829 None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:09.973909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b7bc0-d23e-4403-8aaf-3034dc580829 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:09.974185 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b7bc0-d23e-4403-8aaf-3034dc580829 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:09.974938 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b7bc0-d23e-4403-8aaf-3034dc580829 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:09.976352 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b7bc0-d23e-4403-8aaf-3034dc580829 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:10.005892 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 464/931] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jul 4 05:44:09 2022] POST /identity/v3/endpoints => generated 347 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:44:10.408352 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab8fd4-55f1-4a8d-a8ab-7ec9fb882281 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:10.409003 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab8fd4-55f1-4a8d-a8ab-7ec9fb882281 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:10.409003 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab8fd4-55f1-4a8d-a8ab-7ec9fb882281 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:10.410515 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 468/932] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:44:10.416123 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52413a8d-5a84-4a91-bc1e-83d95d78fcb5 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:10.416416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52413a8d-5a84-4a91-bc1e-83d95d78fcb5 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:10.416698 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52413a8d-5a84-4a91-bc1e-83d95d78fcb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:10.433916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-52413a8d-5a84-4a91-bc1e-83d95d78fcb5 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:10.435101 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-52413a8d-5a84-4a91-bc1e-83d95d78fcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:10.465294 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:10.514956 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 465/933] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 05:44:10.538195 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab8fd4-55f1-4a8d-a8ab-7ec9fb882281 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:10.564080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:10.646929 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab8fd4-55f1-4a8d-a8ab-7ec9fb882281 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:10.680574 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ec696-a54e-4b9d-8b35-7ccdefd0e4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:10.681114 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ec696-a54e-4b9d-8b35-7ccdefd0e4fd None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:10.681394 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ec696-a54e-4b9d-8b35-7ccdefd0e4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:10.681669 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ec696-a54e-4b9d-8b35-7ccdefd0e4fd None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:10.682378 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ec696-a54e-4b9d-8b35-7ccdefd0e4fd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:10.683848 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ec696-a54e-4b9d-8b35-7ccdefd0e4fd None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:10.685213 dv-cinder-797333-5-smb devstack@keystone.service[80213]: WARNING keystone.server.flask.common [None req-f12ec696-a54e-4b9d-8b35-7ccdefd0e4fd None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 04 05:44:10.706108 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.sql.core [None req-f12ec696-a54e-4b9d-8b35-7ccdefd0e4fd None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 04 05:44:10.706108 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 04 05:44:10.706108 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [parameters: {'id': 'dcd3eaec05864e0a8761849c14ae45a8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 04 05:44:10.706108 dv-cinder-797333-5-smb devstack@keystone.service[80213]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80213) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 04 05:44:10.723383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-f12ec696-a54e-4b9d-8b35-7ccdefd0e4fd None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dcd3eaec05864e0a8761849c14ae45a8.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dcd3eaec05864e0a8761849c14ae45a8. Jul 04 05:44:10.723383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:10.723383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 04 05:44:10.723383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 04 05:44:10.723383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 04 05:44:10.723383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 04 05:44:10.723383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 04 05:44:10.723383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application result = self._query(query) Jul 04 05:44:10.723383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 04 05:44:10.723383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application conn.query(q) Jul 04 05:44:10.723383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 04 05:44:10.723383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 04 05:44:10.723383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 04 05:44:10.724221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application result.read() Jul 04 05:44:10.724221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 04 05:44:10.724221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 04 05:44:10.724221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 04 05:44:10.724221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 04 05:44:10.724221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 04 05:44:10.724221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 04 05:44:10.724221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 04 05:44:10.724221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 04 05:44:10.724221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 04 05:44:10.724221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:10.724221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 04 05:44:10.724221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:10.724221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:10.724221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 04 05:44:10.724221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 04 05:44:10.724221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 04 05:44:10.724221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 04 05:44:10.725666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 04 05:44:10.725666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application next(self.gen) Jul 04 05:44:10.725666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 04 05:44:10.725666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application yield resource Jul 04 05:44:10.725666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 04 05:44:10.725666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application next(self.gen) Jul 04 05:44:10.725666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 04 05:44:10.725666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self.session.rollback() Jul 04 05:44:10.725666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 04 05:44:10.725666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self.force_reraise() Jul 04 05:44:10.725666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 04 05:44:10.725666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise self.value Jul 04 05:44:10.725666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 04 05:44:10.725666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 04 05:44:10.725666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 04 05:44:10.725666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application session.commit() Jul 04 05:44:10.725666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 04 05:44:10.727606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 04 05:44:10.727606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 04 05:44:10.727606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._prepare_impl() Jul 04 05:44:10.727606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 04 05:44:10.727606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self.session.flush() Jul 04 05:44:10.727606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 04 05:44:10.727606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._flush(objects) Jul 04 05:44:10.727606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 04 05:44:10.727606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 04 05:44:10.727606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 04 05:44:10.727606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application compat.raise_( Jul 04 05:44:10.727606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 04 05:44:10.727606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception Jul 04 05:44:10.727606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 04 05:44:10.727606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application flush_context.execute() Jul 04 05:44:10.727606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 04 05:44:10.727606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rec.execute(self) Jul 04 05:44:10.728492 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 04 05:44:10.728492 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 04 05:44:10.728492 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 04 05:44:10.728492 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 04 05:44:10.728492 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 04 05:44:10.728492 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 04 05:44:10.728492 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 04 05:44:10.728492 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 04 05:44:10.728492 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 04 05:44:10.728492 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 04 05:44:10.728492 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 04 05:44:10.728492 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 04 05:44:10.728492 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 04 05:44:10.728492 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 04 05:44:10.728492 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 04 05:44:10.729268 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 04 05:44:10.729268 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 04 05:44:10.729268 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception Jul 04 05:44:10.729268 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 04 05:44:10.729268 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 04 05:44:10.729268 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 04 05:44:10.729268 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 04 05:44:10.729268 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 04 05:44:10.729268 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application result = self._query(query) Jul 04 05:44:10.729268 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 04 05:44:10.729268 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application conn.query(q) Jul 04 05:44:10.729268 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 04 05:44:10.729268 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 04 05:44:10.729268 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 04 05:44:10.729268 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application result.read() Jul 04 05:44:10.729268 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 04 05:44:10.729268 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 04 05:44:10.732041 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 04 05:44:10.732041 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 04 05:44:10.732041 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 04 05:44:10.732041 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 04 05:44:10.732041 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 04 05:44:10.732041 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 04 05:44:10.732041 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 04 05:44:10.732041 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 04 05:44:10.732041 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [parameters: {'id': 'dcd3eaec05864e0a8761849c14ae45a8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 04 05:44:10.732041 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 04 05:44:10.732041 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:10.732041 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 05:44:10.732041 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:10.732041 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:10.732041 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 04 05:44:10.732896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 04 05:44:10.732896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 04 05:44:10.732896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 04 05:44:10.732896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 04 05:44:10.732896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:10.732896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 05:44:10.732896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:10.732896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:10.732896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:10.732896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:10.732896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:10.732896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:10.732896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:10.732896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:10.732896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:10.732896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:10.732896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:10.733845 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:10.733845 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 04 05:44:10.733845 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 04 05:44:10.733845 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:10.733845 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:10.733845 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 04 05:44:10.733845 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 04 05:44:10.733845 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dcd3eaec05864e0a8761849c14ae45a8. Jul 04 05:44:10.733845 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:10.733845 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 469/934] 10.222.0.16 () {60 vars in 1140 bytes} [Mon Jul 4 05:44:10 2022] POST /identity/v3/projects => generated 262 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:10.734417 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52413a8d-5a84-4a91-bc1e-83d95d78fcb5 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:10.833141 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52413a8d-5a84-4a91-bc1e-83d95d78fcb5 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:10.868721 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62c02d-6185-4048-bb87-c42ba83ed09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:10.869575 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62c02d-6185-4048-bb87-c42ba83ed09f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:10.869863 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62c02d-6185-4048-bb87-c42ba83ed09f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:10.870140 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62c02d-6185-4048-bb87-c42ba83ed09f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:10.877310 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62c02d-6185-4048-bb87-c42ba83ed09f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:10.878817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62c02d-6185-4048-bb87-c42ba83ed09f None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:10.892964 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-0a62c02d-6185-4048-bb87-c42ba83ed09f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:44:10.892964 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:10.892964 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:10.892964 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:10.892964 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:10.892964 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:10.892964 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:10.892964 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:10.892964 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:10.892964 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:10.892964 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:10.892964 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:10.892964 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:44:10.892964 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:44:10.892964 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:44:10.895108 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:44:10.895108 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:10.895108 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:10.895108 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:10.895108 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:10.895108 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:10.895108 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:10.895108 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:10.895108 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:10.895108 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:10.895108 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:10.895108 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:10.895108 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:10.895108 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:10.895108 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:10.895108 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:10.895108 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:10.897373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:44:10.897373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:44:10.897373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:44:10.897373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:44:10.897373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:44:10.897373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:44:10.897373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:44:10.897373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:10.897373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 466/935] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:44:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:10.904510 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ec696-a54e-4b9d-8b35-7ccdefd0e4fd None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:10.989047 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:10.999505 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8437a-70ed-4601-9cb9-66bfaf52599c None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:10.999505 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8437a-70ed-4601-9cb9-66bfaf52599c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:10.999505 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8437a-70ed-4601-9cb9-66bfaf52599c None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:11.001369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 467/936] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:44:11.007226 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2203f2-0b70-4921-8d49-45b8f79deb01 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:11.007226 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2203f2-0b70-4921-8d49-45b8f79deb01 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:11.007226 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2203f2-0b70-4921-8d49-45b8f79deb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:11.010938 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ec696-a54e-4b9d-8b35-7ccdefd0e4fd None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:11.025076 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-cc2203f2-0b70-4921-8d49-45b8f79deb01 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:11.026296 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-cc2203f2-0b70-4921-8d49-45b8f79deb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:11.045228 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76319a66-1b0e-43fe-bc82-bb21c8d58416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:11.045831 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:11.046622 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76319a66-1b0e-43fe-bc82-bb21c8d58416 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:11.046760 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76319a66-1b0e-43fe-bc82-bb21c8d58416 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:11.047164 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76319a66-1b0e-43fe-bc82-bb21c8d58416 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:11.051589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76319a66-1b0e-43fe-bc82-bb21c8d58416 None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:11.051906 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76319a66-1b0e-43fe-bc82-bb21c8d58416 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:11.053594 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76319a66-1b0e-43fe-bc82-bb21c8d58416 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:11.078960 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 470/937] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 4 05:44:10 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:11.119359 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 468/938] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 05:44:11.137878 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76319a66-1b0e-43fe-bc82-bb21c8d58416 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:11.257789 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76319a66-1b0e-43fe-bc82-bb21c8d58416 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:11.293970 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23987d-1b97-47c9-b09e-91d8f6c5eb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:11.294801 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23987d-1b97-47c9-b09e-91d8f6c5eb08 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:11.295083 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23987d-1b97-47c9-b09e-91d8f6c5eb08 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:11.295381 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23987d-1b97-47c9-b09e-91d8f6c5eb08 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:11.303615 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:11.307733 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23987d-1b97-47c9-b09e-91d8f6c5eb08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:44:11.316619 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-9f23987d-1b97-47c9-b09e-91d8f6c5eb08 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 05:44:11.316619 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:11.316619 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:11.316619 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:11.316619 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:11.316619 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:11.316619 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:11.316619 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:11.316619 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:11.316619 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:11.316619 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:11.316619 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:11.316619 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:44:11.316619 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:44:11.316619 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:44:11.316619 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:44:11.317614 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:44:11.317614 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:44:11.317614 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:44:11.317614 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:44:11.317614 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:11.317614 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:11.317614 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:11.317614 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:11.317614 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:11.317614 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:11.317614 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:11.317614 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:11.317614 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:11.317614 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:11.317614 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:11.317614 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:11.318723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:11.318723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:11.318723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:11.318723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:11.318723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:44:11.318723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:44:11.318723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:44:11.318723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:44:11.318723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:44:11.318723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:44:11.318723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 05:44:11.318723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:11.318723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 471/939] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Jul 4 05:44:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:11.324662 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2203f2-0b70-4921-8d49-45b8f79deb01 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:11.341744 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed13674-12e1-418b-a968-0e2580035215 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:11.342022 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed13674-12e1-418b-a968-0e2580035215 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:11.342305 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed13674-12e1-418b-a968-0e2580035215 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:11.343976 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 472/940] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:44:11.352343 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1393f21-c902-4f97-ab5a-36553fbe0868 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:11.352700 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1393f21-c902-4f97-ab5a-36553fbe0868 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:11.352987 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1393f21-c902-4f97-ab5a-36553fbe0868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:11.370936 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-e1393f21-c902-4f97-ab5a-36553fbe0868 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:11.372485 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e1393f21-c902-4f97-ab5a-36553fbe0868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:11.439677 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2203f2-0b70-4921-8d49-45b8f79deb01 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:11.449628 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 473/941] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 05:44:11.478778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1393f21-c902-4f97-ab5a-36553fbe0868 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:11.483959 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d57bf-e49c-4b6f-91d7-08287ea4aa86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:11.484741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d57bf-e49c-4b6f-91d7-08287ea4aa86 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:11.485020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d57bf-e49c-4b6f-91d7-08287ea4aa86 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:11.485487 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d57bf-e49c-4b6f-91d7-08287ea4aa86 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:11.486830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d57bf-e49c-4b6f-91d7-08287ea4aa86 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:11.487221 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d57bf-e49c-4b6f-91d7-08287ea4aa86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:11.488596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d57bf-e49c-4b6f-91d7-08287ea4aa86 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:11.498872 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 469/942] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Jul 4 05:44:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:11.504905 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d57bf-e49c-4b6f-91d7-08287ea4aa86 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:11.528849 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:11.607834 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1393f21-c902-4f97-ab5a-36553fbe0868 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:11.637726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d57bf-e49c-4b6f-91d7-08287ea4aa86 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:11.645689 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:11.653656 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ce9ff-caba-494d-ab5b-fa25585a4e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:11.655361 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ce9ff-caba-494d-ab5b-fa25585a4e69 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:11.655828 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ce9ff-caba-494d-ab5b-fa25585a4e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:11.656507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ce9ff-caba-494d-ab5b-fa25585a4e69 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:11.657346 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ce9ff-caba-494d-ab5b-fa25585a4e69 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:11.659467 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ce9ff-caba-494d-ab5b-fa25585a4e69 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:11.675299 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-3b1ce9ff-caba-494d-ab5b-fa25585a4e69 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 05:44:11.675299 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:11.675299 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 05:44:11.675299 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 05:44:11.675299 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 05:44:11.675299 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 05:44:11.675299 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 05:44:11.675299 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:44:11.675299 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 05:44:11.675299 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:11.675299 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 05:44:11.675299 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:11.675299 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:11.675299 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:11.675299 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:11.675299 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:11.675299 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:11.676587 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:11.676587 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:11.676587 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:11.676587 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:11.676587 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:11.676587 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:11.676587 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 05:44:11.676587 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 05:44:11.676587 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 05:44:11.676587 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 05:44:11.676587 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:11.676587 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:11.676587 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:11.676587 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:11.676587 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:11.676587 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:11.677661 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:11.677661 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:11.677661 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:11.677661 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:11.677661 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:11.677661 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:11.677661 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:11.677661 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:11.677661 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:11.677661 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:11.677661 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 05:44:11.677661 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:44:11.677661 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 05:44:11.677661 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:11.678583 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09ff1f-1513-4034-8182-d78acbf00da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:11.678583 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09ff1f-1513-4034-8182-d78acbf00da3 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:11.678900 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09ff1f-1513-4034-8182-d78acbf00da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:11.679273 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09ff1f-1513-4034-8182-d78acbf00da3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:11.680720 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 474/943] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jul 4 05:44:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:44:11.688120 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ce9ff-caba-494d-ab5b-fa25585a4e69 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:11.695855 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a09ff1f-1513-4034-8182-d78acbf00da3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:11.698235 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a09ff1f-1513-4034-8182-d78acbf00da3 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:11.721847 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-4a09ff1f-1513-4034-8182-d78acbf00da3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:44:11.721847 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:11.721847 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:11.721847 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:11.721847 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:11.721847 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:11.721847 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:11.721847 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:11.721847 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:11.721847 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:11.721847 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:11.721847 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:11.721847 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:44:11.721847 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:44:11.721847 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:44:11.722787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:44:11.722787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:11.722787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:11.722787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:11.722787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:11.722787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:11.722787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:11.722787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:11.722787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:11.722787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:11.722787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:11.722787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:11.722787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:11.722787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:11.722787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:11.722787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:11.722787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:11.723708 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:44:11.723708 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:44:11.723708 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:44:11.723708 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:11.729854 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 470/944] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:44:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:11.730140 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09ff1f-1513-4034-8182-d78acbf00da3 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:11.798757 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:11.802186 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ce9ff-caba-494d-ab5b-fa25585a4e69 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:11.833839 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09ff1f-1513-4034-8182-d78acbf00da3 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:11.840655 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4eaf42-4fc2-49b7-9d9e-979b2dde589f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:11.841376 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4eaf42-4fc2-49b7-9d9e-979b2dde589f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:11.841658 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4eaf42-4fc2-49b7-9d9e-979b2dde589f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:11.841932 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4eaf42-4fc2-49b7-9d9e-979b2dde589f None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:11.842680 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4eaf42-4fc2-49b7-9d9e-979b2dde589f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:11.842983 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4eaf42-4fc2-49b7-9d9e-979b2dde589f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:11.844518 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4eaf42-4fc2-49b7-9d9e-979b2dde589f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:11.854818 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 475/945] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jul 4 05:44:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:11.855861 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4eaf42-4fc2-49b7-9d9e-979b2dde589f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:11.872112 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f54762-376a-46ec-865a-eb423f79f7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:11.873460 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f54762-376a-46ec-865a-eb423f79f7f8 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:11.873982 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f54762-376a-46ec-865a-eb423f79f7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:11.874447 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f54762-376a-46ec-865a-eb423f79f7f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:11.875395 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f54762-376a-46ec-865a-eb423f79f7f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:11.875890 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f54762-376a-46ec-865a-eb423f79f7f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:11.877446 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f54762-376a-46ec-865a-eb423f79f7f8 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:11.894650 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 471/946] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:11.895855 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f54762-376a-46ec-865a-eb423f79f7f8 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:11.918816 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:11.964479 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4eaf42-4fc2-49b7-9d9e-979b2dde589f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:11.995441 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f54762-376a-46ec-865a-eb423f79f7f8 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:12.001127 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e8ec1-b6ac-418e-81e4-cc27802960cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:12.001797 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e8ec1-b6ac-418e-81e4-cc27802960cb None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:12.002077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e8ec1-b6ac-418e-81e4-cc27802960cb None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:12.002351 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e8ec1-b6ac-418e-81e4-cc27802960cb None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:12.003058 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e8ec1-b6ac-418e-81e4-cc27802960cb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:12.003406 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e8ec1-b6ac-418e-81e4-cc27802960cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:12.004806 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e8ec1-b6ac-418e-81e4-cc27802960cb None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:12.015392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 476/947] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jul 4 05:44:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:12.016372 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e8ec1-b6ac-418e-81e4-cc27802960cb None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:12.027021 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:12.034931 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66d055-8c63-4453-ac7c-8578690ed470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:12.036056 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66d055-8c63-4453-ac7c-8578690ed470 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:12.036530 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66d055-8c63-4453-ac7c-8578690ed470 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:12.037005 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66d055-8c63-4453-ac7c-8578690ed470 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:12.044796 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66d055-8c63-4453-ac7c-8578690ed470 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:12.046546 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66d055-8c63-4453-ac7c-8578690ed470 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:12.061793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-9e66d055-8c63-4453-ac7c-8578690ed470 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 05:44:12.061793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:12.061793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:12.061793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:12.061793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:12.061793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:12.061793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:12.061793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:12.061793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:12.061793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:12.061793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:12.061793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:12.061793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:44:12.061793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:44:12.061793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:44:12.061793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:44:12.062723 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:12.062723 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:12.062723 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:44:12.062723 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:44:12.062723 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:44:12.062723 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:44:12.062723 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:12.062723 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:12.062723 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:12.062723 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:12.062723 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:12.062723 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:12.062723 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:12.062723 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:12.062723 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:12.062723 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:12.062723 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:12.062723 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:12.063700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:12.063700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:12.063700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:44:12.063700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:44:12.063700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:44:12.063700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:44:12.063700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:44:12.063700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:44:12.063700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 05:44:12.063700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:12.070655 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 472/948] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jul 4 05:44:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:12.071782 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66d055-8c63-4453-ac7c-8578690ed470 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:12.121907 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e8ec1-b6ac-418e-81e4-cc27802960cb None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:12.144683 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:12.156457 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644423dc-362b-431a-b7e6-2c0039efa7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:12.157117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644423dc-362b-431a-b7e6-2c0039efa7c2 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:12.157397 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644423dc-362b-431a-b7e6-2c0039efa7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:12.157719 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644423dc-362b-431a-b7e6-2c0039efa7c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:12.158400 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644423dc-362b-431a-b7e6-2c0039efa7c2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:12.159824 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644423dc-362b-431a-b7e6-2c0039efa7c2 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:12.178505 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66d055-8c63-4453-ac7c-8578690ed470 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:12.187216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 477/949] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jul 4 05:44:12 2022] POST /identity/v3/endpoints => generated 349 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:44:12.187216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c6af4-8b50-4776-a8c1-34bd8a337f7b None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:12.187216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c6af4-8b50-4776-a8c1-34bd8a337f7b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:12.187216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c6af4-8b50-4776-a8c1-34bd8a337f7b None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:12.187216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 478/950] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:44:12.190447 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb474b84-b088-47b3-a241-ea62ad653e84 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:12.190736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb474b84-b088-47b3-a241-ea62ad653e84 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:12.191014 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb474b84-b088-47b3-a241-ea62ad653e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:12.209885 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-cb474b84-b088-47b3-a241-ea62ad653e84 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:12.211946 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-cb474b84-b088-47b3-a241-ea62ad653e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:12.234331 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4beb59-87ae-4037-9c0c-1c32af4a1f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:12.235264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4beb59-87ae-4037-9c0c-1c32af4a1f3b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:12.235551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4beb59-87ae-4037-9c0c-1c32af4a1f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:12.235934 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4beb59-87ae-4037-9c0c-1c32af4a1f3b None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:12.236822 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4beb59-87ae-4037-9c0c-1c32af4a1f3b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:12.237180 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4beb59-87ae-4037-9c0c-1c32af4a1f3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:12.238704 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4beb59-87ae-4037-9c0c-1c32af4a1f3b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:12.267906 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 473/951] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Jul 4 05:44:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:12.268913 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4beb59-87ae-4037-9c0c-1c32af4a1f3b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:12.315814 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 479/952] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 05:44:12.329283 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:12.340689 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb474b84-b088-47b3-a241-ea62ad653e84 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:12.407524 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4beb59-87ae-4037-9c0c-1c32af4a1f3b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:12.442532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebaa5d-8c13-4995-bd1f-9760f6fba111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:12.443732 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebaa5d-8c13-4995-bd1f-9760f6fba111 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:12.444218 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebaa5d-8c13-4995-bd1f-9760f6fba111 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:12.444689 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebaa5d-8c13-4995-bd1f-9760f6fba111 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:12.455055 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ebaa5d-8c13-4995-bd1f-9760f6fba111 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:12.456795 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ebaa5d-8c13-4995-bd1f-9760f6fba111 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:12.463318 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb474b84-b088-47b3-a241-ea62ad653e84 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:12.475544 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:12.476786 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-23ebaa5d-8c13-4995-bd1f-9760f6fba111 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:44:12.476786 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:12.476786 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:12.476786 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:12.476786 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:12.476786 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:12.476786 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:12.476786 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:12.476786 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:12.476786 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:12.476786 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:12.476786 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:12.476786 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:44:12.476786 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:44:12.476786 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:44:12.477756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:44:12.477756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:12.477756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:12.477756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:12.477756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:12.477756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:12.477756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:12.477756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:12.477756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:12.477756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:12.477756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:12.477756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:12.477756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:12.477756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:12.477756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:12.477756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:12.477756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:12.478624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:44:12.478624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:44:12.478624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:44:12.478624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:12.480907 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 474/953] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:44:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:12.487400 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebaa5d-8c13-4995-bd1f-9760f6fba111 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:12.509496 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbe4db-07d2-47fa-8a28-3e01bd3fc06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:12.510939 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbe4db-07d2-47fa-8a28-3e01bd3fc06b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:12.511316 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbe4db-07d2-47fa-8a28-3e01bd3fc06b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:12.511738 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbe4db-07d2-47fa-8a28-3e01bd3fc06b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:12.512664 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcbe4db-07d2-47fa-8a28-3e01bd3fc06b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:12.514424 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcbe4db-07d2-47fa-8a28-3e01bd3fc06b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:12.529032 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-9fcbe4db-07d2-47fa-8a28-3e01bd3fc06b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 05:44:12.529032 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:12.529032 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 05:44:12.529032 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 05:44:12.529032 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 05:44:12.529032 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 05:44:12.529032 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 05:44:12.529032 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:44:12.529032 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 05:44:12.529032 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:12.529032 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 05:44:12.529032 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:12.529032 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:12.529032 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:12.529032 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:12.529032 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:12.529032 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:12.530070 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:12.530070 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:12.530070 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:12.530070 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:12.530070 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:12.530070 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:12.530070 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 05:44:12.530070 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 05:44:12.530070 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 05:44:12.530070 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 05:44:12.530070 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:12.530070 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:12.530070 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:12.530070 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:12.530070 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:12.530070 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:12.539018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:12.539018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:12.539018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:12.539018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:12.539018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:12.539018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:12.539018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:12.539018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:12.539018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:12.539018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:12.539018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 05:44:12.539018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:44:12.539018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 05:44:12.539018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:12.539018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 480/954] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:44:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:44:12.544004 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbe4db-07d2-47fa-8a28-3e01bd3fc06b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:12.607688 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:12.616525 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebaa5d-8c13-4995-bd1f-9760f6fba111 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:12.655386 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbe4db-07d2-47fa-8a28-3e01bd3fc06b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:12.666337 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9dc74-d6e5-4cfc-ac18-9b4431a68b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:12.667012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9dc74-d6e5-4cfc-ac18-9b4431a68b29 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:12.667328 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9dc74-d6e5-4cfc-ac18-9b4431a68b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:12.667620 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9dc74-d6e5-4cfc-ac18-9b4431a68b29 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:12.668778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9dc74-d6e5-4cfc-ac18-9b4431a68b29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:12.669218 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9dc74-d6e5-4cfc-ac18-9b4431a68b29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:12.671065 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9dc74-d6e5-4cfc-ac18-9b4431a68b29 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:12.691024 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 475/955] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:12.692427 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9dc74-d6e5-4cfc-ac18-9b4431a68b29 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:12.699143 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d285cb-d4ed-4542-b172-a09a3c8945eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:12.699841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d285cb-d4ed-4542-b172-a09a3c8945eb None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:12.700125 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d285cb-d4ed-4542-b172-a09a3c8945eb None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:12.700402 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d285cb-d4ed-4542-b172-a09a3c8945eb None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:12.701112 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d285cb-d4ed-4542-b172-a09a3c8945eb None admin] RBAC: Adding query filter params (name=compute) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:12.701415 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d285cb-d4ed-4542-b172-a09a3c8945eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:12.702794 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d285cb-d4ed-4542-b172-a09a3c8945eb None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:12.712852 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 481/956] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 4 05:44:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:44:12.714232 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d285cb-d4ed-4542-b172-a09a3c8945eb None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:12.751466 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:12.824951 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d285cb-d4ed-4542-b172-a09a3c8945eb None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:12.831905 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9dc74-d6e5-4cfc-ac18-9b4431a68b29 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:12.860137 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33098b61-5efe-44d9-b187-00c0b0b70151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:12.860719 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33098b61-5efe-44d9-b187-00c0b0b70151 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:12.860997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33098b61-5efe-44d9-b187-00c0b0b70151 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:12.861273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33098b61-5efe-44d9-b187-00c0b0b70151 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:12.861980 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33098b61-5efe-44d9-b187-00c0b0b70151 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:12.862344 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33098b61-5efe-44d9-b187-00c0b0b70151 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:12.863827 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33098b61-5efe-44d9-b187-00c0b0b70151 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:12.875324 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 482/957] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 4 05:44:12 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:12.876662 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06d9d5-decc-483c-9d80-0f55a13fffab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:12.878086 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06d9d5-decc-483c-9d80-0f55a13fffab None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:12.878577 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06d9d5-decc-483c-9d80-0f55a13fffab None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:12.879065 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06d9d5-decc-483c-9d80-0f55a13fffab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:12.887658 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06d9d5-decc-483c-9d80-0f55a13fffab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:12.889498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06d9d5-decc-483c-9d80-0f55a13fffab None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:12.905905 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-ce06d9d5-decc-483c-9d80-0f55a13fffab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:44:12.905905 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:12.905905 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:12.905905 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:12.905905 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:12.905905 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:12.905905 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:12.905905 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:12.905905 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:12.905905 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:12.905905 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:12.905905 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:12.905905 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:44:12.905905 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:44:12.905905 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:44:12.906909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:44:12.906909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:12.906909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:12.906909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:12.906909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:12.906909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:12.906909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:12.906909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:12.906909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:12.906909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:12.906909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:12.906909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:12.906909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:12.906909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:12.906909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:12.906909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:12.906909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:12.908224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:44:12.908224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:44:12.908224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:44:12.908224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:44:12.908224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:44:12.908224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:44:12.908224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:44:12.908224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:12.910579 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 476/958] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:44:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:44:12.917574 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33098b61-5efe-44d9-b187-00c0b0b70151 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:13.028155 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:13.031759 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33098b61-5efe-44d9-b187-00c0b0b70151 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:13.067303 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a73613-5f32-4a49-b4dd-183998c7daea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:13.068265 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a73613-5f32-4a49-b4dd-183998c7daea None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:13.068720 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a73613-5f32-4a49-b4dd-183998c7daea None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:13.069167 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a73613-5f32-4a49-b4dd-183998c7daea None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:13.070222 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a73613-5f32-4a49-b4dd-183998c7daea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:13.070749 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a73613-5f32-4a49-b4dd-183998c7daea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:13.072480 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a73613-5f32-4a49-b4dd-183998c7daea None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:13.084695 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 483/959] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:44:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:13.090857 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06d9d5-decc-483c-9d80-0f55a13fffab None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:13.107575 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:13.192858 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06d9d5-decc-483c-9d80-0f55a13fffab None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:13.227577 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557487b-0594-4e65-8ac4-0ecada30df64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:13.228838 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557487b-0594-4e65-8ac4-0ecada30df64 None admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:13.229310 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557487b-0594-4e65-8ac4-0ecada30df64 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:13.229765 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557487b-0594-4e65-8ac4-0ecada30df64 None admin] PATH_INFO: `/v3/projects/4bc610fb6724419dac99f2483089c783/users/3ed779ae7e0f4c90aaed6d1f9e86a4d0/roles/3cf148f1bf7444adb9c10cf415dac532` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:13.232142 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557487b-0594-4e65-8ac4-0ecada30df64 None admin] RBAC: Authorizing `identity:create_grant(project_id=4bc610fb6724419dac99f2483089c783, user_id=3ed779ae7e0f4c90aaed6d1f9e86a4d0, role_id=3cf148f1bf7444adb9c10cf415dac532)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:13.233762 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557487b-0594-4e65-8ac4-0ecada30df64 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:13.245856 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53821423-300f-42a7-aa9e-40989ddf767e None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:13.246159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53821423-300f-42a7-aa9e-40989ddf767e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:13.246419 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53821423-300f-42a7-aa9e-40989ddf767e None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:13.248116 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 484/960] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:44:13.251949 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 477/961] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 4 05:44:13 2022] PUT /identity/v3/projects/4bc610fb6724419dac99f2483089c783/users/3ed779ae7e0f4c90aaed6d1f9e86a4d0/roles/3cf148f1bf7444adb9c10cf415dac532 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:44:13.253426 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011d8ca-b9bd-4f84-8492-f656b77306e8 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:13.253926 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011d8ca-b9bd-4f84-8492-f656b77306e8 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:13.254414 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011d8ca-b9bd-4f84-8492-f656b77306e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:13.273444 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-f011d8ca-b9bd-4f84-8492-f656b77306e8 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:13.275334 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f011d8ca-b9bd-4f84-8492-f656b77306e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:13.358170 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 485/962] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:44:13.383355 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557487b-0594-4e65-8ac4-0ecada30df64 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:13.467618 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:13.494452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557487b-0594-4e65-8ac4-0ecada30df64 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:13.532622 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8ab81-4472-4696-9e79-023d280e082d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:13.533795 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8ab81-4472-4696-9e79-023d280e082d None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:13.534087 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8ab81-4472-4696-9e79-023d280e082d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:13.534359 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8ab81-4472-4696-9e79-023d280e082d None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:13.535066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8ab81-4472-4696-9e79-023d280e082d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:13.536636 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8ab81-4472-4696-9e79-023d280e082d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:13.538077 dv-cinder-797333-5-smb devstack@keystone.service[80212]: WARNING keystone.server.flask.common [None req-85e8ab81-4472-4696-9e79-023d280e082d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 04 05:44:13.552751 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.sql.core [None req-85e8ab81-4472-4696-9e79-023d280e082d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 04 05:44:13.552751 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 04 05:44:13.552751 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [parameters: {'user_id': 'b1c03bdfd6ea4e32a61b1eea585ca736', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 04 05:44:13.552751 dv-cinder-797333-5-smb devstack@keystone.service[80212]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80212) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 04 05:44:13.560713 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-85e8ab81-4472-4696-9e79-023d280e082d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 04 05:44:13.560713 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:13.560713 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 04 05:44:13.560713 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 04 05:44:13.560713 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 04 05:44:13.560713 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 04 05:44:13.560713 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 04 05:44:13.560713 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application result = self._query(query) Jul 04 05:44:13.560713 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 04 05:44:13.560713 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application conn.query(q) Jul 04 05:44:13.560713 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 04 05:44:13.560713 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 04 05:44:13.560713 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 04 05:44:13.560713 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application result.read() Jul 04 05:44:13.560713 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 04 05:44:13.561592 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 04 05:44:13.561592 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 04 05:44:13.561592 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 04 05:44:13.561592 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 04 05:44:13.561592 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 04 05:44:13.561592 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 04 05:44:13.561592 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 04 05:44:13.561592 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 04 05:44:13.561592 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:13.561592 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 04 05:44:13.561592 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:13.561592 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:13.561592 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 04 05:44:13.561592 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 04 05:44:13.561592 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 04 05:44:13.561592 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 04 05:44:13.561592 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 04 05:44:13.561592 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application next(self.gen) Jul 04 05:44:13.562571 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 04 05:44:13.562571 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application yield resource Jul 04 05:44:13.562571 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 04 05:44:13.562571 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application next(self.gen) Jul 04 05:44:13.562571 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 04 05:44:13.562571 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self.session.rollback() Jul 04 05:44:13.562571 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 04 05:44:13.562571 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self.force_reraise() Jul 04 05:44:13.562571 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 04 05:44:13.562571 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise self.value Jul 04 05:44:13.562571 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 04 05:44:13.562571 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 04 05:44:13.562571 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 04 05:44:13.562571 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application session.commit() Jul 04 05:44:13.562571 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 04 05:44:13.562571 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 04 05:44:13.562571 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 04 05:44:13.563479 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._prepare_impl() Jul 04 05:44:13.563479 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 04 05:44:13.563479 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self.session.flush() Jul 04 05:44:13.563479 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 04 05:44:13.563479 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._flush(objects) Jul 04 05:44:13.563479 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 04 05:44:13.563479 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 04 05:44:13.563479 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 04 05:44:13.563479 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application compat.raise_( Jul 04 05:44:13.563479 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 04 05:44:13.563479 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception Jul 04 05:44:13.563479 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 04 05:44:13.563479 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application flush_context.execute() Jul 04 05:44:13.563479 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 04 05:44:13.563479 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rec.execute(self) Jul 04 05:44:13.563479 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 04 05:44:13.563479 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 04 05:44:13.564478 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 04 05:44:13.564478 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 04 05:44:13.564478 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 04 05:44:13.564478 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 04 05:44:13.564478 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 04 05:44:13.564478 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 04 05:44:13.564478 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 04 05:44:13.564478 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 04 05:44:13.564478 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 04 05:44:13.564478 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 04 05:44:13.564478 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 04 05:44:13.564478 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 04 05:44:13.564478 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 04 05:44:13.564478 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 04 05:44:13.564478 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 04 05:44:13.564478 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception Jul 04 05:44:13.565330 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 04 05:44:13.565330 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 04 05:44:13.565330 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 04 05:44:13.565330 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 04 05:44:13.565330 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 04 05:44:13.565330 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application result = self._query(query) Jul 04 05:44:13.565330 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 04 05:44:13.565330 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application conn.query(q) Jul 04 05:44:13.565330 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 04 05:44:13.565330 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 04 05:44:13.565330 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 04 05:44:13.565330 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application result.read() Jul 04 05:44:13.565330 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 04 05:44:13.565330 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 04 05:44:13.565330 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 04 05:44:13.565330 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 04 05:44:13.566150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 04 05:44:13.566150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 04 05:44:13.566150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 04 05:44:13.566150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 04 05:44:13.566150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 04 05:44:13.566150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 04 05:44:13.566150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b1c03bdfd6ea4e32a61b1eea585ca736', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 04 05:44:13.566150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 04 05:44:13.566150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:13.566150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 05:44:13.566150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:13.566150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:13.566150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:13.566150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:13.566150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:13.566939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:13.566939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:13.566939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:13.566939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:13.566939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:13.566939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:13.566939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:13.566939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 04 05:44:13.566939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 04 05:44:13.566939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:13.566939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:13.566939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:44:13.566939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:44:13.566939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:44:13.566939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:44:13.566939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 04 05:44:13.566939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 04 05:44:13.574159 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 04 05:44:13.574159 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 04 05:44:13.574159 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 04 05:44:13.574159 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 04 05:44:13.574159 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 04 05:44:13.574159 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:13.574159 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 478/963] 10.222.0.16 () {60 vars in 1131 bytes} [Mon Jul 4 05:44:13 2022] POST /identity/v3/users => generated 160 bytes in 179 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:13.576841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011d8ca-b9bd-4f84-8492-f656b77306e8 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:13.672482 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:13.682837 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011d8ca-b9bd-4f84-8492-f656b77306e8 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:13.717208 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b177e-08a7-4bcd-96c4-d3721e57dfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:13.718389 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b177e-08a7-4bcd-96c4-d3721e57dfb4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:13.718870 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b177e-08a7-4bcd-96c4-d3721e57dfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:13.719368 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b177e-08a7-4bcd-96c4-d3721e57dfb4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:13.726548 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b177e-08a7-4bcd-96c4-d3721e57dfb4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:13.728286 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b177e-08a7-4bcd-96c4-d3721e57dfb4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:13.742637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-3b1b177e-08a7-4bcd-96c4-d3721e57dfb4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 05:44:13.742637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:13.742637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:13.742637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:13.742637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:13.742637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:13.742637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:13.742637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:13.742637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:13.742637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:13.742637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:13.742637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:13.742637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:44:13.742637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:44:13.742637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:44:13.742637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:44:13.743648 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:13.743648 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:13.743648 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:44:13.743648 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:44:13.743648 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:44:13.743648 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:44:13.743648 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:13.743648 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:13.743648 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:13.743648 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:13.743648 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:13.743648 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:13.743648 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:13.743648 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:13.743648 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:13.743648 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:13.743648 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:13.743648 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:13.744605 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:13.744605 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:13.744605 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:44:13.744605 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:44:13.744605 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:44:13.744605 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:44:13.744605 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:44:13.744605 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:44:13.744605 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 05:44:13.744605 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:13.751509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 486/964] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:44:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:13.753708 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8ab81-4472-4696-9e79-023d280e082d None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:13.860766 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8ab81-4472-4696-9e79-023d280e082d None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:13.895563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e1181-8218-43f5-837e-6a5b73ec99bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:13.896335 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e1181-8218-43f5-837e-6a5b73ec99bf None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:13.896569 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e1181-8218-43f5-837e-6a5b73ec99bf None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:13.896847 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e1181-8218-43f5-837e-6a5b73ec99bf None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:13.897660 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e1181-8218-43f5-837e-6a5b73ec99bf None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:13.897965 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e1181-8218-43f5-837e-6a5b73ec99bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:13.899714 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e1181-8218-43f5-837e-6a5b73ec99bf None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:13.910122 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:13.939081 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 479/965] 10.222.0.16 () {56 vars in 1101 bytes} [Mon Jul 4 05:44:13 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:14.377635 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3e1e5-2247-4e41-9ced-79bd31be97da None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:14.377898 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3e1e5-2247-4e41-9ced-79bd31be97da None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:14.378172 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3e1e5-2247-4e41-9ced-79bd31be97da None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:14.379784 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 487/966] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:44:14.385063 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f7def-781d-438e-9ba1-7d077b95a227 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:14.385356 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f7def-781d-438e-9ba1-7d077b95a227 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:14.385596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f7def-781d-438e-9ba1-7d077b95a227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:14.403115 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-940f7def-781d-438e-9ba1-7d077b95a227 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:14.404656 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-940f7def-781d-438e-9ba1-7d077b95a227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:14.476530 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 480/967] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:44:14.500146 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3e1e5-2247-4e41-9ced-79bd31be97da None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:14.614207 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3e1e5-2247-4e41-9ced-79bd31be97da None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:14.648568 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5ee34-e964-497a-a400-c91f4c81f9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:14.649370 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5ee34-e964-497a-a400-c91f4c81f9ed None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:14.649644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5ee34-e964-497a-a400-c91f4c81f9ed None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:14.649964 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5ee34-e964-497a-a400-c91f4c81f9ed None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:14.650718 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5ee34-e964-497a-a400-c91f4c81f9ed None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:14.652207 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5ee34-e964-497a-a400-c91f4c81f9ed None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:14.667356 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-24b5ee34-e964-497a-a400-c91f4c81f9ed None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 05:44:14.667356 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:14.667356 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 05:44:14.667356 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 05:44:14.667356 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 05:44:14.667356 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 05:44:14.667356 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 05:44:14.667356 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:44:14.667356 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 05:44:14.667356 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:14.667356 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 05:44:14.667356 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:14.667356 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:14.667356 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:14.667356 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:14.667356 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:14.667356 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:14.668389 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:14.668389 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:14.668389 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:14.668389 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:14.668389 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:14.668389 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:14.668389 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 05:44:14.668389 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 05:44:14.668389 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 05:44:14.668389 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 05:44:14.668389 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:14.668389 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:14.668389 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:14.668389 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:14.668389 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:14.668389 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:14.674347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:14.674347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:14.674347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:14.674347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:14.674347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:14.674347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:14.674347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:14.674347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:14.674347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:14.674347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:14.674347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 05:44:14.674347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:44:14.674347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 05:44:14.674347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:14.674347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 488/968] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jul 4 05:44:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:14.676743 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f7def-781d-438e-9ba1-7d077b95a227 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:14.777535 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f7def-781d-438e-9ba1-7d077b95a227 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:14.800975 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:14.812952 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff9bb2-b52e-4eb8-89a1-61a92f9cb187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:14.813702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff9bb2-b52e-4eb8-89a1-61a92f9cb187 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:14.813992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff9bb2-b52e-4eb8-89a1-61a92f9cb187 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:14.814266 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff9bb2-b52e-4eb8-89a1-61a92f9cb187 None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:14.814985 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff9bb2-b52e-4eb8-89a1-61a92f9cb187 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:14.815311 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff9bb2-b52e-4eb8-89a1-61a92f9cb187 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:14.816698 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff9bb2-b52e-4eb8-89a1-61a92f9cb187 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:14.822060 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 481/969] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jul 4 05:44:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:14.827848 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5ee34-e964-497a-a400-c91f4c81f9ed None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:14.844782 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:14.909665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b629a5b-55b5-4510-831f-b83dd7586ecb None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:14.910202 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b629a5b-55b5-4510-831f-b83dd7586ecb None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:14.910202 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b629a5b-55b5-4510-831f-b83dd7586ecb None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:14.911669 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 482/970] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:44:14.916699 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6bfa1-166a-4d5a-b572-a6a65f58c036 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:14.916956 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6bfa1-166a-4d5a-b572-a6a65f58c036 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:14.917233 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6bfa1-166a-4d5a-b572-a6a65f58c036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:14.933886 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5ee34-e964-497a-a400-c91f4c81f9ed None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:14.934103 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-7ca6bfa1-166a-4d5a-b572-a6a65f58c036 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:14.935124 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-7ca6bfa1-166a-4d5a-b572-a6a65f58c036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:14.972686 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a2110-c558-47f0-848b-7b4b11d89316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:14.974318 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a2110-c558-47f0-848b-7b4b11d89316 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:14.974609 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a2110-c558-47f0-848b-7b4b11d89316 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:14.974888 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a2110-c558-47f0-848b-7b4b11d89316 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:14.975650 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a2110-c558-47f0-848b-7b4b11d89316 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:14.975960 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a2110-c558-47f0-848b-7b4b11d89316 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:14.977445 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a2110-c558-47f0-848b-7b4b11d89316 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:14.989417 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 489/971] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jul 4 05:44:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:14.990904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a2110-c558-47f0-848b-7b4b11d89316 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:15.008869 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 483/972] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 05:44:15.031289 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6bfa1-166a-4d5a-b572-a6a65f58c036 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:15.084783 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:15.107821 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a2110-c558-47f0-848b-7b4b11d89316 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:15.136773 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6bfa1-166a-4d5a-b572-a6a65f58c036 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:15.142910 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9e01d-87ed-4ea0-a774-030812786278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:15.143599 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9e01d-87ed-4ea0-a774-030812786278 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:15.143878 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9e01d-87ed-4ea0-a774-030812786278 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:15.144578 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9e01d-87ed-4ea0-a774-030812786278 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:15.145407 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9e01d-87ed-4ea0-a774-030812786278 None admin] RBAC: Adding query filter params (interface=admin, service_id=d454e06e259244b3b7546b3ed78605f8, region_id=RegionOne) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:15.145715 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9e01d-87ed-4ea0-a774-030812786278 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:15.147735 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9e01d-87ed-4ea0-a774-030812786278 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:15.153439 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 490/973] 10.222.0.16 () {56 vars in 1249 bytes} [Mon Jul 4 05:44:14 2022] GET /identity/v3/endpoints?service_id=d454e06e259244b3b7546b3ed78605f8&interface=admin®ion_id=RegionOne => generated 193 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:15.154226 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:15.158874 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9e01d-87ed-4ea0-a774-030812786278 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:15.171687 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f966957-b8f4-40f9-a97b-87b072233fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:15.172287 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f966957-b8f4-40f9-a97b-87b072233fe4 None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:15.172566 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f966957-b8f4-40f9-a97b-87b072233fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:15.172921 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f966957-b8f4-40f9-a97b-87b072233fe4 None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:15.173551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f966957-b8f4-40f9-a97b-87b072233fe4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:15.174920 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f966957-b8f4-40f9-a97b-87b072233fe4 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:15.189374 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 484/974] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 4 05:44:15 2022] POST /identity/v3/services => generated 242 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 05:44:15.267644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9e01d-87ed-4ea0-a774-030812786278 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:15.310476 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edfe83-a8b8-4253-b99e-1b6da98da702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:15.311146 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edfe83-a8b8-4253-b99e-1b6da98da702 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:15.311450 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edfe83-a8b8-4253-b99e-1b6da98da702 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:15.311720 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edfe83-a8b8-4253-b99e-1b6da98da702 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:15.312396 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70edfe83-a8b8-4253-b99e-1b6da98da702 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:15.313771 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70edfe83-a8b8-4253-b99e-1b6da98da702 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:15.327244 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 491/975] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jul 4 05:44:15 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:44:15.429395 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed3237-1380-41a5-8d42-b6c438496237 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:15.429705 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed3237-1380-41a5-8d42-b6c438496237 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:15.429882 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed3237-1380-41a5-8d42-b6c438496237 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:15.431536 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 485/976] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:44:15.436990 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150858f-b058-4f65-af5f-935ac2c79e5f None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:15.437274 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150858f-b058-4f65-af5f-935ac2c79e5f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:15.437548 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150858f-b058-4f65-af5f-935ac2c79e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:15.442867 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:15.456812 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6150858f-b058-4f65-af5f-935ac2c79e5f None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:15.458035 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6150858f-b058-4f65-af5f-935ac2c79e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:15.531965 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 492/977] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:44:15.555371 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed3237-1380-41a5-8d42-b6c438496237 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:15.657606 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed3237-1380-41a5-8d42-b6c438496237 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:15.693668 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da420465-3259-4295-a239-b757fe3b7401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:15.694396 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da420465-3259-4295-a239-b757fe3b7401 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:15.694675 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da420465-3259-4295-a239-b757fe3b7401 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:15.694951 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da420465-3259-4295-a239-b757fe3b7401 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:15.705491 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da420465-3259-4295-a239-b757fe3b7401 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:44:15.713760 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-da420465-3259-4295-a239-b757fe3b7401 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 05:44:15.713760 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:15.713760 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:15.713760 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:15.713760 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:15.713760 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:15.713760 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:15.713760 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:15.713760 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:15.713760 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:15.713760 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:15.713760 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:15.713760 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:44:15.713760 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:44:15.713760 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:44:15.713760 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:44:15.714737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:44:15.714737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:44:15.714737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:44:15.714737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:44:15.714737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:15.714737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:15.714737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:15.714737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:15.714737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:15.714737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:15.714737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:15.714737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:15.714737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:15.714737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:15.714737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:15.714737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:15.715968 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:15.715968 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:15.715968 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:15.715968 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:15.715968 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:44:15.715968 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:44:15.715968 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:44:15.715968 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:44:15.715968 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:44:15.715968 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:44:15.715968 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 05:44:15.715968 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:15.719359 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 486/978] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Jul 4 05:44:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:15.721082 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150858f-b058-4f65-af5f-935ac2c79e5f None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:15.824299 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150858f-b058-4f65-af5f-935ac2c79e5f None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:15.854111 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:15.859787 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826c4ca-5982-44d4-ad56-992dc339ab5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:15.860469 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826c4ca-5982-44d4-ad56-992dc339ab5c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:15.860755 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826c4ca-5982-44d4-ad56-992dc339ab5c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:15.861030 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826c4ca-5982-44d4-ad56-992dc339ab5c None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:15.861779 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826c4ca-5982-44d4-ad56-992dc339ab5c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:15.862090 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826c4ca-5982-44d4-ad56-992dc339ab5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:15.863771 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826c4ca-5982-44d4-ad56-992dc339ab5c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:15.872842 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 493/979] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Jul 4 05:44:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:15.878290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da420465-3259-4295-a239-b757fe3b7401 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:15.918653 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:15.981627 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da420465-3259-4295-a239-b757fe3b7401 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:16.015328 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5953536-c883-47f7-954f-663b0c582f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:16.016126 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5953536-c883-47f7-954f-663b0c582f9f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:16.016407 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5953536-c883-47f7-954f-663b0c582f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:16.016680 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5953536-c883-47f7-954f-663b0c582f9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:16.026987 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5953536-c883-47f7-954f-663b0c582f9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:16.028492 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5953536-c883-47f7-954f-663b0c582f9f None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:16.045727 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-e5953536-c883-47f7-954f-663b0c582f9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:44:16.045727 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:16.045727 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:16.045727 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:16.045727 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:16.045727 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:16.045727 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:16.045727 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:16.045727 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:16.045727 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:16.045727 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:16.045727 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:16.045727 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:44:16.045727 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:44:16.045727 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:44:16.046633 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:44:16.046633 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:16.046633 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:16.046633 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:16.046633 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:16.046633 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:16.046633 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:16.046633 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:16.046633 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:16.046633 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:16.046633 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:16.046633 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:16.046633 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:16.046633 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:16.046633 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:16.046633 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:16.046633 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:16.047895 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:44:16.047895 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:44:16.047895 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:44:16.047895 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:16.048415 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 487/980] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:44:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:16.054917 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826c4ca-5982-44d4-ad56-992dc339ab5c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:16.154314 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826c4ca-5982-44d4-ad56-992dc339ab5c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:16.186886 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ecac7-095f-41b2-8845-a367196f3fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:16.187552 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ecac7-095f-41b2-8845-a367196f3fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:16.187849 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ecac7-095f-41b2-8845-a367196f3fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:16.188119 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ecac7-095f-41b2-8845-a367196f3fc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:16.188826 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ecac7-095f-41b2-8845-a367196f3fc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:16.189127 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ecac7-095f-41b2-8845-a367196f3fc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:16.190495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ecac7-095f-41b2-8845-a367196f3fc7 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:16.202772 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 494/981] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:16.208176 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5953536-c883-47f7-954f-663b0c582f9f None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:16.299510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:16.311751 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5953536-c883-47f7-954f-663b0c582f9f None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:16.349979 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05372b-ad94-4663-8190-d2ca62b3bd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:16.350807 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05372b-ad94-4663-8190-d2ca62b3bd38 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:16.351087 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05372b-ad94-4663-8190-d2ca62b3bd38 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:16.351424 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05372b-ad94-4663-8190-d2ca62b3bd38 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:16.359116 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05372b-ad94-4663-8190-d2ca62b3bd38 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:16.360595 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05372b-ad94-4663-8190-d2ca62b3bd38 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:16.375463 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-bf05372b-ad94-4663-8190-d2ca62b3bd38 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 05:44:16.375463 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:16.375463 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:16.375463 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:16.375463 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:16.375463 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:16.375463 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:16.375463 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:16.375463 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:16.375463 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:16.375463 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:16.375463 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:16.375463 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:44:16.375463 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:44:16.375463 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:44:16.375463 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:44:16.376456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:16.376456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:16.376456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:44:16.376456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:44:16.376456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:44:16.376456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:44:16.376456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:16.376456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:16.376456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:16.376456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:16.376456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:16.376456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:16.376456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:16.376456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:16.376456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:16.376456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:16.376456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:16.376456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:16.377415 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:16.377415 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:16.377415 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:44:16.377415 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:44:16.377415 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:44:16.377415 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:44:16.377415 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:44:16.377415 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:44:16.377415 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 05:44:16.377415 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:16.382881 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 488/982] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jul 4 05:44:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:16.383001 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ecac7-095f-41b2-8845-a367196f3fc7 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:16.462343 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:16.506526 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ecac7-095f-41b2-8845-a367196f3fc7 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:16.540282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa52e05-7cfb-4d3f-8d72-aa8018f4cfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:16.540957 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa52e05-7cfb-4d3f-8d72-aa8018f4cfe9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:16.541239 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa52e05-7cfb-4d3f-8d72-aa8018f4cfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:16.541513 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa52e05-7cfb-4d3f-8d72-aa8018f4cfe9 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:16.542607 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa52e05-7cfb-4d3f-8d72-aa8018f4cfe9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:16.542607 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa52e05-7cfb-4d3f-8d72-aa8018f4cfe9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:16.547235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa52e05-7cfb-4d3f-8d72-aa8018f4cfe9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:16.561944 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 495/983] 10.222.0.16 () {56 vars in 1149 bytes} [Mon Jul 4 05:44:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:44:16.575203 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05372b-ad94-4663-8190-d2ca62b3bd38 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:16.668374 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05372b-ad94-4663-8190-d2ca62b3bd38 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:16.702108 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3cd86-9e8d-43c1-9faa-c0908f984ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:16.702812 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3cd86-9e8d-43c1-9faa-c0908f984ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:16.703889 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3cd86-9e8d-43c1-9faa-c0908f984ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:16.703889 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3cd86-9e8d-43c1-9faa-c0908f984ba3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:16.722155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:16.773187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3cd86-9e8d-43c1-9faa-c0908f984ba3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:16.774702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3cd86-9e8d-43c1-9faa-c0908f984ba3 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:16.879414 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 489/984] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:44:16 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 05:44:16.885056 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa52e05-7cfb-4d3f-8d72-aa8018f4cfe9 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:16.984108 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa52e05-7cfb-4d3f-8d72-aa8018f4cfe9 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:16.997713 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:17.019596 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04873829-9871-427e-af42-d75244c3e7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:17.020392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04873829-9871-427e-af42-d75244c3e7d6 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:17.020676 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04873829-9871-427e-af42-d75244c3e7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:17.020946 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04873829-9871-427e-af42-d75244c3e7d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:17.031253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04873829-9871-427e-af42-d75244c3e7d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:17.032719 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04873829-9871-427e-af42-d75244c3e7d6 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:17.050040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-04873829-9871-427e-af42-d75244c3e7d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:44:17.050040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:17.050040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:17.050040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:17.050040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:17.050040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:17.050040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:17.050040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:17.050040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:17.050040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:17.050040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:17.050040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:17.050040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:44:17.050040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:44:17.050040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:44:17.051725 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:44:17.051725 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:17.051725 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:17.051725 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:17.051725 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:17.051725 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:17.051725 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:17.051725 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:17.051725 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:17.051725 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:17.051725 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:17.051725 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:17.051725 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:17.051725 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:17.051725 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:17.051725 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:17.051725 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:17.053830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:44:17.053830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:44:17.053830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:44:17.053830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:17.054508 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 496/985] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:44:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:17.056902 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3cd86-9e8d-43c1-9faa-c0908f984ba3 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:17.109786 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:17.162248 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3cd86-9e8d-43c1-9faa-c0908f984ba3 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:17.197275 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67542711-7798-47e4-8de3-be44a0bfcb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:17.197945 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67542711-7798-47e4-8de3-be44a0bfcb5a None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:17.198226 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67542711-7798-47e4-8de3-be44a0bfcb5a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:17.198512 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67542711-7798-47e4-8de3-be44a0bfcb5a None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:17.199265 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67542711-7798-47e4-8de3-be44a0bfcb5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:17.199573 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67542711-7798-47e4-8de3-be44a0bfcb5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:17.200941 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67542711-7798-47e4-8de3-be44a0bfcb5a None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:17.212862 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 490/986] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:17.218245 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04873829-9871-427e-af42-d75244c3e7d6 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:17.281631 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff09ed-8e4a-4b63-a528-3003ca533184 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:17.282056 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff09ed-8e4a-4b63-a528-3003ca533184 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:17.282361 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff09ed-8e4a-4b63-a528-3003ca533184 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:17.283992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 491/987] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:44:17.288610 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd0b7e-eb67-4082-a1a5-2dfa3dd02e67 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:17.288897 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd0b7e-eb67-4082-a1a5-2dfa3dd02e67 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:17.289174 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd0b7e-eb67-4082-a1a5-2dfa3dd02e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:17.306136 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-24bd0b7e-eb67-4082-a1a5-2dfa3dd02e67 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:17.307347 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-24bd0b7e-eb67-4082-a1a5-2dfa3dd02e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:17.323809 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04873829-9871-427e-af42-d75244c3e7d6 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:17.361648 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33814e07-8748-443b-8e67-29c2d129eff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:17.362441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33814e07-8748-443b-8e67-29c2d129eff4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:17.362722 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33814e07-8748-443b-8e67-29c2d129eff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:17.362992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33814e07-8748-443b-8e67-29c2d129eff4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:17.369820 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33814e07-8748-443b-8e67-29c2d129eff4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:17.371617 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33814e07-8748-443b-8e67-29c2d129eff4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:17.380176 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 492/988] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:17 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:44:17.382029 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9e2c6-a3ca-4f15-a421-0b07977bf40c None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:17.382322 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9e2c6-a3ca-4f15-a421-0b07977bf40c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:17.382604 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9e2c6-a3ca-4f15-a421-0b07977bf40c None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:17.384126 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 493/989] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:44:17.385821 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-33814e07-8748-443b-8e67-29c2d129eff4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:44:17.385821 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:17.385821 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:17.385821 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:17.385821 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:17.385821 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:17.385821 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:17.385821 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:17.385821 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:17.385821 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:17.385821 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:17.385821 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:17.385821 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:44:17.385821 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:44:17.385821 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:44:17.386734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:44:17.386734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:17.386734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:17.386734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:17.386734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:17.386734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:17.386734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:17.386734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:17.386734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:17.386734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:17.386734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:17.386734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:17.386734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:17.386734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:17.386734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:17.386734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:17.386734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:17.388100 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:44:17.388100 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:44:17.388100 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:44:17.388100 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:44:17.388100 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:44:17.388100 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:44:17.388100 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:44:17.388100 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:17.388944 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74110294-b3cb-4d59-8b04-e9016d512f38 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:17.389235 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74110294-b3cb-4d59-8b04-e9016d512f38 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:17.389517 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74110294-b3cb-4d59-8b04-e9016d512f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:17.391940 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 497/990] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:44:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:17.392622 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33814e07-8748-443b-8e67-29c2d129eff4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:17.406333 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-74110294-b3cb-4d59-8b04-e9016d512f38 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:17.407549 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-74110294-b3cb-4d59-8b04-e9016d512f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:17.417893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:17.441666 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:17.474092 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 494/991] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:17 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:44:17.474952 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74110294-b3cb-4d59-8b04-e9016d512f38 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:17.493883 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33814e07-8748-443b-8e67-29c2d129eff4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:17.532044 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd1745-2b2a-420b-a5a2-5d3da8aa21d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:17.532701 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd1745-2b2a-420b-a5a2-5d3da8aa21d5 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:17.532975 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd1745-2b2a-420b-a5a2-5d3da8aa21d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:17.533245 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd1745-2b2a-420b-a5a2-5d3da8aa21d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:17.534025 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd1745-2b2a-420b-a5a2-5d3da8aa21d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:17.534329 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd1745-2b2a-420b-a5a2-5d3da8aa21d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:17.535803 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd1745-2b2a-420b-a5a2-5d3da8aa21d5 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:17.547974 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 498/992] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:44:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:17.548775 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd1745-2b2a-420b-a5a2-5d3da8aa21d5 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:17.576645 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74110294-b3cb-4d59-8b04-e9016d512f38 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:17.612648 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc767b89-3878-4986-a243-43ed5ab91dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:17.613451 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc767b89-3878-4986-a243-43ed5ab91dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:17.613735 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc767b89-3878-4986-a243-43ed5ab91dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:17.614012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc767b89-3878-4986-a243-43ed5ab91dc1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:17.614669 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc767b89-3878-4986-a243-43ed5ab91dc1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:17.616201 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc767b89-3878-4986-a243-43ed5ab91dc1 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:17.628416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-cc767b89-3878-4986-a243-43ed5ab91dc1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 05:44:17.628416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:17.628416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 05:44:17.628416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 05:44:17.628416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 05:44:17.628416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 05:44:17.628416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 05:44:17.628416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:44:17.628416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 05:44:17.628416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:17.628416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 05:44:17.628416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:17.628416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:17.628416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:17.628416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:17.628416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:17.628416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:17.629429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:17.629429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:17.629429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:17.629429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:17.629429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:17.629429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:17.629429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 05:44:17.629429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 05:44:17.629429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 05:44:17.629429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 05:44:17.629429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:17.629429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:17.629429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:17.629429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:17.629429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:17.629429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:17.630252 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:17.630252 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:17.630252 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:17.630252 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:17.630252 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:17.630252 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:17.630252 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:17.630252 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:17.630252 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:17.630252 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:17.630252 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 05:44:17.630252 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:44:17.630252 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 05:44:17.630252 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:17.630252 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 495/993] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:44:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:17.631045 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc767b89-3878-4986-a243-43ed5ab91dc1 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:17.634699 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:17.651795 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd1745-2b2a-420b-a5a2-5d3da8aa21d5 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:17.666376 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:17.687087 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d35e1-37c1-46fd-9675-0b58819887d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:17.687850 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d35e1-37c1-46fd-9675-0b58819887d8 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:17.688134 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d35e1-37c1-46fd-9675-0b58819887d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:17.688407 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d35e1-37c1-46fd-9675-0b58819887d8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:17.689048 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d35e1-37c1-46fd-9675-0b58819887d8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:17.690408 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d35e1-37c1-46fd-9675-0b58819887d8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:17.702441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-953d35e1-37c1-46fd-9675-0b58819887d8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 05:44:17.702441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:17.702441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 05:44:17.702441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 05:44:17.702441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 05:44:17.702441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 05:44:17.702441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 05:44:17.702441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:44:17.702441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 05:44:17.702441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:17.702441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 05:44:17.702441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:17.702441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:17.702441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:17.702441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:17.702441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:17.702441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:17.703503 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:17.703503 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:17.703503 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:17.703503 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:17.703503 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:17.703503 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:17.703503 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 05:44:17.703503 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 05:44:17.703503 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 05:44:17.703503 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 05:44:17.703503 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:17.703503 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:17.703503 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:17.703503 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:17.703503 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:17.703503 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:17.704347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:17.704347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:17.704347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:17.704347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:17.704347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:17.704347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:17.704347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:17.704347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:17.704347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:17.704347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:17.704347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 05:44:17.704347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:44:17.704347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 05:44:17.704347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:17.704347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 499/994] 10.222.0.16 () {56 vars in 1126 bytes} [Mon Jul 4 05:44:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:17.705143 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d35e1-37c1-46fd-9675-0b58819887d8 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:17.732995 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc767b89-3878-4986-a243-43ed5ab91dc1 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:17.768410 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659b2fd-2382-46df-a1a8-127e92590c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:17.769068 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659b2fd-2382-46df-a1a8-127e92590c8e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:17.769354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659b2fd-2382-46df-a1a8-127e92590c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:17.769628 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659b2fd-2382-46df-a1a8-127e92590c8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:17.770463 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659b2fd-2382-46df-a1a8-127e92590c8e None admin] RBAC: Adding query filter params (role.id=3cf148f1bf7444adb9c10cf415dac532, scope.project.id=4bc610fb6724419dac99f2483089c783, user.id=3ed779ae7e0f4c90aaed6d1f9e86a4d0) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:17.770779 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659b2fd-2382-46df-a1a8-127e92590c8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:17.772494 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659b2fd-2382-46df-a1a8-127e92590c8e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:17.779318 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 496/995] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:44:17 2022] GET /identity/v3/role_assignments?user.id=3ed779ae7e0f4c90aaed6d1f9e86a4d0&scope.project.id=4bc610fb6724419dac99f2483089c783&role.id=3cf148f1bf7444adb9c10cf415dac532 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:17.780096 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659b2fd-2382-46df-a1a8-127e92590c8e None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:17.815681 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d35e1-37c1-46fd-9675-0b58819887d8 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:17.855842 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd523d-870f-468f-8180-f79c40626557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:17.856630 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd523d-870f-468f-8180-f79c40626557 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:17.856920 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd523d-870f-468f-8180-f79c40626557 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:17.857194 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd523d-870f-468f-8180-f79c40626557 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:17.857921 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd523d-870f-468f-8180-f79c40626557 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:17.858230 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd523d-870f-468f-8180-f79c40626557 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:17.859696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd523d-870f-468f-8180-f79c40626557 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:17.869912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 500/996] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 4 05:44:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:17.871672 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd523d-870f-468f-8180-f79c40626557 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:17.887462 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:17.900365 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:17.906370 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659b2fd-2382-46df-a1a8-127e92590c8e None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:17.952072 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2f620-a45f-4a86-8ad7-03f4d0def352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:17.952670 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2f620-a45f-4a86-8ad7-03f4d0def352 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:17.953060 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2f620-a45f-4a86-8ad7-03f4d0def352 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:17.953407 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2f620-a45f-4a86-8ad7-03f4d0def352 None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:17.954193 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2f620-a45f-4a86-8ad7-03f4d0def352 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:17.954505 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2f620-a45f-4a86-8ad7-03f4d0def352 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:17.955945 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2f620-a45f-4a86-8ad7-03f4d0def352 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:17.962059 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 497/997] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jul 4 05:44:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:17.967967 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2f620-a45f-4a86-8ad7-03f4d0def352 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:17.984759 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd523d-870f-468f-8180-f79c40626557 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:18.020458 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35fc3d-232b-42d8-9dd1-9ffc55a65f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:18.021124 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35fc3d-232b-42d8-9dd1-9ffc55a65f3e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:18.021404 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35fc3d-232b-42d8-9dd1-9ffc55a65f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:18.021679 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35fc3d-232b-42d8-9dd1-9ffc55a65f3e None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:18.022381 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35fc3d-232b-42d8-9dd1-9ffc55a65f3e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:18.022683 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35fc3d-232b-42d8-9dd1-9ffc55a65f3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:18.024221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35fc3d-232b-42d8-9dd1-9ffc55a65f3e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:18.033847 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 501/998] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 4 05:44:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:44:18.035079 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35fc3d-232b-42d8-9dd1-9ffc55a65f3e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:18.084514 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2f620-a45f-4a86-8ad7-03f4d0def352 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:18.122137 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:18.123391 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769a1e4-bc3e-4890-a617-c6d47ffbc452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:18.124380 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769a1e4-bc3e-4890-a617-c6d47ffbc452 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:18.124882 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769a1e4-bc3e-4890-a617-c6d47ffbc452 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:18.124882 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769a1e4-bc3e-4890-a617-c6d47ffbc452 None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:18.125630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b769a1e4-bc3e-4890-a617-c6d47ffbc452 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:18.125932 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b769a1e4-bc3e-4890-a617-c6d47ffbc452 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:18.127533 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b769a1e4-bc3e-4890-a617-c6d47ffbc452 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:18.138175 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 498/999] 10.222.0.16 () {56 vars in 1122 bytes} [Mon Jul 4 05:44:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:18.139944 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769a1e4-bc3e-4890-a617-c6d47ffbc452 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:18.147824 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35fc3d-232b-42d8-9dd1-9ffc55a65f3e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:18.169775 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:18.182550 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15398d11-41ea-4914-a0c7-45d6115d9644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:18.183222 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15398d11-41ea-4914-a0c7-45d6115d9644 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:18.183509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15398d11-41ea-4914-a0c7-45d6115d9644 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:18.183781 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15398d11-41ea-4914-a0c7-45d6115d9644 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:18.184566 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15398d11-41ea-4914-a0c7-45d6115d9644 None admin] RBAC: Adding query filter params (interface=public, service_id=e5bfd056b47f4d82b1c1a22943f558f6, region_id=RegionOne) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:18.184877 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15398d11-41ea-4914-a0c7-45d6115d9644 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:18.186257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15398d11-41ea-4914-a0c7-45d6115d9644 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:18.191795 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 502/1000] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Jul 4 05:44:18 2022] GET /identity/v3/endpoints?service_id=e5bfd056b47f4d82b1c1a22943f558f6&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:44:18.197002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15398d11-41ea-4914-a0c7-45d6115d9644 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:18.249497 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769a1e4-bc3e-4890-a617-c6d47ffbc452 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:18.285785 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc933f-2886-4aa0-b6fb-b23325b83a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:18.286449 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc933f-2886-4aa0-b6fb-b23325b83a03 None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:18.286733 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc933f-2886-4aa0-b6fb-b23325b83a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:18.287017 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc933f-2886-4aa0-b6fb-b23325b83a03 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:18.287808 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc933f-2886-4aa0-b6fb-b23325b83a03 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:18.289191 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc933f-2886-4aa0-b6fb-b23325b83a03 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:18.305775 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 499/1001] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jul 4 05:44:18 2022] POST /identity/v3/endpoints => generated 325 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:44:18.317844 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15398d11-41ea-4914-a0c7-45d6115d9644 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:18.364981 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36ae99-a169-4fce-a1ef-a7d2ac1df1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:18.365670 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36ae99-a169-4fce-a1ef-a7d2ac1df1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:18.365926 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36ae99-a169-4fce-a1ef-a7d2ac1df1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:18.366226 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36ae99-a169-4fce-a1ef-a7d2ac1df1d9 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:18.366919 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36ae99-a169-4fce-a1ef-a7d2ac1df1d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:18.368484 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36ae99-a169-4fce-a1ef-a7d2ac1df1d9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:18.370988 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:18.378467 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 503/1002] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jul 4 05:44:18 2022] GET /identity/v3/services => generated 1727 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 05:44:19.810140 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92888df8-3c5e-430f-a9c5-bb208fb6edf8 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:19.810686 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92888df8-3c5e-430f-a9c5-bb208fb6edf8 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:19.810686 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92888df8-3c5e-430f-a9c5-bb208fb6edf8 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:19.812294 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 500/1003] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:44:19.817268 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bfa5e-355e-47ae-aa4c-65ebef8bd9e0 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:19.817690 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bfa5e-355e-47ae-aa4c-65ebef8bd9e0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:19.817861 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bfa5e-355e-47ae-aa4c-65ebef8bd9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:19.835263 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-770bfa5e-355e-47ae-aa4c-65ebef8bd9e0 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:19.836565 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-770bfa5e-355e-47ae-aa4c-65ebef8bd9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:19.912249 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 504/1004] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:19 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:44:19.934475 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92888df8-3c5e-430f-a9c5-bb208fb6edf8 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:20.023494 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:20.041583 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92888df8-3c5e-430f-a9c5-bb208fb6edf8 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:20.077824 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc4b63-1cc6-4989-b1f0-2f6d8b6e491d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:20.078910 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc4b63-1cc6-4989-b1f0-2f6d8b6e491d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:20.079417 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc4b63-1cc6-4989-b1f0-2f6d8b6e491d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:20.079868 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc4b63-1cc6-4989-b1f0-2f6d8b6e491d None admin] PATH_INFO: `/v3/services/image` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:20.080705 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc4b63-1cc6-4989-b1f0-2f6d8b6e491d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:20.082246 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc4b63-1cc6-4989-b1f0-2f6d8b6e491d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:20.096176 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-91bc4b63-1cc6-4989-b1f0-2f6d8b6e491d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 05:44:20.096176 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:20.096176 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 05:44:20.096176 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 05:44:20.096176 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 05:44:20.096176 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 05:44:20.096176 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 05:44:20.096176 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:44:20.096176 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 05:44:20.096176 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:20.096176 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 05:44:20.096176 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:20.096176 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:20.096176 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:20.096176 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:20.096176 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:20.096176 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:20.097198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:20.097198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:20.097198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:20.097198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:20.097198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:20.097198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:20.097198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 05:44:20.097198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 05:44:20.097198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 05:44:20.097198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 05:44:20.097198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:20.097198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:20.097198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:20.097198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:20.097198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:20.097198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:20.098038 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:20.098038 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:20.098038 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:20.098038 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:20.098038 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:20.098038 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:20.098038 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:20.098038 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:20.098038 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:20.098038 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:20.098038 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 05:44:20.098038 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:44:20.098038 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 05:44:20.098038 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:20.105147 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 501/1005] 10.222.0.16 () {56 vars in 1105 bytes} [Mon Jul 4 05:44:19 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:20.106738 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bfa5e-355e-47ae-aa4c-65ebef8bd9e0 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:20.209179 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bfa5e-355e-47ae-aa4c-65ebef8bd9e0 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:20.238048 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:20.245105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e428596-b1bf-407d-aa1a-e718b0c2f919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:20.246268 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e428596-b1bf-407d-aa1a-e718b0c2f919 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:20.246730 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e428596-b1bf-407d-aa1a-e718b0c2f919 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:20.247153 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e428596-b1bf-407d-aa1a-e718b0c2f919 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:20.248029 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e428596-b1bf-407d-aa1a-e718b0c2f919 None admin] RBAC: Adding query filter params (name=image) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:20.248482 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e428596-b1bf-407d-aa1a-e718b0c2f919 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:20.250012 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e428596-b1bf-407d-aa1a-e718b0c2f919 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:20.259971 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 505/1006] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:44:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:20.261526 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc4b63-1cc6-4989-b1f0-2f6d8b6e491d None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:20.343263 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55faee-49af-456d-a70b-98c62e01b80b None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:20.343449 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55faee-49af-456d-a70b-98c62e01b80b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:20.343728 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55faee-49af-456d-a70b-98c62e01b80b None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:20.345125 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 506/1007] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:44:20.349969 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167750de-fc85-49cc-ae6c-f9e7bfc14e11 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:20.350253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167750de-fc85-49cc-ae6c-f9e7bfc14e11 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:20.350528 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167750de-fc85-49cc-ae6c-f9e7bfc14e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:20.365632 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc4b63-1cc6-4989-b1f0-2f6d8b6e491d None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:20.366987 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-167750de-fc85-49cc-ae6c-f9e7bfc14e11 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:20.368256 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-167750de-fc85-49cc-ae6c-f9e7bfc14e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:20.400798 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8202a-7dbd-41d0-a24d-35d08eba022c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:20.401467 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8202a-7dbd-41d0-a24d-35d08eba022c None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:20.401751 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8202a-7dbd-41d0-a24d-35d08eba022c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:20.402025 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8202a-7dbd-41d0-a24d-35d08eba022c None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:20.402734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8202a-7dbd-41d0-a24d-35d08eba022c None admin] RBAC: Adding query filter params (type=image) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:20.403041 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8202a-7dbd-41d0-a24d-35d08eba022c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:20.404447 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8202a-7dbd-41d0-a24d-35d08eba022c None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:20.408851 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 502/1008] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:44:20 2022] GET /identity/v3/services?type=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:20.413619 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c342e-4aa2-4dfe-aa54-1e9a5f08feee None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:20.414237 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c342e-4aa2-4dfe-aa54-1e9a5f08feee None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:20.414518 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c342e-4aa2-4dfe-aa54-1e9a5f08feee None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:20.416286 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 503/1009] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:44:20.421781 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a2ca1-c140-4a5b-890c-a7a37837447e None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:20.422123 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a2ca1-c140-4a5b-890c-a7a37837447e None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:20.422333 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a2ca1-c140-4a5b-890c-a7a37837447e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:20.439253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 507/1010] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:20 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 05:44:20.440709 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-335a2ca1-c140-4a5b-890c-a7a37837447e None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:20.441929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-335a2ca1-c140-4a5b-890c-a7a37837447e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:20.456229 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:20.463049 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167750de-fc85-49cc-ae6c-f9e7bfc14e11 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:20.526722 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 504/1011] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:20 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 05:44:20.547907 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a2ca1-c140-4a5b-890c-a7a37837447e None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:20.592328 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167750de-fc85-49cc-ae6c-f9e7bfc14e11 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:20.617114 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:20.629532 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfb6bf-6eec-4022-bea1-74e0b0cb7172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:20.630622 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfb6bf-6eec-4022-bea1-74e0b0cb7172 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:20.631109 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfb6bf-6eec-4022-bea1-74e0b0cb7172 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:20.631646 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfb6bf-6eec-4022-bea1-74e0b0cb7172 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:20.633355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edfb6bf-6eec-4022-bea1-74e0b0cb7172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:20.635009 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edfb6bf-6eec-4022-bea1-74e0b0cb7172 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:20.637216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 508/1012] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:44:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:20.642675 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfb6bf-6eec-4022-bea1-74e0b0cb7172 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:20.662022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a2ca1-c140-4a5b-890c-a7a37837447e None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:20.698319 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f995905-4996-4770-80cc-6f3c5ebb6a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:20.699115 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f995905-4996-4770-80cc-6f3c5ebb6a22 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:20.699422 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f995905-4996-4770-80cc-6f3c5ebb6a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:20.699692 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f995905-4996-4770-80cc-6f3c5ebb6a22 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:20.700339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f995905-4996-4770-80cc-6f3c5ebb6a22 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:20.701750 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f995905-4996-4770-80cc-6f3c5ebb6a22 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:20.713702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-7f995905-4996-4770-80cc-6f3c5ebb6a22 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 05:44:20.713702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:20.713702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 05:44:20.713702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 05:44:20.713702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 05:44:20.713702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 05:44:20.713702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 05:44:20.713702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:44:20.713702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 05:44:20.713702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:20.713702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 05:44:20.713702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:20.713702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:20.713702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:20.713702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:20.713702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:20.713702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:20.714753 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:20.714753 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:20.714753 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:20.714753 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:20.714753 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:20.714753 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:20.714753 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 05:44:20.714753 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 05:44:20.714753 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 05:44:20.714753 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 05:44:20.714753 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:20.714753 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:20.714753 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:20.714753 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:20.714753 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:20.714753 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:20.715691 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:20.715691 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:20.715691 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:20.715691 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:20.715691 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:20.715691 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:20.715691 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:20.715691 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:20.715691 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:20.715691 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:20.715691 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 05:44:20.715691 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:44:20.715691 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 05:44:20.715691 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:20.715691 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 505/1013] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:44:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:44:20.720688 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f995905-4996-4770-80cc-6f3c5ebb6a22 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:20.731558 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:20.751083 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfb6bf-6eec-4022-bea1-74e0b0cb7172 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:20.787836 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0d846-d25c-4b99-8112-69a221bb9181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:20.788490 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0d846-d25c-4b99-8112-69a221bb9181 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:20.788767 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0d846-d25c-4b99-8112-69a221bb9181 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:20.789034 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0d846-d25c-4b99-8112-69a221bb9181 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:20.789788 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0d846-d25c-4b99-8112-69a221bb9181 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:20.791238 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0d846-d25c-4b99-8112-69a221bb9181 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:20.817554 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 509/1014] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 4 05:44:20 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 05:44:20.836093 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f995905-4996-4770-80cc-6f3c5ebb6a22 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:20.878850 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3df8a3-6200-4f3e-b898-e29cf5c1c585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:20.879469 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3df8a3-6200-4f3e-b898-e29cf5c1c585 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:20.879724 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3df8a3-6200-4f3e-b898-e29cf5c1c585 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:20.880081 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3df8a3-6200-4f3e-b898-e29cf5c1c585 None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:20.880842 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3df8a3-6200-4f3e-b898-e29cf5c1c585 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:20.881226 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3df8a3-6200-4f3e-b898-e29cf5c1c585 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:20.882788 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3df8a3-6200-4f3e-b898-e29cf5c1c585 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:20.898536 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 506/1015] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 4 05:44:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:44:20.900011 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0d846-d25c-4b99-8112-69a221bb9181 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:20.952484 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:21.013545 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0d846-d25c-4b99-8112-69a221bb9181 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:21.047334 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808473d-5c30-4932-bb74-025b27f7e0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:21.048145 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808473d-5c30-4932-bb74-025b27f7e0fb None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:21.048425 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808473d-5c30-4932-bb74-025b27f7e0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:21.048699 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808473d-5c30-4932-bb74-025b27f7e0fb None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:21.049421 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808473d-5c30-4932-bb74-025b27f7e0fb None admin] RBAC: Adding query filter params (type=compute) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:21.049704 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808473d-5c30-4932-bb74-025b27f7e0fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:21.051079 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808473d-5c30-4932-bb74-025b27f7e0fb None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:21.056264 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 510/1016] 10.222.0.16 () {56 vars in 1112 bytes} [Mon Jul 4 05:44:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:21.062128 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3df8a3-6200-4f3e-b898-e29cf5c1c585 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:21.136567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:21.167135 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3df8a3-6200-4f3e-b898-e29cf5c1c585 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:21.202100 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684069a-b801-4ea2-ab00-15289233bf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:21.202759 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684069a-b801-4ea2-ab00-15289233bf78 None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:21.203026 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684069a-b801-4ea2-ab00-15289233bf78 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:21.203355 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684069a-b801-4ea2-ab00-15289233bf78 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:21.204090 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684069a-b801-4ea2-ab00-15289233bf78 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:21.205459 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684069a-b801-4ea2-ab00-15289233bf78 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:21.227223 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 507/1017] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jul 4 05:44:21 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:44:22.431589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a1afa-52e3-4396-9cc5-b3be8488850a None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:22.432136 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a1afa-52e3-4396-9cc5-b3be8488850a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:22.432136 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a1afa-52e3-4396-9cc5-b3be8488850a None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:22.433502 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 511/1018] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:44:22.438949 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb23f6d-e8b8-4f11-ac17-01fc42a8c0c5 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:22.439392 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb23f6d-e8b8-4f11-ac17-01fc42a8c0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:22.439492 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb23f6d-e8b8-4f11-ac17-01fc42a8c0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:22.456774 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-1fb23f6d-e8b8-4f11-ac17-01fc42a8c0c5 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:22.457963 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-1fb23f6d-e8b8-4f11-ac17-01fc42a8c0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:22.545234 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 508/1019] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:22 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:44:22.567823 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a1afa-52e3-4396-9cc5-b3be8488850a None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:22.674227 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a1afa-52e3-4396-9cc5-b3be8488850a None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:22.683767 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:22.709173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052772da-0daa-4faa-bd4d-22769a2db907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:22.709836 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052772da-0daa-4faa-bd4d-22769a2db907 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:22.710119 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052772da-0daa-4faa-bd4d-22769a2db907 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:22.710396 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052772da-0daa-4faa-bd4d-22769a2db907 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:22.711196 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052772da-0daa-4faa-bd4d-22769a2db907 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:22.712591 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052772da-0daa-4faa-bd4d-22769a2db907 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:22.733540 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 512/1020] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 4 05:44:22 2022] POST /identity/v3/services => generated 242 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:44:22.893848 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fefd72-e1ad-43e1-8029-8e56ae09ad0b None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:22.894133 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fefd72-e1ad-43e1-8029-8e56ae09ad0b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:22.894410 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fefd72-e1ad-43e1-8029-8e56ae09ad0b None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:22.895961 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 509/1021] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:44:22.902016 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf8ecc-2ebf-414d-afe5-56487bb91ee6 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:22.902573 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf8ecc-2ebf-414d-afe5-56487bb91ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:22.903263 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf8ecc-2ebf-414d-afe5-56487bb91ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:22.925958 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9bcf8ecc-2ebf-414d-afe5-56487bb91ee6 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:22.927140 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9bcf8ecc-2ebf-414d-afe5-56487bb91ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:23.006530 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 513/1022] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:44:23.030898 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fefd72-e1ad-43e1-8029-8e56ae09ad0b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:23.088238 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:23.136132 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fefd72-e1ad-43e1-8029-8e56ae09ad0b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:23.169617 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f9b3e-40eb-45cc-8812-7180786c0e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:23.170407 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f9b3e-40eb-45cc-8812-7180786c0e38 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:23.170683 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f9b3e-40eb-45cc-8812-7180786c0e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:23.170953 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f9b3e-40eb-45cc-8812-7180786c0e38 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:23.172140 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3f9b3e-40eb-45cc-8812-7180786c0e38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:23.173621 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3f9b3e-40eb-45cc-8812-7180786c0e38 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:23.179914 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 510/1023] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:44:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:23.181190 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf8ecc-2ebf-414d-afe5-56487bb91ee6 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:23.284422 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:23.293251 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf8ecc-2ebf-414d-afe5-56487bb91ee6 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:23.329043 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770005c7-71b1-4151-a011-fc67ec3c7e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:23.329717 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770005c7-71b1-4151-a011-fc67ec3c7e37 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:23.330185 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770005c7-71b1-4151-a011-fc67ec3c7e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:23.330318 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770005c7-71b1-4151-a011-fc67ec3c7e37 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:23.330980 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770005c7-71b1-4151-a011-fc67ec3c7e37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:23.332461 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770005c7-71b1-4151-a011-fc67ec3c7e37 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:23.335564 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78148ce7-0c5a-4772-98c1-6feb1fcfd9b6 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:23.335849 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78148ce7-0c5a-4772-98c1-6feb1fcfd9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:23.336181 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78148ce7-0c5a-4772-98c1-6feb1fcfd9b6 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:23.337721 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 511/1024] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:44:23.342277 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac468fd-9e74-423b-8159-562c96d82234 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:23.342610 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac468fd-9e74-423b-8159-562c96d82234 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:23.342822 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac468fd-9e74-423b-8159-562c96d82234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:23.357697 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 514/1025] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 4 05:44:23 2022] POST /identity/v3/users => generated 285 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 05:44:23.359947 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-3ac468fd-9e74-423b-8159-562c96d82234 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:23.361161 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-3ac468fd-9e74-423b-8159-562c96d82234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:23.439014 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 512/1026] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:23 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 05:44:23.463167 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770005c7-71b1-4151-a011-fc67ec3c7e37 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:23.584642 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770005c7-71b1-4151-a011-fc67ec3c7e37 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:23.618419 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0504a-d61f-4957-a6af-45e3fe14bf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:23.619263 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0504a-d61f-4957-a6af-45e3fe14bf0b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:23.619545 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0504a-d61f-4957-a6af-45e3fe14bf0b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:23.619811 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0504a-d61f-4957-a6af-45e3fe14bf0b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:23.630313 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0504a-d61f-4957-a6af-45e3fe14bf0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:44:23.638592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-a2b0504a-d61f-4957-a6af-45e3fe14bf0b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 05:44:23.638592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:23.638592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:23.638592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:23.638592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:23.638592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:23.638592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:23.638592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:23.638592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:23.638592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:23.638592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:23.638592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:23.638592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:44:23.638592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:44:23.638592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:44:23.638592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:44:23.639539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:44:23.639539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:44:23.639539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:44:23.639539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:44:23.639539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:23.639539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:23.639539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:23.639539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:23.639539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:23.639539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:23.639539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:23.639539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:23.639539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:23.639539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:23.639539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:23.639539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:23.640418 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:23.640418 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:23.640418 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:23.640418 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:23.640418 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:44:23.640418 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:44:23.640418 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:44:23.640418 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:44:23.640418 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:44:23.640418 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:44:23.640418 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 05:44:23.640418 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:23.640418 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 515/1027] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Jul 4 05:44:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:23.645778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac468fd-9e74-423b-8159-562c96d82234 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:23.699716 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:23.750700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac468fd-9e74-423b-8159-562c96d82234 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:23.785957 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dafa38-a9ed-42e3-99e5-fbcde58eba06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:23.786640 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dafa38-a9ed-42e3-99e5-fbcde58eba06 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:23.786926 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dafa38-a9ed-42e3-99e5-fbcde58eba06 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:23.787351 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dafa38-a9ed-42e3-99e5-fbcde58eba06 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:23.788099 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dafa38-a9ed-42e3-99e5-fbcde58eba06 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:23.788459 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dafa38-a9ed-42e3-99e5-fbcde58eba06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:23.789839 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dafa38-a9ed-42e3-99e5-fbcde58eba06 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:23.799258 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 513/1028] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Jul 4 05:44:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:23.804325 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0504a-d61f-4957-a6af-45e3fe14bf0b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:23.817230 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:23.910998 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0504a-d61f-4957-a6af-45e3fe14bf0b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:23.944586 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5455968-de5f-418d-950b-32aad6981664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:23.945572 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5455968-de5f-418d-950b-32aad6981664 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:23.945875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5455968-de5f-418d-950b-32aad6981664 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:23.946144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5455968-de5f-418d-950b-32aad6981664 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:23.957332 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5455968-de5f-418d-950b-32aad6981664 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:23.958861 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5455968-de5f-418d-950b-32aad6981664 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:23.976322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-c5455968-de5f-418d-950b-32aad6981664 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:44:23.976322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:23.976322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:23.976322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:23.976322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:23.976322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:23.976322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:23.976322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:23.976322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:23.976322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:23.976322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:23.976322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:23.976322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:44:23.976322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:44:23.976322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:44:23.977257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:44:23.977257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:23.977257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:23.977257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:23.977257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:23.977257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:23.977257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:23.977257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:23.977257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:23.977257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:23.977257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:23.977257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:23.977257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:23.977257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:23.977257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:23.977257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:23.977257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:23.978136 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:44:23.978136 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:44:23.978136 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:44:23.978136 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:23.979546 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 516/1029] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:44:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:23.983549 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dafa38-a9ed-42e3-99e5-fbcde58eba06 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:24.089491 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dafa38-a9ed-42e3-99e5-fbcde58eba06 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:24.103037 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:24.126415 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b78b4-0d48-4e54-ab01-ea7c0f00843d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:24.127082 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b78b4-0d48-4e54-ab01-ea7c0f00843d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:24.127391 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b78b4-0d48-4e54-ab01-ea7c0f00843d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:24.127665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b78b4-0d48-4e54-ab01-ea7c0f00843d None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:24.128383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b78b4-0d48-4e54-ab01-ea7c0f00843d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:24.128685 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b78b4-0d48-4e54-ab01-ea7c0f00843d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:24.130053 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b78b4-0d48-4e54-ab01-ea7c0f00843d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:24.142435 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 514/1030] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:24.147920 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5455968-de5f-418d-950b-32aad6981664 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:24.211035 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:24.252208 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5455968-de5f-418d-950b-32aad6981664 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:24.286413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf5e87-ca78-4ed5-9a89-69b9a7f19dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:24.287220 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf5e87-ca78-4ed5-9a89-69b9a7f19dca None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:24.287599 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf5e87-ca78-4ed5-9a89-69b9a7f19dca None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:24.287870 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf5e87-ca78-4ed5-9a89-69b9a7f19dca None admin] PATH_INFO: `/v3/users/nova` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:24.295504 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf5e87-ca78-4ed5-9a89-69b9a7f19dca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:24.296947 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf5e87-ca78-4ed5-9a89-69b9a7f19dca None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:24.310801 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-76cf5e87-ca78-4ed5-9a89-69b9a7f19dca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 05:44:24.310801 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:24.310801 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:24.310801 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:24.310801 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:24.310801 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:24.310801 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:24.310801 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:24.310801 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:24.310801 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:24.310801 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:24.310801 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:24.310801 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:44:24.310801 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:44:24.310801 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:44:24.310801 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:44:24.311904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:24.311904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:24.311904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:44:24.311904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:44:24.311904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:44:24.311904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:44:24.311904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:24.311904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:24.311904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:24.311904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:24.311904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:24.311904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:24.311904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:24.311904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:24.311904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:24.311904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:24.311904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:24.311904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:24.312982 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:24.312982 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:24.312982 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:44:24.312982 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:44:24.312982 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:44:24.312982 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:44:24.312982 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:44:24.312982 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:44:24.312982 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 05:44:24.312982 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:24.315547 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 517/1031] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jul 4 05:44:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:24.317709 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b78b4-0d48-4e54-ab01-ea7c0f00843d None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:24.420275 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b78b4-0d48-4e54-ab01-ea7c0f00843d None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:24.455343 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653ef73-e071-424e-94ea-54b65ba6cea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:24.456107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653ef73-e071-424e-94ea-54b65ba6cea3 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:24.456295 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653ef73-e071-424e-94ea-54b65ba6cea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:24.456558 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653ef73-e071-424e-94ea-54b65ba6cea3 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:24.457390 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1653ef73-e071-424e-94ea-54b65ba6cea3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:24.457699 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1653ef73-e071-424e-94ea-54b65ba6cea3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:24.459139 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1653ef73-e071-424e-94ea-54b65ba6cea3 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:24.477882 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 515/1032] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jul 4 05:44:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:24.483638 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf5e87-ca78-4ed5-9a89-69b9a7f19dca None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:24.594031 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf5e87-ca78-4ed5-9a89-69b9a7f19dca None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:24.618614 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:24.632228 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17346900-84e0-49b2-bf78-2328cd994003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:24.632935 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17346900-84e0-49b2-bf78-2328cd994003 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:24.633220 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17346900-84e0-49b2-bf78-2328cd994003 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:24.633497 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17346900-84e0-49b2-bf78-2328cd994003 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:24.701137 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17346900-84e0-49b2-bf78-2328cd994003 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:24.702570 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17346900-84e0-49b2-bf78-2328cd994003 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:24.769521 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb39856-fe06-4807-bb8a-ac6779d59123 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:24.770019 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb39856-fe06-4807-bb8a-ac6779d59123 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:24.770376 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb39856-fe06-4807-bb8a-ac6779d59123 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:24.772938 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 516/1033] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:44:24.778038 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4779f0-ca20-4a25-8c69-ab201fe3a70f None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:24.778324 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4779f0-ca20-4a25-8c69-ab201fe3a70f None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:24.778600 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4779f0-ca20-4a25-8c69-ab201fe3a70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:24.797201 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-8f4779f0-ca20-4a25-8c69-ab201fe3a70f None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:24.798391 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-8f4779f0-ca20-4a25-8c69-ab201fe3a70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:24.806346 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 518/1034] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:44:24 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 05:44:24.808571 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17346900-84e0-49b2-bf78-2328cd994003 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:24.827498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:24.831425 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:24.875672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 517/1035] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:44:24.897132 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4779f0-ca20-4a25-8c69-ab201fe3a70f None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:24.922287 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17346900-84e0-49b2-bf78-2328cd994003 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:24.963815 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279fa9b-1bce-4351-805c-b605bbd310e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:24.964530 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279fa9b-1bce-4351-805c-b605bbd310e1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:24.964813 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279fa9b-1bce-4351-805c-b605bbd310e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:24.965086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279fa9b-1bce-4351-805c-b605bbd310e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:24.977888 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279fa9b-1bce-4351-805c-b605bbd310e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:24.980669 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279fa9b-1bce-4351-805c-b605bbd310e1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:25.000214 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-4279fa9b-1bce-4351-805c-b605bbd310e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:44:25.000214 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:25.000214 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:25.000214 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:25.000214 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:25.000214 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:25.000214 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:25.000214 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:25.000214 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:25.000214 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:25.000214 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:25.000214 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:25.000214 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:44:25.000214 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:44:25.000214 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:44:25.001173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:44:25.001173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:25.001173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:25.001173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:25.001173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:25.001173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:25.001173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:25.001173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:25.001173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:25.001173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:25.001173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:25.001173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:25.001173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:25.001173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:25.001173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:25.001173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:25.001173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:25.002753 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:44:25.002753 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:44:25.002753 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:44:25.002753 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:25.002753 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 519/1036] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:44:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:25.006980 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279fa9b-1bce-4351-805c-b605bbd310e1 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:25.013366 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4779f0-ca20-4a25-8c69-ab201fe3a70f None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:25.051913 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290925c-a906-48ea-9eec-a0d8e4a1ec86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:25.052714 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290925c-a906-48ea-9eec-a0d8e4a1ec86 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:25.052992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290925c-a906-48ea-9eec-a0d8e4a1ec86 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:25.053261 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290925c-a906-48ea-9eec-a0d8e4a1ec86 None admin] PATH_INFO: `/v3/services/image` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:25.053910 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290925c-a906-48ea-9eec-a0d8e4a1ec86 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:25.055384 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290925c-a906-48ea-9eec-a0d8e4a1ec86 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:25.067496 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-d290925c-a906-48ea-9eec-a0d8e4a1ec86 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 05:44:25.067496 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:25.067496 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 05:44:25.067496 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 05:44:25.067496 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 05:44:25.067496 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 05:44:25.067496 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 05:44:25.067496 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:44:25.067496 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 05:44:25.067496 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:25.067496 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 05:44:25.067496 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:25.067496 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:25.067496 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:25.067496 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:25.067496 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:25.067496 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:25.068547 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:25.068547 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:25.068547 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:25.068547 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:25.068547 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:25.068547 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:25.068547 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 05:44:25.068547 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 05:44:25.068547 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 05:44:25.068547 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 05:44:25.068547 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:25.068547 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:25.068547 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:25.068547 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:25.068547 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:25.068547 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:25.072264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:25.072264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:25.072264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:25.072264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:25.072264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:25.072264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:25.072264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:25.072264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:25.072264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:25.072264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:25.072264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 05:44:25.072264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:44:25.072264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 05:44:25.072264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:25.072264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 518/1037] 10.222.0.16 () {56 vars in 1105 bytes} [Mon Jul 4 05:44:24 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:25.074514 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290925c-a906-48ea-9eec-a0d8e4a1ec86 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:25.092278 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:25.103352 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:25.120538 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279fa9b-1bce-4351-805c-b605bbd310e1 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:25.156894 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5ded6-31c4-4a38-88c0-4eaaec8e1dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:25.157556 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5ded6-31c4-4a38-88c0-4eaaec8e1dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:25.157853 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5ded6-31c4-4a38-88c0-4eaaec8e1dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:25.158102 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5ded6-31c4-4a38-88c0-4eaaec8e1dc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:25.158837 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5ded6-31c4-4a38-88c0-4eaaec8e1dc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:25.159114 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5ded6-31c4-4a38-88c0-4eaaec8e1dc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:25.160513 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5ded6-31c4-4a38-88c0-4eaaec8e1dc2 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:25.172325 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 520/1038] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:44:25.177433 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5ded6-31c4-4a38-88c0-4eaaec8e1dc2 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:25.181499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290925c-a906-48ea-9eec-a0d8e4a1ec86 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:25.220908 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf051d-015d-47a1-9834-b6babc8b2593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:25.221512 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf051d-015d-47a1-9834-b6babc8b2593 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:25.221787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf051d-015d-47a1-9834-b6babc8b2593 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:25.222059 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf051d-015d-47a1-9834-b6babc8b2593 None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:25.222802 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf051d-015d-47a1-9834-b6babc8b2593 None admin] RBAC: Adding query filter params (name=image) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:25.223108 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf051d-015d-47a1-9834-b6babc8b2593 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:25.224509 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf051d-015d-47a1-9834-b6babc8b2593 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:25.230235 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 519/1039] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:44:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:25.235742 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf051d-015d-47a1-9834-b6babc8b2593 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:25.284670 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5ded6-31c4-4a38-88c0-4eaaec8e1dc2 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:25.318958 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984d642-4773-4a49-91dc-a05908eb55d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:25.319802 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984d642-4773-4a49-91dc-a05908eb55d9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:25.320116 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984d642-4773-4a49-91dc-a05908eb55d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:25.320409 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984d642-4773-4a49-91dc-a05908eb55d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:25.322311 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:25.330478 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984d642-4773-4a49-91dc-a05908eb55d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:25.332235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984d642-4773-4a49-91dc-a05908eb55d9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:25.334116 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:25.345966 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf051d-015d-47a1-9834-b6babc8b2593 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:25.349024 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-4984d642-4773-4a49-91dc-a05908eb55d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:44:25.349024 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:25.349024 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:25.349024 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:25.349024 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:25.349024 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:25.349024 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:25.349024 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:25.349024 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:25.349024 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:25.349024 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:25.349024 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:25.349024 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:44:25.349024 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:44:25.349024 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:44:25.349929 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:44:25.349929 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:25.349929 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:25.349929 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:25.349929 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:25.349929 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:25.349929 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:25.349929 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:25.349929 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:25.349929 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:25.349929 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:25.349929 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:25.349929 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:25.349929 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:25.349929 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:25.349929 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:25.349929 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:25.350830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:44:25.350830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:44:25.350830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:44:25.350830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:44:25.350830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:44:25.350830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:44:25.350830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:44:25.350830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:25.355379 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 521/1040] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:44:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:44:25.356243 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984d642-4773-4a49-91dc-a05908eb55d9 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:25.386885 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf0969-2f9c-49e9-a34a-e0c64c249ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:25.387552 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf0969-2f9c-49e9-a34a-e0c64c249ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:25.387831 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf0969-2f9c-49e9-a34a-e0c64c249ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:25.388250 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf0969-2f9c-49e9-a34a-e0c64c249ae6 None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:25.388814 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf0969-2f9c-49e9-a34a-e0c64c249ae6 None admin] RBAC: Adding query filter params (type=image) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:25.389094 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf0969-2f9c-49e9-a34a-e0c64c249ae6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:25.390475 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf0969-2f9c-49e9-a34a-e0c64c249ae6 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:25.396135 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 520/1041] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:44:25 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:44:25.401905 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf0969-2f9c-49e9-a34a-e0c64c249ae6 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:25.457317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984d642-4773-4a49-91dc-a05908eb55d9 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:25.492055 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c285234-d175-4b33-9b6d-2aeb6521072e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:25.492678 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c285234-d175-4b33-9b6d-2aeb6521072e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:25.492872 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c285234-d175-4b33-9b6d-2aeb6521072e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:25.493170 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c285234-d175-4b33-9b6d-2aeb6521072e None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:25.493932 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c285234-d175-4b33-9b6d-2aeb6521072e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:25.494241 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c285234-d175-4b33-9b6d-2aeb6521072e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:25.496037 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c285234-d175-4b33-9b6d-2aeb6521072e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:25.507389 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 522/1042] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:44:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:44:25.507638 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf0969-2f9c-49e9-a34a-e0c64c249ae6 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:25.508680 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5d2cd-375f-489f-9712-63dc4a7e5898 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:25.508965 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5d2cd-375f-489f-9712-63dc4a7e5898 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:25.509246 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5d2cd-375f-489f-9712-63dc4a7e5898 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:25.510481 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 523/1043] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:44:25.513349 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5d2cd-375f-489f-9712-63dc4a7e5898 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:25.546240 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006c3e0-c386-49ef-acd5-240539d27dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:25.546903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006c3e0-c386-49ef-acd5-240539d27dfe None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:25.547204 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006c3e0-c386-49ef-acd5-240539d27dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:25.547491 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006c3e0-c386-49ef-acd5-240539d27dfe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:25.548290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006c3e0-c386-49ef-acd5-240539d27dfe None admin] RBAC: Adding query filter params (interface=public, service_id=e7fcb254f57b4dfeb1db65494cd9bcf0, region_id=RegionOne) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:25.548599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006c3e0-c386-49ef-acd5-240539d27dfe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:25.549963 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006c3e0-c386-49ef-acd5-240539d27dfe None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:25.555079 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 521/1044] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Jul 4 05:44:25 2022] GET /identity/v3/endpoints?service_id=e7fcb254f57b4dfeb1db65494cd9bcf0&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:44:25.556263 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f63780-b834-4d28-9acf-a78808c4d488 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:25.556548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f63780-b834-4d28-9acf-a78808c4d488 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:25.556822 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f63780-b834-4d28-9acf-a78808c4d488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:25.572346 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-b9f63780-b834-4d28-9acf-a78808c4d488 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:25.573690 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b9f63780-b834-4d28-9acf-a78808c4d488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:25.575066 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:25.587627 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:25.622719 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5d2cd-375f-489f-9712-63dc4a7e5898 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:25.644640 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 522/1045] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:44:25.645634 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f63780-b834-4d28-9acf-a78808c4d488 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:25.659815 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26638bd-4f60-449a-aa09-33929a7a838e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:25.660520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26638bd-4f60-449a-aa09-33929a7a838e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:25.660807 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26638bd-4f60-449a-aa09-33929a7a838e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:25.661069 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26638bd-4f60-449a-aa09-33929a7a838e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:25.661900 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26638bd-4f60-449a-aa09-33929a7a838e None admin] RBAC: Adding query filter params (role.id=3cf148f1bf7444adb9c10cf415dac532, scope.project.id=4bc610fb6724419dac99f2483089c783, user.id=6f638cc70c994a529a48cb2c92b70384) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:25.662226 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26638bd-4f60-449a-aa09-33929a7a838e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:25.663687 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26638bd-4f60-449a-aa09-33929a7a838e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:25.669539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 524/1046] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:44:25 2022] GET /identity/v3/role_assignments?user.id=6f638cc70c994a529a48cb2c92b70384&scope.project.id=4bc610fb6724419dac99f2483089c783&role.id=3cf148f1bf7444adb9c10cf415dac532 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:25.670313 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26638bd-4f60-449a-aa09-33929a7a838e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:25.764653 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f63780-b834-4d28-9acf-a78808c4d488 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:25.781592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26638bd-4f60-449a-aa09-33929a7a838e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:25.799726 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:25.800155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b7f0d-219b-4f76-997a-8da055f5f13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:25.800845 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b7f0d-219b-4f76-997a-8da055f5f13f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:25.801165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b7f0d-219b-4f76-997a-8da055f5f13f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:25.801663 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b7f0d-219b-4f76-997a-8da055f5f13f None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:25.802268 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b7f0d-219b-4f76-997a-8da055f5f13f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:25.803751 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b7f0d-219b-4f76-997a-8da055f5f13f None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:25.811923 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 523/1047] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jul 4 05:44:25 2022] GET /identity/v3/services => generated 1957 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:44:25.828624 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c426871-9ca4-47be-951f-fda7cf005073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:25.829450 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c426871-9ca4-47be-951f-fda7cf005073 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:25.829733 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c426871-9ca4-47be-951f-fda7cf005073 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:25.830008 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c426871-9ca4-47be-951f-fda7cf005073 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:25.843563 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c426871-9ca4-47be-951f-fda7cf005073 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:44:25.851659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-4c426871-9ca4-47be-951f-fda7cf005073 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:44:25.851659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:25.851659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:25.851659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:25.851659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:25.851659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:25.851659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:25.851659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:25.851659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:25.851659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:25.851659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:25.851659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:25.851659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:44:25.851659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:44:25.851659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:44:25.851659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:44:25.852670 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:44:25.852670 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:44:25.852670 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:44:25.852670 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:44:25.852670 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:25.852670 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:25.852670 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:25.852670 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:25.852670 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:25.852670 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:25.852670 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:25.852670 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:25.852670 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:25.852670 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:25.852670 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:25.852670 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:25.853592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:25.853592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:25.853592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:25.853592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:25.853592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:44:25.853592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:44:25.853592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:44:25.853592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:44:25.853592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:44:25.853592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:44:25.853592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:44:25.853592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:25.853592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 525/1048] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:44:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:25.861058 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b7f0d-219b-4f76-997a-8da055f5f13f None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:25.877573 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:25.974826 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b7f0d-219b-4f76-997a-8da055f5f13f None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:26.009267 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd55c6b-e6cf-4396-a8dc-9ffd1acba291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:26.009949 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd55c6b-e6cf-4396-a8dc-9ffd1acba291 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:26.010230 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd55c6b-e6cf-4396-a8dc-9ffd1acba291 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:26.010503 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd55c6b-e6cf-4396-a8dc-9ffd1acba291 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:26.011276 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd55c6b-e6cf-4396-a8dc-9ffd1acba291 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:26.011578 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd55c6b-e6cf-4396-a8dc-9ffd1acba291 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:26.012948 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd55c6b-e6cf-4396-a8dc-9ffd1acba291 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:26.021519 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 524/1049] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:44:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:26.026996 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c426871-9ca4-47be-951f-fda7cf005073 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:26.129926 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c426871-9ca4-47be-951f-fda7cf005073 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:26.165399 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6605a-7dfe-42d7-b21e-ffe7c9f8b25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:26.166273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6605a-7dfe-42d7-b21e-ffe7c9f8b25d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:26.166559 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6605a-7dfe-42d7-b21e-ffe7c9f8b25d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:26.166905 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6605a-7dfe-42d7-b21e-ffe7c9f8b25d None admin] PATH_INFO: `/v3/users/3fa4637daf1941ad8681dfb05a594a79` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:26.181218 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b6605a-7dfe-42d7-b21e-ffe7c9f8b25d None admin] RBAC: Authorizing `identity:get_user(user_id=3fa4637daf1941ad8681dfb05a594a79)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:26.182665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b6605a-7dfe-42d7-b21e-ffe7c9f8b25d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:26.187271 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 526/1050] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:44:26 2022] GET /identity/v3/users/3fa4637daf1941ad8681dfb05a594a79 => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:26.190418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd55c6b-e6cf-4396-a8dc-9ffd1acba291 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:26.269918 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:26.296996 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd55c6b-e6cf-4396-a8dc-9ffd1acba291 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:26.330510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822ebff-60fd-4343-8d90-f75b59476f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:26.331227 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822ebff-60fd-4343-8d90-f75b59476f66 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:26.331520 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822ebff-60fd-4343-8d90-f75b59476f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:26.331792 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822ebff-60fd-4343-8d90-f75b59476f66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:26.398899 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822ebff-60fd-4343-8d90-f75b59476f66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:26.400400 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822ebff-60fd-4343-8d90-f75b59476f66 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:26.472139 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:26.503361 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 525/1051] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:44:26 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 05:44:26.505232 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6605a-7dfe-42d7-b21e-ffe7c9f8b25d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:26.550202 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:26.619411 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6605a-7dfe-42d7-b21e-ffe7c9f8b25d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:26.653415 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8c1a0-8080-4dd0-9e19-3518fe76a970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:26.654272 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8c1a0-8080-4dd0-9e19-3518fe76a970 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:26.654555 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8c1a0-8080-4dd0-9e19-3518fe76a970 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:26.654828 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8c1a0-8080-4dd0-9e19-3518fe76a970 None admin] PATH_INFO: `/v3/projects/c90ec771fd0148c0995151d74e6081cd` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:26.656024 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8c1a0-8080-4dd0-9e19-3518fe76a970 None admin] RBAC: Authorizing `identity:get_project(project_id=c90ec771fd0148c0995151d74e6081cd)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:26.657470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8c1a0-8080-4dd0-9e19-3518fe76a970 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:26.664417 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 527/1052] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:44:26 2022] GET /identity/v3/projects/c90ec771fd0148c0995151d74e6081cd => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:26.665416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822ebff-60fd-4343-8d90-f75b59476f66 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:26.766922 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822ebff-60fd-4343-8d90-f75b59476f66 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:26.801185 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72372a6b-b3b3-4988-82a0-0987ac72dd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:26.801770 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72372a6b-b3b3-4988-82a0-0987ac72dd2d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:26.802055 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72372a6b-b3b3-4988-82a0-0987ac72dd2d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:26.802329 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72372a6b-b3b3-4988-82a0-0987ac72dd2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:26.803156 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72372a6b-b3b3-4988-82a0-0987ac72dd2d None admin] RBAC: Adding query filter params (role.id=6c5b161dbf33447fa1d383915d3c9382, scope.project.id=c90ec771fd0148c0995151d74e6081cd, user.id=3fa4637daf1941ad8681dfb05a594a79) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:26.803500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72372a6b-b3b3-4988-82a0-0987ac72dd2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:26.804985 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72372a6b-b3b3-4988-82a0-0987ac72dd2d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:26.810672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 526/1053] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:44:26 2022] GET /identity/v3/role_assignments?user.id=3fa4637daf1941ad8681dfb05a594a79&scope.project.id=c90ec771fd0148c0995151d74e6081cd&role.id=6c5b161dbf33447fa1d383915d3c9382 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:44:27.661876 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445acb1-3ad1-45b8-b3b8-476dd97cb933 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:27.662456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445acb1-3ad1-45b8-b3b8-476dd97cb933 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:27.662456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445acb1-3ad1-45b8-b3b8-476dd97cb933 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:27.663882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 528/1054] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:44:27.669456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df0ec7-b0c2-46a3-9f79-8567accffaa5 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:27.669880 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df0ec7-b0c2-46a3-9f79-8567accffaa5 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:27.670089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df0ec7-b0c2-46a3-9f79-8567accffaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:27.688015 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-b9df0ec7-b0c2-46a3-9f79-8567accffaa5 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:27.689204 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b9df0ec7-b0c2-46a3-9f79-8567accffaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:27.721408 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:27.760998 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 527/1055] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:44:27.783471 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445acb1-3ad1-45b8-b3b8-476dd97cb933 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:27.829019 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ddf65-a9ce-4313-8406-671b9dad1618 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:27.829300 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ddf65-a9ce-4313-8406-671b9dad1618 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:27.829574 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ddf65-a9ce-4313-8406-671b9dad1618 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:27.831092 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 528/1056] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:44:27.835859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea4c47-ac1d-4576-8a08-9606ad3cf974 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:27.836129 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea4c47-ac1d-4576-8a08-9606ad3cf974 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:27.836393 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea4c47-ac1d-4576-8a08-9606ad3cf974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:27.853596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-e6ea4c47-ac1d-4576-8a08-9606ad3cf974 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:27.854773 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e6ea4c47-ac1d-4576-8a08-9606ad3cf974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:27.904351 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445acb1-3ad1-45b8-b3b8-476dd97cb933 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:27.907544 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:27.928483 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 529/1057] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 05:44:27.943283 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d1ff3-2c1b-4d35-93c4-02394563de6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:27.944196 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d1ff3-2c1b-4d35-93c4-02394563de6f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:27.944549 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d1ff3-2c1b-4d35-93c4-02394563de6f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:27.944890 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d1ff3-2c1b-4d35-93c4-02394563de6f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:27.951508 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea4c47-ac1d-4576-8a08-9606ad3cf974 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:27.955605 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d1ff3-2c1b-4d35-93c4-02394563de6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:44:27.963868 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-8e1d1ff3-2c1b-4d35-93c4-02394563de6f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 05:44:27.963868 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:27.963868 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:27.963868 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:27.963868 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:27.963868 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:27.963868 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:27.963868 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:27.963868 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:27.963868 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:27.963868 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:27.963868 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:27.963868 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:44:27.963868 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:44:27.963868 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:44:27.963868 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:44:27.964823 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:44:27.964823 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:44:27.964823 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:44:27.964823 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:44:27.964823 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:27.964823 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:27.964823 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:27.964823 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:27.964823 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:27.964823 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:27.964823 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:27.964823 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:27.964823 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:27.964823 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:27.964823 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:27.964823 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:27.965659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:27.965659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:27.965659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:27.965659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:27.965659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:44:27.965659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:44:27.965659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:44:27.965659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:44:27.965659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:44:27.965659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:44:27.965659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 05:44:27.965659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:27.967497 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 529/1058] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Jul 4 05:44:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:27.971031 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d1ff3-2c1b-4d35-93c4-02394563de6f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:28.053565 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:28.058451 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea4c47-ac1d-4576-8a08-9606ad3cf974 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:28.073261 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d1ff3-2c1b-4d35-93c4-02394563de6f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:28.095155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771c782-58c4-4893-afa5-5955007d2f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:28.096014 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771c782-58c4-4893-afa5-5955007d2f2c None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:28.096298 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771c782-58c4-4893-afa5-5955007d2f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:28.096574 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771c782-58c4-4893-afa5-5955007d2f2c None admin] PATH_INFO: `/v3/services/image` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:28.097228 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1771c782-58c4-4893-afa5-5955007d2f2c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:28.098830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1771c782-58c4-4893-afa5-5955007d2f2c None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:28.106109 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f50587-5181-4875-9267-cb51ae154ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:28.106771 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f50587-5181-4875-9267-cb51ae154ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:28.107052 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f50587-5181-4875-9267-cb51ae154ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:28.107357 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f50587-5181-4875-9267-cb51ae154ce4 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:28.108095 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f50587-5181-4875-9267-cb51ae154ce4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:28.108399 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f50587-5181-4875-9267-cb51ae154ce4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:28.109755 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f50587-5181-4875-9267-cb51ae154ce4 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:28.110554 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-1771c782-58c4-4893-afa5-5955007d2f2c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 05:44:28.110554 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:28.110554 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 05:44:28.110554 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 05:44:28.110554 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 05:44:28.110554 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 05:44:28.110554 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 05:44:28.110554 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:44:28.110554 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 05:44:28.110554 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:28.110554 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 05:44:28.110554 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:28.110554 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:28.110554 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:28.110554 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:28.110554 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:28.110554 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:28.111532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:28.111532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:28.111532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:28.111532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:28.111532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:28.111532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:28.111532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 05:44:28.111532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 05:44:28.111532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 05:44:28.111532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 05:44:28.111532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:28.111532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:28.111532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:28.111532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:28.111532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:28.111532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:28.112407 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:28.112407 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:28.112407 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:28.112407 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:28.112407 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:28.112407 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:28.112407 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:28.112407 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:28.112407 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:28.112407 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:28.112407 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 05:44:28.112407 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:44:28.112407 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 05:44:28.112407 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:28.112407 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 530/1059] 10.222.0.16 () {56 vars in 1105 bytes} [Mon Jul 4 05:44:27 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:44:28.117924 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771c782-58c4-4893-afa5-5955007d2f2c None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:28.125911 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 530/1060] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Jul 4 05:44:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:44:28.126698 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f50587-5181-4875-9267-cb51ae154ce4 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:28.155108 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:28.230335 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771c782-58c4-4893-afa5-5955007d2f2c None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:28.237586 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f50587-5181-4875-9267-cb51ae154ce4 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:28.268731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962806cd-6738-435f-84ab-21d7936a8619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:28.269411 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962806cd-6738-435f-84ab-21d7936a8619 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:28.269783 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962806cd-6738-435f-84ab-21d7936a8619 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:28.270156 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962806cd-6738-435f-84ab-21d7936a8619 None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:28.270955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962806cd-6738-435f-84ab-21d7936a8619 None admin] RBAC: Adding query filter params (name=image) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:28.271296 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962806cd-6738-435f-84ab-21d7936a8619 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:28.272671 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908effda-d83d-47ac-b2b9-22fedfa37831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:28.272802 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962806cd-6738-435f-84ab-21d7936a8619 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:28.273469 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908effda-d83d-47ac-b2b9-22fedfa37831 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:28.273867 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908effda-d83d-47ac-b2b9-22fedfa37831 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:28.274141 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908effda-d83d-47ac-b2b9-22fedfa37831 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:28.283108 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 531/1061] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:44:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:44:28.284611 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962806cd-6738-435f-84ab-21d7936a8619 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:28.286287 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908effda-d83d-47ac-b2b9-22fedfa37831 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:28.287896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908effda-d83d-47ac-b2b9-22fedfa37831 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:28.306173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-908effda-d83d-47ac-b2b9-22fedfa37831 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:44:28.306173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:28.306173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:28.306173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:28.306173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:28.306173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:28.306173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:28.306173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:28.306173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:28.306173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:28.306173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:28.306173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:28.306173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:44:28.306173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:44:28.306173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:44:28.307107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:44:28.307107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:28.307107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:28.307107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:28.307107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:28.307107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:28.307107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:28.307107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:28.307107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:28.307107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:28.307107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:28.307107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:28.307107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:28.307107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:28.307107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:28.307107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:28.307107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:28.308036 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:44:28.308036 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:44:28.308036 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:44:28.308036 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:28.308036 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 531/1062] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:44:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:44:28.313004 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908effda-d83d-47ac-b2b9-22fedfa37831 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:28.314999 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:28.393487 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:28.395199 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962806cd-6738-435f-84ab-21d7936a8619 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:28.418086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908effda-d83d-47ac-b2b9-22fedfa37831 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:28.430810 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862f85f-9551-4938-933b-a7712082e7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:28.431526 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862f85f-9551-4938-933b-a7712082e7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:28.431808 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862f85f-9551-4938-933b-a7712082e7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:28.432280 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862f85f-9551-4938-933b-a7712082e7c9 None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:28.432777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862f85f-9551-4938-933b-a7712082e7c9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:28.433126 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862f85f-9551-4938-933b-a7712082e7c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:28.434499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862f85f-9551-4938-933b-a7712082e7c9 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:28.439501 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 532/1063] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:44:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:44:28.445273 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862f85f-9551-4938-933b-a7712082e7c9 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:28.453222 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6449a0-6fff-4558-85ff-9a8b4fcc599f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:28.453895 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6449a0-6fff-4558-85ff-9a8b4fcc599f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:28.454177 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6449a0-6fff-4558-85ff-9a8b4fcc599f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:28.454454 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6449a0-6fff-4558-85ff-9a8b4fcc599f None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:28.455171 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6449a0-6fff-4558-85ff-9a8b4fcc599f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:28.455500 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6449a0-6fff-4558-85ff-9a8b4fcc599f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:28.456872 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6449a0-6fff-4558-85ff-9a8b4fcc599f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:28.473536 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 532/1064] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:44:28.474527 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6449a0-6fff-4558-85ff-9a8b4fcc599f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:28.547205 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:28.558978 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862f85f-9551-4938-933b-a7712082e7c9 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:28.582676 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6449a0-6fff-4558-85ff-9a8b4fcc599f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:28.595956 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb001df-00a5-4022-ab1a-ab45f624f5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:28.596628 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb001df-00a5-4022-ab1a-ab45f624f5d5 None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:28.596909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb001df-00a5-4022-ab1a-ab45f624f5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:28.597182 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb001df-00a5-4022-ab1a-ab45f624f5d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:28.598199 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb001df-00a5-4022-ab1a-ab45f624f5d5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:28.599340 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb001df-00a5-4022-ab1a-ab45f624f5d5 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:28.618609 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 533/1065] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jul 4 05:44:28 2022] POST /identity/v3/endpoints => generated 327 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 05:44:28.635866 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8395b-d406-4e8c-8617-7d4078ed25de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:28.636774 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8395b-d406-4e8c-8617-7d4078ed25de None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:28.637136 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8395b-d406-4e8c-8617-7d4078ed25de None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:28.637494 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8395b-d406-4e8c-8617-7d4078ed25de None admin] PATH_INFO: `/v3/users/nova` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:28.640182 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:28.647624 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8395b-d406-4e8c-8617-7d4078ed25de None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:28.649290 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8395b-d406-4e8c-8617-7d4078ed25de None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:28.665901 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-17e8395b-d406-4e8c-8617-7d4078ed25de None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 05:44:28.665901 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:28.665901 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:28.665901 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:28.665901 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:28.665901 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:28.665901 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:28.665901 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:28.665901 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:28.665901 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:28.665901 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:28.665901 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:28.665901 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:44:28.665901 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:44:28.665901 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:44:28.665901 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:44:28.667659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:28.667659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:28.667659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:44:28.667659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:44:28.667659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:44:28.667659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:44:28.667659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:28.667659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:28.667659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:28.667659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:28.667659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:28.667659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:28.667659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:28.667659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:28.667659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:28.667659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:28.667659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:28.667659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:28.668642 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:28.668642 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:28.668642 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:44:28.668642 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:44:28.668642 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:44:28.668642 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:44:28.668642 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:44:28.668642 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:44:28.668642 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 05:44:28.668642 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:28.668642 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 533/1066] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jul 4 05:44:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:44:28.673000 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb001df-00a5-4022-ab1a-ab45f624f5d5 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:28.788030 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb001df-00a5-4022-ab1a-ab45f624f5d5 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:28.804612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e40fb-d35a-4600-94e0-a56a840fd2ce None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:28.804877 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e40fb-d35a-4600-94e0-a56a840fd2ce None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:28.805691 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e40fb-d35a-4600-94e0-a56a840fd2ce None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:28.806681 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 534/1067] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:44:28.812832 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e11b8-3229-4abf-aa3c-18d0ae568d4c None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:28.813609 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e11b8-3229-4abf-aa3c-18d0ae568d4c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:28.813887 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e11b8-3229-4abf-aa3c-18d0ae568d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:28.822844 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c03476-fc62-429c-a216-cd417d9d72d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:28.823554 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c03476-fc62-429c-a216-cd417d9d72d6 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:28.823834 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c03476-fc62-429c-a216-cd417d9d72d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:28.824105 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c03476-fc62-429c-a216-cd417d9d72d6 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:28.824943 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c03476-fc62-429c-a216-cd417d9d72d6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:28.825250 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c03476-fc62-429c-a216-cd417d9d72d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:28.826690 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c03476-fc62-429c-a216-cd417d9d72d6 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:28.832042 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-e30e11b8-3229-4abf-aa3c-18d0ae568d4c None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:28.833237 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e30e11b8-3229-4abf-aa3c-18d0ae568d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:28.845238 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 534/1068] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jul 4 05:44:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:44:28.850734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c03476-fc62-429c-a216-cd417d9d72d6 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:28.854300 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:28.904009 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 535/1069] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:44:28.926307 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e11b8-3229-4abf-aa3c-18d0ae568d4c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:28.955546 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c03476-fc62-429c-a216-cd417d9d72d6 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:28.992506 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb48cfc-ea33-4ad0-960e-edf8e0780e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:28.993420 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb48cfc-ea33-4ad0-960e-edf8e0780e76 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:28.993755 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb48cfc-ea33-4ad0-960e-edf8e0780e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:28.994029 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb48cfc-ea33-4ad0-960e-edf8e0780e76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:29.005917 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb48cfc-ea33-4ad0-960e-edf8e0780e76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:29.007573 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb48cfc-ea33-4ad0-960e-edf8e0780e76 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:29.025830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-2bb48cfc-ea33-4ad0-960e-edf8e0780e76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:44:29.025830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:29.025830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:29.025830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:29.025830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:29.025830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:29.025830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:29.025830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:29.025830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:29.025830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:29.025830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:29.025830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:29.025830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:44:29.025830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:44:29.025830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:44:29.026982 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:44:29.026982 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:29.026982 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:29.026982 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:29.026982 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:29.026982 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:29.026982 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:29.026982 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:29.026982 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:29.026982 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:29.026982 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:29.026982 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:29.026982 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:29.026982 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:29.026982 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:29.026982 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:29.026982 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:29.032155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:44:29.032155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:44:29.032155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:44:29.032155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:29.032155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 535/1070] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:44:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:44:29.033576 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb48cfc-ea33-4ad0-960e-edf8e0780e76 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:29.034536 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e11b8-3229-4abf-aa3c-18d0ae568d4c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:29.060216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:29.071275 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaeb975-3000-43db-85ec-b8019c39d76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:29.072077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaeb975-3000-43db-85ec-b8019c39d76c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:29.072359 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaeb975-3000-43db-85ec-b8019c39d76c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:29.072633 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaeb975-3000-43db-85ec-b8019c39d76c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:29.082745 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaeb975-3000-43db-85ec-b8019c39d76c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:44:29.090433 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-aaaeb975-3000-43db-85ec-b8019c39d76c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:44:29.090433 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:29.090433 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:29.090433 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:29.090433 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:29.090433 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:29.090433 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:29.090433 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:29.090433 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:29.090433 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:29.090433 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:29.090433 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:29.090433 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:44:29.090433 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:44:29.090433 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:44:29.090433 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:44:29.091413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:44:29.091413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:44:29.091413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:44:29.091413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:44:29.091413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:29.091413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:29.091413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:29.091413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:29.091413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:29.091413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:29.091413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:29.091413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:29.091413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:29.091413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:29.091413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:29.091413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:29.092367 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:29.092367 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:29.092367 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:29.092367 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:29.092367 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:44:29.092367 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:44:29.092367 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:44:29.092367 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:44:29.092367 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:44:29.092367 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:44:29.092367 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:44:29.092367 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:29.092367 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 536/1071] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:44:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:44:29.095985 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:29.097601 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaeb975-3000-43db-85ec-b8019c39d76c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:29.145008 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb48cfc-ea33-4ad0-960e-edf8e0780e76 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:29.180888 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1451c-134d-405d-af06-44c41415ca7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:29.181470 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1451c-134d-405d-af06-44c41415ca7e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:29.181750 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1451c-134d-405d-af06-44c41415ca7e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:29.182023 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1451c-134d-405d-af06-44c41415ca7e None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:29.182750 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1451c-134d-405d-af06-44c41415ca7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:29.183078 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1451c-134d-405d-af06-44c41415ca7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:29.184481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1451c-134d-405d-af06-44c41415ca7e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:29.197002 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 536/1072] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:29.200979 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaeb975-3000-43db-85ec-b8019c39d76c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:29.202307 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1451c-134d-405d-af06-44c41415ca7e None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:29.234624 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4929f9-8be2-415a-8540-200ee7b72f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:29.235320 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4929f9-8be2-415a-8540-200ee7b72f1e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:29.235599 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4929f9-8be2-415a-8540-200ee7b72f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:29.235868 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4929f9-8be2-415a-8540-200ee7b72f1e None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:29.236601 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4929f9-8be2-415a-8540-200ee7b72f1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:29.236896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4929f9-8be2-415a-8540-200ee7b72f1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:29.238263 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4929f9-8be2-415a-8540-200ee7b72f1e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:29.248555 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 537/1073] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:44:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:44:29.253674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4929f9-8be2-415a-8540-200ee7b72f1e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:29.304449 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:29.308219 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1451c-134d-405d-af06-44c41415ca7e None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:29.326377 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:29.344891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b755a-cdbb-4e2f-a075-63aa5f1afc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:29.345688 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b755a-cdbb-4e2f-a075-63aa5f1afc3e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:29.345966 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b755a-cdbb-4e2f-a075-63aa5f1afc3e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:29.346243 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b755a-cdbb-4e2f-a075-63aa5f1afc3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:29.353051 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b755a-cdbb-4e2f-a075-63aa5f1afc3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:29.354487 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b755a-cdbb-4e2f-a075-63aa5f1afc3e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:29.362034 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4929f9-8be2-415a-8540-200ee7b72f1e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:29.368369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-608b755a-cdbb-4e2f-a075-63aa5f1afc3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:44:29.368369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:29.368369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:29.368369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:29.368369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:29.368369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:29.368369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:29.368369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:29.368369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:29.368369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:29.368369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:29.368369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:29.368369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:44:29.368369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:44:29.368369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:44:29.369255 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:44:29.369255 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:29.369255 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:29.369255 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:29.369255 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:29.369255 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:29.369255 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:29.369255 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:29.369255 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:29.369255 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:29.369255 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:29.369255 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:29.369255 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:29.369255 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:29.369255 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:29.369255 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:29.369255 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:29.370483 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:44:29.370483 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:44:29.370483 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:44:29.370483 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:44:29.370483 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:44:29.370483 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:44:29.370483 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:44:29.370483 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:29.370483 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 537/1074] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:44:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:44:29.375676 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b755a-cdbb-4e2f-a075-63aa5f1afc3e None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:29.399743 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817d574-64a0-416f-956e-917238066a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:29.401027 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817d574-64a0-416f-956e-917238066a40 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:29.401382 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817d574-64a0-416f-956e-917238066a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:29.401722 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817d574-64a0-416f-956e-917238066a40 None admin] PATH_INFO: `/v3/users/3fa4637daf1941ad8681dfb05a594a79` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:29.402973 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d817d574-64a0-416f-956e-917238066a40 None admin] RBAC: Authorizing `identity:get_user(user_id=3fa4637daf1941ad8681dfb05a594a79)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:29.404772 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d817d574-64a0-416f-956e-917238066a40 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:29.411334 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 538/1075] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:44:29 2022] GET /identity/v3/users/3fa4637daf1941ad8681dfb05a594a79 => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:29.412858 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817d574-64a0-416f-956e-917238066a40 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:29.480806 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b755a-cdbb-4e2f-a075-63aa5f1afc3e None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:29.515817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199aaf0-3e79-48e4-94fb-884b028aa229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:29.516497 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199aaf0-3e79-48e4-94fb-884b028aa229 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:29.516756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199aaf0-3e79-48e4-94fb-884b028aa229 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:29.517033 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199aaf0-3e79-48e4-94fb-884b028aa229 None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:29.517833 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199aaf0-3e79-48e4-94fb-884b028aa229 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:29.518142 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199aaf0-3e79-48e4-94fb-884b028aa229 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:29.519644 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199aaf0-3e79-48e4-94fb-884b028aa229 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:29.521970 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817d574-64a0-416f-956e-917238066a40 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:29.534567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 538/1076] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:44:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:29.540275 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199aaf0-3e79-48e4-94fb-884b028aa229 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:29.545823 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:29.567805 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212df422-3d49-4f6d-9a39-7d1fcc86823f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:29.568666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212df422-3d49-4f6d-9a39-7d1fcc86823f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:29.568941 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212df422-3d49-4f6d-9a39-7d1fcc86823f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:29.569215 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212df422-3d49-4f6d-9a39-7d1fcc86823f None admin] PATH_INFO: `/v3/projects/c90ec771fd0148c0995151d74e6081cd` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:29.570538 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212df422-3d49-4f6d-9a39-7d1fcc86823f None admin] RBAC: Authorizing `identity:get_project(project_id=c90ec771fd0148c0995151d74e6081cd)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:29.572006 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212df422-3d49-4f6d-9a39-7d1fcc86823f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:29.573722 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 539/1077] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:44:29 2022] GET /identity/v3/projects/c90ec771fd0148c0995151d74e6081cd => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:44:29.576780 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:29.579881 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212df422-3d49-4f6d-9a39-7d1fcc86823f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:29.643092 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199aaf0-3e79-48e4-94fb-884b028aa229 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:29.678836 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec3792-a1b6-4574-afc2-08d15bbcf0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:29.679778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec3792-a1b6-4574-afc2-08d15bbcf0db None admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:29.680054 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec3792-a1b6-4574-afc2-08d15bbcf0db None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:29.680321 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec3792-a1b6-4574-afc2-08d15bbcf0db None admin] PATH_INFO: `/v3/projects/4bc610fb6724419dac99f2483089c783/users/6f638cc70c994a529a48cb2c92b70384/roles/3cf148f1bf7444adb9c10cf415dac532` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:29.682510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec3792-a1b6-4574-afc2-08d15bbcf0db None admin] RBAC: Authorizing `identity:create_grant(project_id=4bc610fb6724419dac99f2483089c783, user_id=6f638cc70c994a529a48cb2c92b70384, role_id=3cf148f1bf7444adb9c10cf415dac532)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:29.683968 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec3792-a1b6-4574-afc2-08d15bbcf0db None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:29.692668 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212df422-3d49-4f6d-9a39-7d1fcc86823f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:29.700243 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 539/1078] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 4 05:44:29 2022] PUT /identity/v3/projects/4bc610fb6724419dac99f2483089c783/users/6f638cc70c994a529a48cb2c92b70384/roles/3cf148f1bf7444adb9c10cf415dac532 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 05:44:29.738973 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac1e52-0600-4aaf-b6ef-9894fea7f64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:29.739910 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac1e52-0600-4aaf-b6ef-9894fea7f64a None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:29.740193 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac1e52-0600-4aaf-b6ef-9894fea7f64a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:29.740461 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac1e52-0600-4aaf-b6ef-9894fea7f64a None admin] PATH_INFO: `/v3/projects/c90ec771fd0148c0995151d74e6081cd/users/3fa4637daf1941ad8681dfb05a594a79/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:29.742598 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac1e52-0600-4aaf-b6ef-9894fea7f64a None admin] RBAC: Authorizing `identity:create_grant(project_id=c90ec771fd0148c0995151d74e6081cd, user_id=3fa4637daf1941ad8681dfb05a594a79, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:29.744206 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac1e52-0600-4aaf-b6ef-9894fea7f64a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:29.763038 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 540/1079] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 4 05:44:29 2022] PUT /identity/v3/projects/c90ec771fd0148c0995151d74e6081cd/users/3fa4637daf1941ad8681dfb05a594a79/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 05:44:30.678891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b4c61-cd8a-4fba-8e21-78dee36ddafa None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:30.679478 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b4c61-cd8a-4fba-8e21-78dee36ddafa None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:30.679478 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b4c61-cd8a-4fba-8e21-78dee36ddafa None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:30.681087 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 540/1080] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:44:30.686077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4b722-3534-4455-937a-20d40302cf73 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:30.686366 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4b722-3534-4455-937a-20d40302cf73 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:30.686641 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4b722-3534-4455-937a-20d40302cf73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:30.703750 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-f4f4b722-3534-4455-937a-20d40302cf73 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:30.704936 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f4f4b722-3534-4455-937a-20d40302cf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:30.743370 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:30.779074 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 541/1081] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:44:30.801801 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b4c61-cd8a-4fba-8e21-78dee36ddafa None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:30.905165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:30.914792 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b4c61-cd8a-4fba-8e21-78dee36ddafa None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:30.948621 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12ec27-fd20-4a3b-81c6-212931770d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:30.949269 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12ec27-fd20-4a3b-81c6-212931770d0b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:30.949550 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12ec27-fd20-4a3b-81c6-212931770d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:30.949820 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12ec27-fd20-4a3b-81c6-212931770d0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:31.015266 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e12ec27-fd20-4a3b-81c6-212931770d0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:31.016726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e12ec27-fd20-4a3b-81c6-212931770d0b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:31.105137 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:31.117661 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 541/1082] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:44:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 05:44:31.119233 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4b722-3534-4455-937a-20d40302cf73 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:31.218097 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4b722-3534-4455-937a-20d40302cf73 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:31.251802 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944b574-e8a8-4c88-ad69-9f09ea834f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:31.252591 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944b574-e8a8-4c88-ad69-9f09ea834f17 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:31.252869 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944b574-e8a8-4c88-ad69-9f09ea834f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:31.253149 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944b574-e8a8-4c88-ad69-9f09ea834f17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:31.263639 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944b574-e8a8-4c88-ad69-9f09ea834f17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:31.265048 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944b574-e8a8-4c88-ad69-9f09ea834f17 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:31.282829 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-1944b574-e8a8-4c88-ad69-9f09ea834f17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:44:31.282829 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:31.282829 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:31.282829 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:31.282829 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:31.282829 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:31.282829 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:31.282829 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:31.282829 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:31.282829 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:31.282829 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:31.282829 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:31.282829 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:44:31.282829 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:44:31.282829 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:44:31.284018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:44:31.284018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:31.284018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:31.284018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:31.284018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:31.284018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:31.284018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:31.284018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:31.284018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:31.284018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:31.284018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:31.284018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:31.284018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:31.284018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:31.284018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:31.284018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:31.284018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:31.284918 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:44:31.284918 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:44:31.284918 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:44:31.284918 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:31.287524 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 542/1083] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:44:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:31.290274 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12ec27-fd20-4a3b-81c6-212931770d0b None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:31.396484 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12ec27-fd20-4a3b-81c6-212931770d0b None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:31.430605 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c79909-e59c-427f-a07c-d2f7f6ce5ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:31.431301 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c79909-e59c-427f-a07c-d2f7f6ce5ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:31.431586 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c79909-e59c-427f-a07c-d2f7f6ce5ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:31.431857 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c79909-e59c-427f-a07c-d2f7f6ce5ca6 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:31.432580 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c79909-e59c-427f-a07c-d2f7f6ce5ca6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:31.432883 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c79909-e59c-427f-a07c-d2f7f6ce5ca6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:31.434251 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c79909-e59c-427f-a07c-d2f7f6ce5ca6 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:31.445991 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 542/1084] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:31.730586 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f30fdb-2cc6-4759-8b97-5c879a525d99 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:31.731104 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f30fdb-2cc6-4759-8b97-5c879a525d99 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:31.731104 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f30fdb-2cc6-4759-8b97-5c879a525d99 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:31.732527 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 543/1085] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:44:31.737831 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab6820-933e-4152-84fd-9cefa9e82a7b None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:31.738266 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab6820-933e-4152-84fd-9cefa9e82a7b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:31.738390 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab6820-933e-4152-84fd-9cefa9e82a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:31.756509 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-f3ab6820-933e-4152-84fd-9cefa9e82a7b None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:31.757727 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f3ab6820-933e-4152-84fd-9cefa9e82a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:31.764830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88728ed-aa34-4e51-809c-958ebf75e293 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:31.765115 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88728ed-aa34-4e51-809c-958ebf75e293 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:31.765390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88728ed-aa34-4e51-809c-958ebf75e293 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:31.766758 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 544/1086] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:44:31.772905 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db02c1c-2584-4dc8-940d-ea30ea693c05 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:31.773231 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db02c1c-2584-4dc8-940d-ea30ea693c05 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:31.773460 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db02c1c-2584-4dc8-940d-ea30ea693c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:31.791281 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-4db02c1c-2584-4dc8-940d-ea30ea693c05 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:31.792466 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4db02c1c-2584-4dc8-940d-ea30ea693c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:31.810551 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:31.811401 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:31.830424 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 543/1087] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:44:31.853828 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab6820-933e-4152-84fd-9cefa9e82a7b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:31.862445 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 545/1088] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 05:44:31.886073 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db02c1c-2584-4dc8-940d-ea30ea693c05 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:31.952841 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab6820-933e-4152-84fd-9cefa9e82a7b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:31.981828 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db02c1c-2584-4dc8-940d-ea30ea693c05 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:31.987903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a573d-13cd-46e7-983c-88070e6aa1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:31.988719 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a573d-13cd-46e7-983c-88070e6aa1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:31.988997 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a573d-13cd-46e7-983c-88070e6aa1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:31.989273 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a573d-13cd-46e7-983c-88070e6aa1b8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:31.999797 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a573d-13cd-46e7-983c-88070e6aa1b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:44:32.008022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-a27a573d-13cd-46e7-983c-88070e6aa1b8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 05:44:32.008022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:32.008022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:32.008022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:32.008022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:32.008022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:32.008022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:32.008022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:32.008022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:32.008022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:32.008022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:32.008022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:32.008022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:44:32.008022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:44:32.008022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:44:32.008022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:44:32.008962 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:44:32.008962 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:44:32.008962 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:44:32.008962 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:44:32.008962 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:32.008962 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:32.008962 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:32.008962 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:32.008962 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:32.008962 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:32.008962 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:32.008962 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:32.008962 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:32.008962 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:32.008962 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:32.008962 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:32.009809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:32.009809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:32.009809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:32.009809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:32.009809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:44:32.009809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:44:32.009809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:44:32.009809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:44:32.009809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:44:32.009809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:44:32.009809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 05:44:32.009809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:32.009809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 544/1089] 10.222.0.16 () {56 vars in 1120 bytes} [Mon Jul 4 05:44:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:44:32.014593 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bd482-633d-4d8e-897b-9c837406620b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:32.015255 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a573d-13cd-46e7-983c-88070e6aa1b8 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:32.015412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bd482-633d-4d8e-897b-9c837406620b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:32.015690 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bd482-633d-4d8e-897b-9c837406620b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:32.016017 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bd482-633d-4d8e-897b-9c837406620b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:32.026986 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9bd482-633d-4d8e-897b-9c837406620b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:44:32.034495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-6a9bd482-633d-4d8e-897b-9c837406620b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:44:32.034495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:32.034495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:32.034495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:32.034495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:32.034495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:32.034495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:32.034495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:32.034495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:32.034495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:32.034495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:32.034495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:32.034495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:44:32.034495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:44:32.034495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:44:32.034495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:44:32.035449 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:44:32.035449 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:44:32.035449 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:44:32.035449 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:44:32.035449 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:32.035449 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:32.035449 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:32.035449 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:32.035449 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:32.035449 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:32.035449 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:32.035449 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:32.035449 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:32.035449 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:32.035449 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:32.035449 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:32.036304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:32.036304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:32.036304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:32.036304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:32.036304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:44:32.036304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:44:32.036304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:44:32.036304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:44:32.036304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:44:32.036304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:44:32.036304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:44:32.036304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:32.036304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 546/1090] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:44:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:44:32.041789 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bd482-633d-4d8e-897b-9c837406620b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:32.058461 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:32.063580 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:32.116818 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a573d-13cd-46e7-983c-88070e6aa1b8 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:32.141651 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bd482-633d-4d8e-897b-9c837406620b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:32.150855 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28515b-6b06-4920-8363-7a284543027a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:32.151564 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28515b-6b06-4920-8363-7a284543027a None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:32.151845 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28515b-6b06-4920-8363-7a284543027a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:32.152118 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28515b-6b06-4920-8363-7a284543027a None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:32.152865 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28515b-6b06-4920-8363-7a284543027a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:32.153166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28515b-6b06-4920-8363-7a284543027a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:32.154547 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28515b-6b06-4920-8363-7a284543027a None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:32.162396 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 545/1091] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Jul 4 05:44:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:32.167957 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28515b-6b06-4920-8363-7a284543027a None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:32.174756 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97f353-942c-4d05-b0fe-8058325344de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:32.175564 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97f353-942c-4d05-b0fe-8058325344de None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:32.175849 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97f353-942c-4d05-b0fe-8058325344de None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:32.176124 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97f353-942c-4d05-b0fe-8058325344de None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:32.176868 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97f353-942c-4d05-b0fe-8058325344de None admin] RBAC: Adding query filter params (name=admin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:32.177170 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97f353-942c-4d05-b0fe-8058325344de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:32.178544 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97f353-942c-4d05-b0fe-8058325344de None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:32.188549 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 547/1092] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:44:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:32.194346 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97f353-942c-4d05-b0fe-8058325344de None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:32.270856 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28515b-6b06-4920-8363-7a284543027a None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:32.274992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:32.280282 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:32.296290 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97f353-942c-4d05-b0fe-8058325344de None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:32.305507 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8db23-8d65-4737-a901-ce9997518dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:32.306313 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8db23-8d65-4737-a901-ce9997518dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:32.306593 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8db23-8d65-4737-a901-ce9997518dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:32.306868 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8db23-8d65-4737-a901-ce9997518dc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:32.317192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a8db23-8d65-4737-a901-ce9997518dc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:32.318642 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a8db23-8d65-4737-a901-ce9997518dc0 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:32.329387 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b1bbf-83f8-41bf-ac92-ce5c8ca935d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:32.330249 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b1bbf-83f8-41bf-ac92-ce5c8ca935d3 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:32.330525 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b1bbf-83f8-41bf-ac92-ce5c8ca935d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:32.330796 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b1bbf-83f8-41bf-ac92-ce5c8ca935d3 None admin] PATH_INFO: `/v3/users/3fa4637daf1941ad8681dfb05a594a79` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:32.331995 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b1bbf-83f8-41bf-ac92-ce5c8ca935d3 None admin] RBAC: Authorizing `identity:get_user(user_id=3fa4637daf1941ad8681dfb05a594a79)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:32.333412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b1bbf-83f8-41bf-ac92-ce5c8ca935d3 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:32.335050 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 548/1093] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:44:32 2022] GET /identity/v3/users/3fa4637daf1941ad8681dfb05a594a79 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:32.335505 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-65a8db23-8d65-4737-a901-ce9997518dc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:44:32.335505 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:32.335505 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:32.335505 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:32.335505 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:32.335505 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:32.335505 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:32.335505 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:32.335505 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:32.335505 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:32.335505 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:32.335505 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:32.335505 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:44:32.335505 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:44:32.335505 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:44:32.336560 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:44:32.336560 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:32.336560 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:32.336560 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:32.336560 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:32.336560 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:32.336560 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:32.336560 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:32.336560 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:32.336560 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:32.336560 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:32.336560 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:32.336560 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:32.336560 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:32.336560 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:32.336560 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:32.336560 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:32.337500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:44:32.337500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:44:32.337500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:44:32.337500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:32.337500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 546/1094] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:44:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:32.342096 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b1bbf-83f8-41bf-ac92-ce5c8ca935d3 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:32.342252 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8db23-8d65-4737-a901-ce9997518dc0 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:32.438978 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b1bbf-83f8-41bf-ac92-ce5c8ca935d3 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:32.440619 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8db23-8d65-4737-a901-ce9997518dc0 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:32.471310 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9c12d-c8b2-4ef8-bffa-3bc2aed4f8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:32.471972 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9c12d-c8b2-4ef8-bffa-3bc2aed4f8ed None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:32.472255 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9c12d-c8b2-4ef8-bffa-3bc2aed4f8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:32.472531 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9c12d-c8b2-4ef8-bffa-3bc2aed4f8ed None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:32.472739 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdf959-066d-4cfe-808c-3ce35edbd97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:32.473272 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae9c12d-c8b2-4ef8-bffa-3bc2aed4f8ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:32.473494 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdf959-066d-4cfe-808c-3ce35edbd97e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:32.473588 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae9c12d-c8b2-4ef8-bffa-3bc2aed4f8ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:32.473671 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdf959-066d-4cfe-808c-3ce35edbd97e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:32.473912 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdf959-066d-4cfe-808c-3ce35edbd97e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:32.474939 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae9c12d-c8b2-4ef8-bffa-3bc2aed4f8ed None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:32.486682 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 549/1095] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:32.492359 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9c12d-c8b2-4ef8-bffa-3bc2aed4f8ed None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:32.496332 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:32.502578 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:32.551020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fdf959-066d-4cfe-808c-3ce35edbd97e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:32.552557 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fdf959-066d-4cfe-808c-3ce35edbd97e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:32.594221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9c12d-c8b2-4ef8-bffa-3bc2aed4f8ed None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:32.628019 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7904c-614b-4629-a68a-5aa6424804c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:32.628798 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7904c-614b-4629-a68a-5aa6424804c0 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:32.629074 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7904c-614b-4629-a68a-5aa6424804c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:32.629347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7904c-614b-4629-a68a-5aa6424804c0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:32.636189 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7904c-614b-4629-a68a-5aa6424804c0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:32.637616 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7904c-614b-4629-a68a-5aa6424804c0 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:32.650697 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 547/1096] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:44:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 05:44:32.651778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-79f7904c-614b-4629-a68a-5aa6424804c0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 05:44:32.651778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:32.651778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:32.651778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:32.651778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:32.651778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:32.651778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:32.651778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:32.651778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:32.651778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:32.651778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:32.651778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:32.651778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:44:32.651778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:44:32.651778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:44:32.651778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:44:32.652897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:32.652897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:32.652897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:44:32.652897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:44:32.652897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:44:32.652897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:44:32.652897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:32.652897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:32.652897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:32.652897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:32.652897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:32.652897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:32.652897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:32.652897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:32.652897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:32.652897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:32.652897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:32.652897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:32.653862 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:32.653862 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:32.653862 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:44:32.653862 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:44:32.653862 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:44:32.653862 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:44:32.653862 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:44:32.653862 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:44:32.653862 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 05:44:32.653862 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:32.653862 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 550/1097] 10.222.0.16 () {56 vars in 1093 bytes} [Mon Jul 4 05:44:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:32.656543 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdf959-066d-4cfe-808c-3ce35edbd97e None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:32.658305 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7904c-614b-4629-a68a-5aa6424804c0 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:32.715358 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:32.718749 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:32.755698 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdf959-066d-4cfe-808c-3ce35edbd97e None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:32.756579 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7904c-614b-4629-a68a-5aa6424804c0 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:32.789722 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613de5ed-ea3e-4dbe-b0be-5e3d3bc12a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:32.790545 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613de5ed-ea3e-4dbe-b0be-5e3d3bc12a64 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:32.790823 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613de5ed-ea3e-4dbe-b0be-5e3d3bc12a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:32.791089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613de5ed-ea3e-4dbe-b0be-5e3d3bc12a64 None admin] PATH_INFO: `/v3/projects/c90ec771fd0148c0995151d74e6081cd` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:32.791236 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c3544-a469-4ed8-8470-f1eed2fdfa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:32.791864 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c3544-a469-4ed8-8470-f1eed2fdfa4b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:32.792150 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c3544-a469-4ed8-8470-f1eed2fdfa4b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:32.792290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613de5ed-ea3e-4dbe-b0be-5e3d3bc12a64 None admin] RBAC: Authorizing `identity:get_project(project_id=c90ec771fd0148c0995151d74e6081cd)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:32.792395 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c3544-a469-4ed8-8470-f1eed2fdfa4b None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:32.793237 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c3544-a469-4ed8-8470-f1eed2fdfa4b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:32.793547 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c3544-a469-4ed8-8470-f1eed2fdfa4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:32.793688 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613de5ed-ea3e-4dbe-b0be-5e3d3bc12a64 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:32.794965 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c3544-a469-4ed8-8470-f1eed2fdfa4b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:32.795594 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 548/1098] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:44:32 2022] GET /identity/v3/projects/c90ec771fd0148c0995151d74e6081cd => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:44:32.801436 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613de5ed-ea3e-4dbe-b0be-5e3d3bc12a64 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:32.816223 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 551/1099] 10.222.0.16 () {56 vars in 1133 bytes} [Mon Jul 4 05:44:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:44:32.821824 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c3544-a469-4ed8-8470-f1eed2fdfa4b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:32.898609 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613de5ed-ea3e-4dbe-b0be-5e3d3bc12a64 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:32.917055 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c3544-a469-4ed8-8470-f1eed2fdfa4b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:32.924603 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:32.933474 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955a21d-2779-450b-a7b4-c3c9aee1e88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:32.934126 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955a21d-2779-450b-a7b4-c3c9aee1e88c None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:32.934404 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955a21d-2779-450b-a7b4-c3c9aee1e88c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:32.934677 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955a21d-2779-450b-a7b4-c3c9aee1e88c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:32.935540 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955a21d-2779-450b-a7b4-c3c9aee1e88c None admin] RBAC: Adding query filter params (role.id=6c5b161dbf33447fa1d383915d3c9382, scope.project.id=c90ec771fd0148c0995151d74e6081cd, user.id=3fa4637daf1941ad8681dfb05a594a79) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:32.935853 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955a21d-2779-450b-a7b4-c3c9aee1e88c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:32.937281 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955a21d-2779-450b-a7b4-c3c9aee1e88c None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:32.939196 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:32.943351 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 549/1100] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:44:32 2022] GET /identity/v3/role_assignments?user.id=3fa4637daf1941ad8681dfb05a594a79&scope.project.id=c90ec771fd0148c0995151d74e6081cd&role.id=6c5b161dbf33447fa1d383915d3c9382 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:44:32.951563 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672f3fd-8bc6-4914-aba6-af73f1d0a6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:32.952231 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672f3fd-8bc6-4914-aba6-af73f1d0a6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:32.952511 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672f3fd-8bc6-4914-aba6-af73f1d0a6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:32.952781 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672f3fd-8bc6-4914-aba6-af73f1d0a6c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:33.027967 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672f3fd-8bc6-4914-aba6-af73f1d0a6c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:33.029435 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672f3fd-8bc6-4914-aba6-af73f1d0a6c9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:33.135099 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 552/1101] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:44:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 05:44:33.141236 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955a21d-2779-450b-a7b4-c3c9aee1e88c None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:33.240071 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955a21d-2779-450b-a7b4-c3c9aee1e88c None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:33.274314 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338965c8-f3cb-41ee-b889-a5c2128d1ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:33.275110 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338965c8-f3cb-41ee-b889-a5c2128d1ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:33.275412 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338965c8-f3cb-41ee-b889-a5c2128d1ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:33.275686 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338965c8-f3cb-41ee-b889-a5c2128d1ee0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:33.286329 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338965c8-f3cb-41ee-b889-a5c2128d1ee0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:33.287809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338965c8-f3cb-41ee-b889-a5c2128d1ee0 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:33.304648 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-338965c8-f3cb-41ee-b889-a5c2128d1ee0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:44:33.304648 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:33.304648 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:33.304648 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:33.304648 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:33.304648 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:33.304648 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:33.304648 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:33.304648 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:33.304648 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:33.304648 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:33.304648 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:33.304648 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:44:33.304648 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:44:33.304648 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:44:33.305548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:44:33.305548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:33.305548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:33.305548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:33.305548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:33.305548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:33.305548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:33.305548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:33.305548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:33.305548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:33.305548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:33.305548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:33.305548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:33.305548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:33.305548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:33.305548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:33.305548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:33.306440 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:44:33.306440 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:44:33.306440 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:44:33.306440 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:33.306440 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 550/1102] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:44:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:33.311611 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672f3fd-8bc6-4914-aba6-af73f1d0a6c9 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:33.335781 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:33.411870 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672f3fd-8bc6-4914-aba6-af73f1d0a6c9 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:33.447081 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee6085-8a61-4df6-bd8a-4222a03e5d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:33.447773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee6085-8a61-4df6-bd8a-4222a03e5d8c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:33.448049 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee6085-8a61-4df6-bd8a-4222a03e5d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:33.448323 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee6085-8a61-4df6-bd8a-4222a03e5d8c None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:33.449033 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee6085-8a61-4df6-bd8a-4222a03e5d8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:33.449383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee6085-8a61-4df6-bd8a-4222a03e5d8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:33.450767 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee6085-8a61-4df6-bd8a-4222a03e5d8c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:33.462096 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 553/1103] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:33.467764 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338965c8-f3cb-41ee-b889-a5c2128d1ee0 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:33.513542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:33.571073 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338965c8-f3cb-41ee-b889-a5c2128d1ee0 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:33.605942 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92201a1b-5f18-4045-8bdb-5f96838f1c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:33.606754 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92201a1b-5f18-4045-8bdb-5f96838f1c85 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:33.607037 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92201a1b-5f18-4045-8bdb-5f96838f1c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:33.607344 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92201a1b-5f18-4045-8bdb-5f96838f1c85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:33.614310 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92201a1b-5f18-4045-8bdb-5f96838f1c85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:33.615793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92201a1b-5f18-4045-8bdb-5f96838f1c85 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:33.630261 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-92201a1b-5f18-4045-8bdb-5f96838f1c85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:44:33.630261 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:33.630261 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:33.630261 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:33.630261 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:33.630261 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:33.630261 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:33.630261 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:33.630261 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:33.630261 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:33.630261 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:33.630261 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:33.630261 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:44:33.630261 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:44:33.630261 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:44:33.631127 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:44:33.631127 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:33.631127 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:33.631127 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:33.631127 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:33.631127 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:33.631127 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:33.631127 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:33.631127 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:33.631127 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:33.631127 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:33.631127 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:33.631127 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:33.631127 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:33.631127 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:33.631127 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:33.631127 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:33.632046 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:44:33.632046 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:44:33.632046 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:44:33.632046 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:44:33.632046 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:44:33.632046 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:44:33.632046 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:44:33.632046 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:33.635323 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 551/1104] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:44:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:33.637392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee6085-8a61-4df6-bd8a-4222a03e5d8c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:33.721681 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:33.740360 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee6085-8a61-4df6-bd8a-4222a03e5d8c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:33.778915 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be0ea1-119f-45b8-b452-cf11a3d62df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:33.779607 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be0ea1-119f-45b8-b452-cf11a3d62df2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:33.779935 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be0ea1-119f-45b8-b452-cf11a3d62df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:33.780411 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be0ea1-119f-45b8-b452-cf11a3d62df2 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:33.781443 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be0ea1-119f-45b8-b452-cf11a3d62df2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:33.781750 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be0ea1-119f-45b8-b452-cf11a3d62df2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:33.783204 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be0ea1-119f-45b8-b452-cf11a3d62df2 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:33.795391 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 554/1105] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:44:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:33.801588 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92201a1b-5f18-4045-8bdb-5f96838f1c85 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:33.911691 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92201a1b-5f18-4045-8bdb-5f96838f1c85 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:33.914210 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:33.947769 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d412624-23cd-4b1f-9f93-90388664313e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:33.948412 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d412624-23cd-4b1f-9f93-90388664313e None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:33.948696 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d412624-23cd-4b1f-9f93-90388664313e None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:33.948973 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d412624-23cd-4b1f-9f93-90388664313e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:33.949793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d412624-23cd-4b1f-9f93-90388664313e None admin] RBAC: Adding query filter params (role.id=3cf148f1bf7444adb9c10cf415dac532, scope.project.id=4bc610fb6724419dac99f2483089c783, user.id=6f638cc70c994a529a48cb2c92b70384) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:33.950102 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d412624-23cd-4b1f-9f93-90388664313e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:33.951569 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d412624-23cd-4b1f-9f93-90388664313e None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:33.957636 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 552/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:44:33 2022] GET /identity/v3/role_assignments?user.id=6f638cc70c994a529a48cb2c92b70384&scope.project.id=4bc610fb6724419dac99f2483089c783&role.id=3cf148f1bf7444adb9c10cf415dac532 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:34.976039 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef329c2-6627-42d5-917d-3bec9cc6662c None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:34.976592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef329c2-6627-42d5-917d-3bec9cc6662c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:34.976592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef329c2-6627-42d5-917d-3bec9cc6662c None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:34.978719 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 555/1107] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:44:34.987447 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd7f02-1ad5-490b-93f5-f92326256a67 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:34.987844 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd7f02-1ad5-490b-93f5-f92326256a67 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:34.988091 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd7f02-1ad5-490b-93f5-f92326256a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:35.013319 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d5cd7f02-1ad5-490b-93f5-f92326256a67 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:35.014518 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d5cd7f02-1ad5-490b-93f5-f92326256a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:35.091370 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 553/1108] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:44:35.119536 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef329c2-6627-42d5-917d-3bec9cc6662c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:35.236276 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef329c2-6627-42d5-917d-3bec9cc6662c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:35.276344 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43cca9d-31d5-4291-9ee6-9a181cd281b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:35.277484 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43cca9d-31d5-4291-9ee6-9a181cd281b5 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:35.277834 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43cca9d-31d5-4291-9ee6-9a181cd281b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:35.278188 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43cca9d-31d5-4291-9ee6-9a181cd281b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:35.280197 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43cca9d-31d5-4291-9ee6-9a181cd281b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:35.282436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43cca9d-31d5-4291-9ee6-9a181cd281b5 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:35.284990 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 556/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:44:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:35.292228 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd7f02-1ad5-490b-93f5-f92326256a67 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:35.389272 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:35.394451 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd7f02-1ad5-490b-93f5-f92326256a67 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:35.432384 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee6fd0-b7d1-4841-85f9-67903d9bf118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:35.433042 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee6fd0-b7d1-4841-85f9-67903d9bf118 None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:35.433322 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee6fd0-b7d1-4841-85f9-67903d9bf118 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:35.433599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee6fd0-b7d1-4841-85f9-67903d9bf118 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:35.434313 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee6fd0-b7d1-4841-85f9-67903d9bf118 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:35.435791 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee6fd0-b7d1-4841-85f9-67903d9bf118 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:35.458196 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 554/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 4 05:44:35 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 05:44:37.480496 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416878f5-af9d-4f0f-9de9-63e243d1a9df None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:37.481349 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416878f5-af9d-4f0f-9de9-63e243d1a9df None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:37.481349 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416878f5-af9d-4f0f-9de9-63e243d1a9df None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:37.483654 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 557/1111] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:44:37.489035 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45869dd0-b0e3-4408-82fa-f8bc3200bd53 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:37.489456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45869dd0-b0e3-4408-82fa-f8bc3200bd53 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:37.489545 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45869dd0-b0e3-4408-82fa-f8bc3200bd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:37.508406 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-45869dd0-b0e3-4408-82fa-f8bc3200bd53 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:37.509572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-45869dd0-b0e3-4408-82fa-f8bc3200bd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:37.577399 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 555/1112] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:44:37.601958 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416878f5-af9d-4f0f-9de9-63e243d1a9df None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:37.619459 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:37.713645 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416878f5-af9d-4f0f-9de9-63e243d1a9df None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:37.754808 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12fa313-106f-4d30-9ed2-1fc58e047413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:37.756034 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fa313-106f-4d30-9ed2-1fc58e047413 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:37.756381 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fa313-106f-4d30-9ed2-1fc58e047413 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:37.756722 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fa313-106f-4d30-9ed2-1fc58e047413 None admin] PATH_INFO: `/v3/roles/91c119444803497dafe274cc66f05208` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:37.759534 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12fa313-106f-4d30-9ed2-1fc58e047413 None admin] RBAC: Authorizing `identity:get_role(role_id=91c119444803497dafe274cc66f05208)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:37.761676 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12fa313-106f-4d30-9ed2-1fc58e047413 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:37.763843 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 558/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:44:37 2022] GET /identity/v3/roles/91c119444803497dafe274cc66f05208 => generated 223 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:37.769894 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45869dd0-b0e3-4408-82fa-f8bc3200bd53 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:37.856464 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:37.873357 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45869dd0-b0e3-4408-82fa-f8bc3200bd53 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:37.905915 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb28ee-4aab-4cbb-90d7-54894b3f3fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:37.906772 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb28ee-4aab-4cbb-90d7-54894b3f3fdf None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:37.907052 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb28ee-4aab-4cbb-90d7-54894b3f3fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:37.907379 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb28ee-4aab-4cbb-90d7-54894b3f3fdf None admin] PATH_INFO: `/v3/users/f737fcf990c644cb8da7871081df3b2f` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:37.920187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb28ee-4aab-4cbb-90d7-54894b3f3fdf None admin] RBAC: Authorizing `identity:get_user(user_id=f737fcf990c644cb8da7871081df3b2f)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:37.921624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb28ee-4aab-4cbb-90d7-54894b3f3fdf None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:37.923286 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 556/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:44:37 2022] GET /identity/v3/users/f737fcf990c644cb8da7871081df3b2f => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:37.930105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12fa313-106f-4d30-9ed2-1fc58e047413 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:38.021529 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:38.044716 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12fa313-106f-4d30-9ed2-1fc58e047413 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:38.081246 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df151c-c04c-4963-a915-a84acf62a9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:38.081893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df151c-c04c-4963-a915-a84acf62a9b6 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:38.082209 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df151c-c04c-4963-a915-a84acf62a9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:38.082521 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df151c-c04c-4963-a915-a84acf62a9b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:38.166360 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df151c-c04c-4963-a915-a84acf62a9b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:38.167852 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df151c-c04c-4963-a915-a84acf62a9b6 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:38.245640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:38.272844 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 559/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:44:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 05:44:38.278871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb28ee-4aab-4cbb-90d7-54894b3f3fdf None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:38.380982 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb28ee-4aab-4cbb-90d7-54894b3f3fdf None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:38.416146 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c07900-4673-438a-bf26-d81d11908aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:38.416998 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c07900-4673-438a-bf26-d81d11908aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:38.417274 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c07900-4673-438a-bf26-d81d11908aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:38.417542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c07900-4673-438a-bf26-d81d11908aa5 None admin] PATH_INFO: `/v3/projects/c90ec771fd0148c0995151d74e6081cd` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:38.418749 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c07900-4673-438a-bf26-d81d11908aa5 None admin] RBAC: Authorizing `identity:get_project(project_id=c90ec771fd0148c0995151d74e6081cd)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:38.420195 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c07900-4673-438a-bf26-d81d11908aa5 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:38.421878 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 557/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:44:38 2022] GET /identity/v3/projects/c90ec771fd0148c0995151d74e6081cd => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:38.430781 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df151c-c04c-4963-a915-a84acf62a9b6 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:38.549129 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df151c-c04c-4963-a915-a84acf62a9b6 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:38.583410 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87052bdd-6d5a-4611-b56b-622747f35e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:38.584050 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87052bdd-6d5a-4611-b56b-622747f35e58 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:38.584327 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87052bdd-6d5a-4611-b56b-622747f35e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:38.584601 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87052bdd-6d5a-4611-b56b-622747f35e58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:38.585552 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87052bdd-6d5a-4611-b56b-622747f35e58 None admin] RBAC: Adding query filter params (role.id=91c119444803497dafe274cc66f05208, scope.project.id=c90ec771fd0148c0995151d74e6081cd, user.id=f737fcf990c644cb8da7871081df3b2f) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:38.585859 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87052bdd-6d5a-4611-b56b-622747f35e58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:38.587319 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87052bdd-6d5a-4611-b56b-622747f35e58 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:38.594918 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 560/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:44:38 2022] GET /identity/v3/role_assignments?user.id=f737fcf990c644cb8da7871081df3b2f&scope.project.id=c90ec771fd0148c0995151d74e6081cd&role.id=91c119444803497dafe274cc66f05208 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:40.586306 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5037c67-06fb-4b99-a005-1c9b219aaa4c None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:40.587135 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5037c67-06fb-4b99-a005-1c9b219aaa4c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:40.587295 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5037c67-06fb-4b99-a005-1c9b219aaa4c None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:40.589497 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 558/1118] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:44:40.595749 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63dbda-06ac-4436-97d6-1da2237e2e9c None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:40.596185 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63dbda-06ac-4436-97d6-1da2237e2e9c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:40.596297 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63dbda-06ac-4436-97d6-1da2237e2e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:40.620688 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-bf63dbda-06ac-4436-97d6-1da2237e2e9c None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:40.621866 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-bf63dbda-06ac-4436-97d6-1da2237e2e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:40.657470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:40.700543 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 561/1119] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:44:40.726866 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5037c67-06fb-4b99-a005-1c9b219aaa4c None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:40.740784 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:40.843782 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5037c67-06fb-4b99-a005-1c9b219aaa4c None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:40.878626 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3d8c7-be63-461a-b88f-c2496d4f9198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:40.879509 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3d8c7-be63-461a-b88f-c2496d4f9198 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:40.879790 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3d8c7-be63-461a-b88f-c2496d4f9198 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:40.880059 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3d8c7-be63-461a-b88f-c2496d4f9198 None admin] PATH_INFO: `/v3/roles/91c119444803497dafe274cc66f05208` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:40.881569 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e3d8c7-be63-461a-b88f-c2496d4f9198 None admin] RBAC: Authorizing `identity:get_role(role_id=91c119444803497dafe274cc66f05208)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:40.882965 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e3d8c7-be63-461a-b88f-c2496d4f9198 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:40.884392 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 559/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:44:40 2022] GET /identity/v3/roles/91c119444803497dafe274cc66f05208 => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:40.890938 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63dbda-06ac-4436-97d6-1da2237e2e9c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:41.009564 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63dbda-06ac-4436-97d6-1da2237e2e9c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:41.045507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b9bec-56c9-4eb5-bb83-4eb9cff45324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:41.046370 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b9bec-56c9-4eb5-bb83-4eb9cff45324 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:41.046646 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b9bec-56c9-4eb5-bb83-4eb9cff45324 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:41.046921 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b9bec-56c9-4eb5-bb83-4eb9cff45324 None admin] PATH_INFO: `/v3/users/f737fcf990c644cb8da7871081df3b2f` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:41.048233 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b9bec-56c9-4eb5-bb83-4eb9cff45324 None admin] RBAC: Authorizing `identity:get_user(user_id=f737fcf990c644cb8da7871081df3b2f)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:41.049680 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b9bec-56c9-4eb5-bb83-4eb9cff45324 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:41.051343 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 562/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:44:40 2022] GET /identity/v3/users/f737fcf990c644cb8da7871081df3b2f => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:41.060416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3d8c7-be63-461a-b88f-c2496d4f9198 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:41.138831 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:41.161114 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3d8c7-be63-461a-b88f-c2496d4f9198 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:41.199314 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a76f5a-6a13-4a71-99d3-b75edf213747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:41.200159 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a76f5a-6a13-4a71-99d3-b75edf213747 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:41.200434 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a76f5a-6a13-4a71-99d3-b75edf213747 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:41.200699 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a76f5a-6a13-4a71-99d3-b75edf213747 None admin] PATH_INFO: `/v3/projects/c90ec771fd0148c0995151d74e6081cd` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:41.201976 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a76f5a-6a13-4a71-99d3-b75edf213747 None admin] RBAC: Authorizing `identity:get_project(project_id=c90ec771fd0148c0995151d74e6081cd)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:41.203431 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a76f5a-6a13-4a71-99d3-b75edf213747 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:41.205115 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 560/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:44:41 2022] GET /identity/v3/projects/c90ec771fd0148c0995151d74e6081cd => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:41.214610 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b9bec-56c9-4eb5-bb83-4eb9cff45324 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:41.264991 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:41.336358 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b9bec-56c9-4eb5-bb83-4eb9cff45324 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:41.376979 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194dfe6f-7721-4def-a0ee-e2cb22505688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:41.378356 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dfe6f-7721-4def-a0ee-e2cb22505688 None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:41.378789 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dfe6f-7721-4def-a0ee-e2cb22505688 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:41.379271 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dfe6f-7721-4def-a0ee-e2cb22505688 None admin] PATH_INFO: `/v3/projects/c90ec771fd0148c0995151d74e6081cd/users/f737fcf990c644cb8da7871081df3b2f/roles/91c119444803497dafe274cc66f05208` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:41.383040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194dfe6f-7721-4def-a0ee-e2cb22505688 None admin] RBAC: Authorizing `identity:create_grant(project_id=c90ec771fd0148c0995151d74e6081cd, user_id=f737fcf990c644cb8da7871081df3b2f, role_id=91c119444803497dafe274cc66f05208)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:41.385275 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194dfe6f-7721-4def-a0ee-e2cb22505688 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:41.402987 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 563/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 4 05:44:41 2022] PUT /identity/v3/projects/c90ec771fd0148c0995151d74e6081cd/users/f737fcf990c644cb8da7871081df3b2f/roles/91c119444803497dafe274cc66f05208 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:44:43.383109 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576b106-ab3a-41f5-a117-dad8a64cdb79 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:43.383745 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576b106-ab3a-41f5-a117-dad8a64cdb79 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:43.383745 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576b106-ab3a-41f5-a117-dad8a64cdb79 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:43.385100 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 561/1124] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:44:43.391342 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d638ff-b160-438a-a7a6-f483d33c5e7b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:43.391769 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d638ff-b160-438a-a7a6-f483d33c5e7b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:43.391965 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d638ff-b160-438a-a7a6-f483d33c5e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:43.417656 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-c5d638ff-b160-438a-a7a6-f483d33c5e7b None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:43.418832 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c5d638ff-b160-438a-a7a6-f483d33c5e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:43.488349 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 564/1125] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:44:43.512554 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576b106-ab3a-41f5-a117-dad8a64cdb79 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:43.626700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576b106-ab3a-41f5-a117-dad8a64cdb79 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:43.661861 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad18e36-eeeb-47b4-af18-85f54a9551cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:43.662645 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad18e36-eeeb-47b4-af18-85f54a9551cc None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:43.662950 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad18e36-eeeb-47b4-af18-85f54a9551cc None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:43.663212 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad18e36-eeeb-47b4-af18-85f54a9551cc None admin] PATH_INFO: `/v3/roles/91c119444803497dafe274cc66f05208` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:43.664749 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad18e36-eeeb-47b4-af18-85f54a9551cc None admin] RBAC: Authorizing `identity:get_role(role_id=91c119444803497dafe274cc66f05208)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:43.666133 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad18e36-eeeb-47b4-af18-85f54a9551cc None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:43.667559 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 562/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:44:43 2022] GET /identity/v3/roles/91c119444803497dafe274cc66f05208 => generated 223 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:43.673621 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d638ff-b160-438a-a7a6-f483d33c5e7b None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:43.704726 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:43.775094 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d638ff-b160-438a-a7a6-f483d33c5e7b None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:43.811773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4c877-484c-4bb9-a0e7-38a511df6573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:43.812638 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4c877-484c-4bb9-a0e7-38a511df6573 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:43.812915 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4c877-484c-4bb9-a0e7-38a511df6573 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:43.813190 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4c877-484c-4bb9-a0e7-38a511df6573 None admin] PATH_INFO: `/v3/users/f737fcf990c644cb8da7871081df3b2f` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:43.814487 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4c877-484c-4bb9-a0e7-38a511df6573 None admin] RBAC: Authorizing `identity:get_user(user_id=f737fcf990c644cb8da7871081df3b2f)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:43.815961 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4c877-484c-4bb9-a0e7-38a511df6573 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:43.817611 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 565/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:44:43 2022] GET /identity/v3/users/f737fcf990c644cb8da7871081df3b2f => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:43.825582 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad18e36-eeeb-47b4-af18-85f54a9551cc None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:43.849695 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:43.942160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad18e36-eeeb-47b4-af18-85f54a9551cc None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:43.976577 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5cfb23-87be-4870-97bf-998053a78ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:43.977217 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5cfb23-87be-4870-97bf-998053a78ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:43.977493 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5cfb23-87be-4870-97bf-998053a78ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:43.977763 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5cfb23-87be-4870-97bf-998053a78ab5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:44.051665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5cfb23-87be-4870-97bf-998053a78ab5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:44.053120 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5cfb23-87be-4870-97bf-998053a78ab5 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:44.067767 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:44.153877 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 563/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:44:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 05:44:44.160135 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4c877-484c-4bb9-a0e7-38a511df6573 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:44.264302 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:44.270065 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4c877-484c-4bb9-a0e7-38a511df6573 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:44.309855 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28848f44-62ed-40c0-afa5-050d98909961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:44.311104 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28848f44-62ed-40c0-afa5-050d98909961 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:44.311700 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28848f44-62ed-40c0-afa5-050d98909961 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:44.312009 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28848f44-62ed-40c0-afa5-050d98909961 None admin] PATH_INFO: `/v3/projects/c90ec771fd0148c0995151d74e6081cd` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:44.314044 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28848f44-62ed-40c0-afa5-050d98909961 None admin] RBAC: Authorizing `identity:get_project(project_id=c90ec771fd0148c0995151d74e6081cd)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:44.316321 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28848f44-62ed-40c0-afa5-050d98909961 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:44.318914 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 566/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:44:44 2022] GET /identity/v3/projects/c90ec771fd0148c0995151d74e6081cd => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:44.328725 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5cfb23-87be-4870-97bf-998053a78ab5 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:44.433492 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5cfb23-87be-4870-97bf-998053a78ab5 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:44.447791 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:44.470221 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b90608-f063-4951-b1cf-c32688616de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:44.470870 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b90608-f063-4951-b1cf-c32688616de4 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:44.471155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b90608-f063-4951-b1cf-c32688616de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:44.471475 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b90608-f063-4951-b1cf-c32688616de4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:44.472306 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b90608-f063-4951-b1cf-c32688616de4 None admin] RBAC: Adding query filter params (role.id=91c119444803497dafe274cc66f05208, scope.project.id=c90ec771fd0148c0995151d74e6081cd, user.id=f737fcf990c644cb8da7871081df3b2f) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:44.472617 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b90608-f063-4951-b1cf-c32688616de4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:44.474053 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b90608-f063-4951-b1cf-c32688616de4 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:44.480133 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 564/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:44:44 2022] GET /identity/v3/role_assignments?user.id=f737fcf990c644cb8da7871081df3b2f&scope.project.id=c90ec771fd0148c0995151d74e6081cd&role.id=91c119444803497dafe274cc66f05208 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:46.492010 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a8514-6f7c-40aa-83ca-51b3df6601ed None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:46.492600 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a8514-6f7c-40aa-83ca-51b3df6601ed None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:46.492600 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a8514-6f7c-40aa-83ca-51b3df6601ed None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:46.493917 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 567/1131] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:44:46.500574 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e517394-5808-480a-a621-33205c31f81f None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:46.501304 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e517394-5808-480a-a621-33205c31f81f None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:46.501441 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e517394-5808-480a-a621-33205c31f81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:46.521988 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-6e517394-5808-480a-a621-33205c31f81f None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:46.523165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-6e517394-5808-480a-a621-33205c31f81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:46.594908 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 565/1132] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:44:46.618440 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a8514-6f7c-40aa-83ca-51b3df6601ed None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:46.742583 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a8514-6f7c-40aa-83ca-51b3df6601ed None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:46.777572 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd7874-2174-4ef4-838f-9dc0dd3dc384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:46.778354 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd7874-2174-4ef4-838f-9dc0dd3dc384 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:46.778633 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd7874-2174-4ef4-838f-9dc0dd3dc384 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:46.778896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd7874-2174-4ef4-838f-9dc0dd3dc384 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:46.780454 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd7874-2174-4ef4-838f-9dc0dd3dc384 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:46.781885 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd7874-2174-4ef4-838f-9dc0dd3dc384 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:46.783532 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 568/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:44:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:46.790156 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e517394-5808-480a-a621-33205c31f81f None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:46.899658 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e517394-5808-480a-a621-33205c31f81f None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:46.909521 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:46.934155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414cfff-e232-4bbd-97d3-8a83d08f7245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:46.934803 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414cfff-e232-4bbd-97d3-8a83d08f7245 None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:46.935078 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414cfff-e232-4bbd-97d3-8a83d08f7245 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:46.935400 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414cfff-e232-4bbd-97d3-8a83d08f7245 None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:46.936097 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414cfff-e232-4bbd-97d3-8a83d08f7245 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:46.937527 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414cfff-e232-4bbd-97d3-8a83d08f7245 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:46.963765 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 566/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 4 05:44:46 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:44:48.991446 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c20ff-1c6d-4458-90de-a5f66d866358 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:48.992021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c20ff-1c6d-4458-90de-a5f66d866358 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:48.992021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c20ff-1c6d-4458-90de-a5f66d866358 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:48.994130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 569/1135] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:44:49.003148 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6323c-5de9-42d1-b0be-ab085094f702 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:49.003567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6323c-5de9-42d1-b0be-ab085094f702 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:49.003796 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6323c-5de9-42d1-b0be-ab085094f702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:49.028810 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-faf6323c-5de9-42d1-b0be-ab085094f702 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:49.030011 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-faf6323c-5de9-42d1-b0be-ab085094f702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:49.101563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 567/1136] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:44:49.126839 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c20ff-1c6d-4458-90de-a5f66d866358 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:49.165333 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:49.245293 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c20ff-1c6d-4458-90de-a5f66d866358 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:49.280112 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd03f2-d5e6-40fa-919e-ffc2eb9e077c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:49.280896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd03f2-d5e6-40fa-919e-ffc2eb9e077c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:49.281178 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd03f2-d5e6-40fa-919e-ffc2eb9e077c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:49.281453 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd03f2-d5e6-40fa-919e-ffc2eb9e077c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:49.282619 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd03f2-d5e6-40fa-919e-ffc2eb9e077c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:49.284090 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd03f2-d5e6-40fa-919e-ffc2eb9e077c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:49.285706 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 570/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:44:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:49.291706 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6323c-5de9-42d1-b0be-ab085094f702 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:49.384250 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:49.395941 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6323c-5de9-42d1-b0be-ab085094f702 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:49.432220 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0404dbe-2df7-46f7-92d7-84373a7b01ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:49.432882 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0404dbe-2df7-46f7-92d7-84373a7b01ba None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:49.433170 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0404dbe-2df7-46f7-92d7-84373a7b01ba None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:49.433443 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0404dbe-2df7-46f7-92d7-84373a7b01ba None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:49.434152 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0404dbe-2df7-46f7-92d7-84373a7b01ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:49.435612 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0404dbe-2df7-46f7-92d7-84373a7b01ba None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:49.457597 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 568/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 4 05:44:49 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:44:51.504123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcaf734-1fd8-4f98-97d7-b12632963786 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:51.505017 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcaf734-1fd8-4f98-97d7-b12632963786 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:51.505017 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcaf734-1fd8-4f98-97d7-b12632963786 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:51.508317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 571/1139] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:44:51.513987 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f62e4-03b7-408c-b09f-5ca024f7a9ac None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:51.514410 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f62e4-03b7-408c-b09f-5ca024f7a9ac None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:51.514727 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f62e4-03b7-408c-b09f-5ca024f7a9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:51.533042 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-e83f62e4-03b7-408c-b09f-5ca024f7a9ac None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:51.534218 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e83f62e4-03b7-408c-b09f-5ca024f7a9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:51.610525 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 569/1140] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:44:51.633991 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcaf734-1fd8-4f98-97d7-b12632963786 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:51.741356 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcaf734-1fd8-4f98-97d7-b12632963786 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:51.742893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:51.784736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cff58-296f-4084-b37d-749d2aca4a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:51.785756 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cff58-296f-4084-b37d-749d2aca4a2e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:51.786124 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cff58-296f-4084-b37d-749d2aca4a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:51.786470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cff58-296f-4084-b37d-749d2aca4a2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:51.797747 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8cff58-296f-4084-b37d-749d2aca4a2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:44:51.805470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-0c8cff58-296f-4084-b37d-749d2aca4a2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:44:51.805470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:51.805470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:51.805470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:51.805470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:51.805470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:51.805470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:51.805470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:51.805470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:51.805470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:51.805470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:51.805470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:51.805470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:44:51.805470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:44:51.805470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:44:51.805470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:44:51.806611 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:44:51.806611 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:44:51.806611 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:44:51.806611 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:44:51.806611 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:51.806611 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:51.806611 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:51.806611 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:51.806611 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:51.806611 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:51.806611 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:51.806611 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:51.806611 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:51.806611 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:51.806611 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:51.806611 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:51.807867 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:51.807867 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:51.807867 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:51.807867 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:51.807867 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:44:51.807867 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:44:51.807867 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:44:51.807867 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:44:51.807867 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:44:51.807867 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:44:51.807867 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:44:51.807867 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:51.807867 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 572/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:44:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:51.814304 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f62e4-03b7-408c-b09f-5ca024f7a9ac None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:51.892939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:51.921900 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f62e4-03b7-408c-b09f-5ca024f7a9ac None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:51.957934 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbdc55-dc07-4c34-bb27-14f0edc7a1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:51.958609 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbdc55-dc07-4c34-bb27-14f0edc7a1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:51.958897 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbdc55-dc07-4c34-bb27-14f0edc7a1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:51.959233 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbdc55-dc07-4c34-bb27-14f0edc7a1b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:51.960017 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbdc55-dc07-4c34-bb27-14f0edc7a1b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:51.960326 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbdc55-dc07-4c34-bb27-14f0edc7a1b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:51.961718 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbdc55-dc07-4c34-bb27-14f0edc7a1b9 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:51.970011 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 570/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:44:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:51.976238 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cff58-296f-4084-b37d-749d2aca4a2e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:52.087195 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cff58-296f-4084-b37d-749d2aca4a2e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:52.122185 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58c49f-9bc2-4834-9ed0-f08918edb9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:52.123049 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58c49f-9bc2-4834-9ed0-f08918edb9da None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:52.123360 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58c49f-9bc2-4834-9ed0-f08918edb9da None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:52.123635 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58c49f-9bc2-4834-9ed0-f08918edb9da None admin] PATH_INFO: `/v3/users/c65dc2974e044fd0bd0104a70e2469d3` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:52.137202 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58c49f-9bc2-4834-9ed0-f08918edb9da None admin] RBAC: Authorizing `identity:get_user(user_id=c65dc2974e044fd0bd0104a70e2469d3)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:52.138659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58c49f-9bc2-4834-9ed0-f08918edb9da None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:52.140351 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 573/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:44:51 2022] GET /identity/v3/users/c65dc2974e044fd0bd0104a70e2469d3 => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:52.149621 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbdc55-dc07-4c34-bb27-14f0edc7a1b9 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:52.256900 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbdc55-dc07-4c34-bb27-14f0edc7a1b9 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:52.290542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f394b-941f-43e9-b053-cd9622a1e493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:52.291215 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f394b-941f-43e9-b053-cd9622a1e493 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:52.291496 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f394b-941f-43e9-b053-cd9622a1e493 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:52.291778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f394b-941f-43e9-b053-cd9622a1e493 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:52.300401 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:52.361629 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f394b-941f-43e9-b053-cd9622a1e493 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:52.363005 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f394b-941f-43e9-b053-cd9622a1e493 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:52.467200 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 571/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:44:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 05:44:52.473472 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58c49f-9bc2-4834-9ed0-f08918edb9da None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:52.500542 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:52.592895 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58c49f-9bc2-4834-9ed0-f08918edb9da None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:52.628848 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c45b77-7af8-4693-a5bf-8bbdaec5f949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:52.629623 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c45b77-7af8-4693-a5bf-8bbdaec5f949 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:52.629896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c45b77-7af8-4693-a5bf-8bbdaec5f949 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:52.630164 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c45b77-7af8-4693-a5bf-8bbdaec5f949 None admin] PATH_INFO: `/v3/projects/3d176034a19841ed80678b51e636eff2` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:52.631506 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c45b77-7af8-4693-a5bf-8bbdaec5f949 None admin] RBAC: Authorizing `identity:get_project(project_id=3d176034a19841ed80678b51e636eff2)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:52.632950 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c45b77-7af8-4693-a5bf-8bbdaec5f949 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:52.634644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 574/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:44:52 2022] GET /identity/v3/projects/3d176034a19841ed80678b51e636eff2 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:44:52.641103 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f394b-941f-43e9-b053-cd9622a1e493 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:52.681486 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:52.751619 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f394b-941f-43e9-b053-cd9622a1e493 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:52.796869 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f29e51-8678-48a5-9a29-ebb920f2a2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:52.797842 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f29e51-8678-48a5-9a29-ebb920f2a2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:52.798270 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f29e51-8678-48a5-9a29-ebb920f2a2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:52.798695 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f29e51-8678-48a5-9a29-ebb920f2a2d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:52.800040 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f29e51-8678-48a5-9a29-ebb920f2a2d8 None admin] RBAC: Adding query filter params (role.id=6c5b161dbf33447fa1d383915d3c9382, scope.project.id=3d176034a19841ed80678b51e636eff2, user.id=c65dc2974e044fd0bd0104a70e2469d3) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:52.800522 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f29e51-8678-48a5-9a29-ebb920f2a2d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:52.802720 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f29e51-8678-48a5-9a29-ebb920f2a2d8 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:52.808933 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 572/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:44:52 2022] GET /identity/v3/role_assignments?user.id=c65dc2974e044fd0bd0104a70e2469d3&scope.project.id=3d176034a19841ed80678b51e636eff2&role.id=6c5b161dbf33447fa1d383915d3c9382 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:54.797508 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf4ea0-b251-43fd-a48e-890a2a6af879 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:54.798032 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf4ea0-b251-43fd-a48e-890a2a6af879 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:54.798032 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf4ea0-b251-43fd-a48e-890a2a6af879 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:54.799411 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 575/1147] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:44:54.805811 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a22b7-d3bd-4a5e-ae95-abeefb1f5862 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:54.806572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a22b7-d3bd-4a5e-ae95-abeefb1f5862 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:54.806691 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a22b7-d3bd-4a5e-ae95-abeefb1f5862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:54.833374 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-474a22b7-d3bd-4a5e-ae95-abeefb1f5862 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:54.834969 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-474a22b7-d3bd-4a5e-ae95-abeefb1f5862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:54.906244 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 573/1148] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:44:54.929129 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf4ea0-b251-43fd-a48e-890a2a6af879 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:55.024466 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:55.038867 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf4ea0-b251-43fd-a48e-890a2a6af879 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:55.074719 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c20fd3-c094-42b7-bcc0-2a7a67347c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:55.075535 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c20fd3-c094-42b7-bcc0-2a7a67347c1b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:55.075811 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c20fd3-c094-42b7-bcc0-2a7a67347c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:55.076091 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c20fd3-c094-42b7-bcc0-2a7a67347c1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:55.087031 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c20fd3-c094-42b7-bcc0-2a7a67347c1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:44:55.094560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-38c20fd3-c094-42b7-bcc0-2a7a67347c1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:44:55.094560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:55.094560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:55.094560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:55.094560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:55.094560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:55.094560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:55.094560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:55.094560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:55.094560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:55.094560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:55.094560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:55.094560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:44:55.094560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:44:55.094560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:44:55.094560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:44:55.095660 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:44:55.095660 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:44:55.095660 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:44:55.095660 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:44:55.095660 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:55.095660 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:55.095660 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:55.095660 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:55.095660 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:55.095660 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:55.095660 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:55.095660 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:55.095660 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:55.095660 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:55.095660 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:55.095660 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:55.096637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:55.096637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:55.096637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:55.096637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:55.096637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:44:55.096637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:44:55.096637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:44:55.096637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:44:55.096637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:44:55.096637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:44:55.096637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:44:55.096637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:44:55.099348 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 576/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:44:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:55.101925 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a22b7-d3bd-4a5e-ae95-abeefb1f5862 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:55.134845 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:55.208385 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a22b7-d3bd-4a5e-ae95-abeefb1f5862 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:55.247038 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a89f2-301e-415e-90bd-1f27d420419d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:55.247728 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a89f2-301e-415e-90bd-1f27d420419d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:55.248008 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a89f2-301e-415e-90bd-1f27d420419d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:55.248280 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a89f2-301e-415e-90bd-1f27d420419d None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:55.249027 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a89f2-301e-415e-90bd-1f27d420419d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:55.249330 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a89f2-301e-415e-90bd-1f27d420419d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:55.250704 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a89f2-301e-415e-90bd-1f27d420419d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:55.258882 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 574/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:44:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:55.265586 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c20fd3-c094-42b7-bcc0-2a7a67347c1b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:55.374003 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c20fd3-c094-42b7-bcc0-2a7a67347c1b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:55.408855 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de88a8b-40cc-4d26-948a-a73564cad07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:55.409699 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de88a8b-40cc-4d26-948a-a73564cad07d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:55.409982 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de88a8b-40cc-4d26-948a-a73564cad07d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:55.410255 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de88a8b-40cc-4d26-948a-a73564cad07d None admin] PATH_INFO: `/v3/users/c65dc2974e044fd0bd0104a70e2469d3` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:55.411573 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de88a8b-40cc-4d26-948a-a73564cad07d None admin] RBAC: Authorizing `identity:get_user(user_id=c65dc2974e044fd0bd0104a70e2469d3)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:55.413062 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de88a8b-40cc-4d26-948a-a73564cad07d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:55.414686 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 577/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:44:55 2022] GET /identity/v3/users/c65dc2974e044fd0bd0104a70e2469d3 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:55.420720 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a89f2-301e-415e-90bd-1f27d420419d None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:55.517282 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:55.524847 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a89f2-301e-415e-90bd-1f27d420419d None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:55.560895 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86f36d-d585-4c06-a0bb-1654a0e0d635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:55.561752 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86f36d-d585-4c06-a0bb-1654a0e0d635 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:55.562027 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86f36d-d585-4c06-a0bb-1654a0e0d635 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:55.562297 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86f36d-d585-4c06-a0bb-1654a0e0d635 None admin] PATH_INFO: `/v3/projects/3d176034a19841ed80678b51e636eff2` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:55.563575 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86f36d-d585-4c06-a0bb-1654a0e0d635 None admin] RBAC: Authorizing `identity:get_project(project_id=3d176034a19841ed80678b51e636eff2)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:55.565025 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86f36d-d585-4c06-a0bb-1654a0e0d635 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:55.566755 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 575/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:44:55 2022] GET /identity/v3/projects/3d176034a19841ed80678b51e636eff2 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:55.576321 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de88a8b-40cc-4d26-948a-a73564cad07d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:55.599803 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:55.682028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de88a8b-40cc-4d26-948a-a73564cad07d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:55.716950 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345cf01-c4c4-4386-a74e-a4e837be88cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:55.717834 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345cf01-c4c4-4386-a74e-a4e837be88cd None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:55.718117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345cf01-c4c4-4386-a74e-a4e837be88cd None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:55.718392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345cf01-c4c4-4386-a74e-a4e837be88cd None admin] PATH_INFO: `/v3/projects/3d176034a19841ed80678b51e636eff2/users/c65dc2974e044fd0bd0104a70e2469d3/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:55.720643 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8345cf01-c4c4-4386-a74e-a4e837be88cd None admin] RBAC: Authorizing `identity:create_grant(project_id=3d176034a19841ed80678b51e636eff2, user_id=c65dc2974e044fd0bd0104a70e2469d3, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:55.722089 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8345cf01-c4c4-4386-a74e-a4e837be88cd None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:55.740612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 578/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 4 05:44:55 2022] PUT /identity/v3/projects/3d176034a19841ed80678b51e636eff2/users/c65dc2974e044fd0bd0104a70e2469d3/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:44:57.713927 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64462a81-9b55-4fab-b729-eaa474c2b492 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:57.714765 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64462a81-9b55-4fab-b729-eaa474c2b492 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:57.714765 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64462a81-9b55-4fab-b729-eaa474c2b492 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:57.717082 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 576/1154] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:44:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:44:57.722374 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22ff1a-4e96-4f6b-a190-96d9c2ab2559 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:57.722796 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22ff1a-4e96-4f6b-a190-96d9c2ab2559 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:57.722886 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22ff1a-4e96-4f6b-a190-96d9c2ab2559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:57.740087 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-fd22ff1a-4e96-4f6b-a190-96d9c2ab2559 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:44:57.741249 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fd22ff1a-4e96-4f6b-a190-96d9c2ab2559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:44:57.809773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 579/1155] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:44:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:44:57.832969 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64462a81-9b55-4fab-b729-eaa474c2b492 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:57.936576 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64462a81-9b55-4fab-b729-eaa474c2b492 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:57.977926 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59117d0-3f65-4375-b569-1bee92b24580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:57.978703 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59117d0-3f65-4375-b569-1bee92b24580 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:57.978984 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59117d0-3f65-4375-b569-1bee92b24580 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:57.979288 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59117d0-3f65-4375-b569-1bee92b24580 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:57.991278 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59117d0-3f65-4375-b569-1bee92b24580 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:44:57.999218 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-f59117d0-3f65-4375-b569-1bee92b24580 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:44:57.999218 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:44:57.999218 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:44:57.999218 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:44:57.999218 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:44:57.999218 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:44:57.999218 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:44:57.999218 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:44:57.999218 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:44:57.999218 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:44:57.999218 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:44:57.999218 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:44:57.999218 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:44:57.999218 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:44:57.999218 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:44:57.999218 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:44:58.000291 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:44:58.000291 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:44:58.000291 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:44:58.000291 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:44:58.000291 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:44:58.000291 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:44:58.000291 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:44:58.000291 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:44:58.000291 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:44:58.000291 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:44:58.000291 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:44:58.000291 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:44:58.000291 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:44:58.000291 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:44:58.000291 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:44:58.000291 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:44:58.001647 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:44:58.001647 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:44:58.001647 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:44:58.001647 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:44:58.001647 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:44:58.001647 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:44:58.001647 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:44:58.001647 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:44:58.001647 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:44:58.001647 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:44:58.001647 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:44:58.001647 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:44:58.001647 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 577/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:44:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:44:58.008879 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22ff1a-4e96-4f6b-a190-96d9c2ab2559 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:58.021150 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:58.112167 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22ff1a-4e96-4f6b-a190-96d9c2ab2559 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:58.146716 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8094af-efdc-44d7-9cbb-8f71b095ab20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:58.147406 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8094af-efdc-44d7-9cbb-8f71b095ab20 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:58.147711 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8094af-efdc-44d7-9cbb-8f71b095ab20 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:58.147979 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8094af-efdc-44d7-9cbb-8f71b095ab20 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:58.148727 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8094af-efdc-44d7-9cbb-8f71b095ab20 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:58.149017 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8094af-efdc-44d7-9cbb-8f71b095ab20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:58.150383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8094af-efdc-44d7-9cbb-8f71b095ab20 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:58.159386 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 580/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:44:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:58.166604 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59117d0-3f65-4375-b569-1bee92b24580 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:58.191814 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:58.273740 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59117d0-3f65-4375-b569-1bee92b24580 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:58.314561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ce577-beec-4c03-b165-0b9b6abc281f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:58.315460 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ce577-beec-4c03-b165-0b9b6abc281f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:58.315748 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ce577-beec-4c03-b165-0b9b6abc281f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:58.316030 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ce577-beec-4c03-b165-0b9b6abc281f None admin] PATH_INFO: `/v3/users/c65dc2974e044fd0bd0104a70e2469d3` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:58.317257 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ce577-beec-4c03-b165-0b9b6abc281f None admin] RBAC: Authorizing `identity:get_user(user_id=c65dc2974e044fd0bd0104a70e2469d3)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:58.318785 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ce577-beec-4c03-b165-0b9b6abc281f None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:58.320472 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 578/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:44:58 2022] GET /identity/v3/users/c65dc2974e044fd0bd0104a70e2469d3 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:58.329301 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8094af-efdc-44d7-9cbb-8f71b095ab20 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:58.405115 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:58.442290 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8094af-efdc-44d7-9cbb-8f71b095ab20 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:58.476339 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bcda25-3ef4-40d8-bfd1-c75dded0e12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:58.476959 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bcda25-3ef4-40d8-bfd1-c75dded0e12e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:58.477236 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bcda25-3ef4-40d8-bfd1-c75dded0e12e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:58.477503 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bcda25-3ef4-40d8-bfd1-c75dded0e12e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:58.547073 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bcda25-3ef4-40d8-bfd1-c75dded0e12e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:58.548587 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bcda25-3ef4-40d8-bfd1-c75dded0e12e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:58.616022 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:58.651017 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 581/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:44:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 05:44:58.657403 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ce577-beec-4c03-b165-0b9b6abc281f None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:58.749473 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:44:58.759550 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ce577-beec-4c03-b165-0b9b6abc281f None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:58.796139 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f7d98-7074-49ac-9a52-4a865acbad1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:58.796994 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f7d98-7074-49ac-9a52-4a865acbad1c None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:58.797277 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f7d98-7074-49ac-9a52-4a865acbad1c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:58.797550 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f7d98-7074-49ac-9a52-4a865acbad1c None admin] PATH_INFO: `/v3/projects/3d176034a19841ed80678b51e636eff2` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:58.798779 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f7d98-7074-49ac-9a52-4a865acbad1c None admin] RBAC: Authorizing `identity:get_project(project_id=3d176034a19841ed80678b51e636eff2)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:58.800248 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f7d98-7074-49ac-9a52-4a865acbad1c None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:58.801965 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 579/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:44:58 2022] GET /identity/v3/projects/3d176034a19841ed80678b51e636eff2 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:44:58.810627 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bcda25-3ef4-40d8-bfd1-c75dded0e12e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:44:58.911919 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bcda25-3ef4-40d8-bfd1-c75dded0e12e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:44:58.945928 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac014e6c-f4de-4d6c-ae4a-0171c9b089c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:44:58.946548 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac014e6c-f4de-4d6c-ae4a-0171c9b089c8 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:44:58.946822 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac014e6c-f4de-4d6c-ae4a-0171c9b089c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:44:58.947093 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac014e6c-f4de-4d6c-ae4a-0171c9b089c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:44:58.947939 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac014e6c-f4de-4d6c-ae4a-0171c9b089c8 None admin] RBAC: Adding query filter params (role.id=6c5b161dbf33447fa1d383915d3c9382, scope.project.id=3d176034a19841ed80678b51e636eff2, user.id=c65dc2974e044fd0bd0104a70e2469d3) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:44:58.948242 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac014e6c-f4de-4d6c-ae4a-0171c9b089c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:44:58.949680 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac014e6c-f4de-4d6c-ae4a-0171c9b089c8 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:44:58.955349 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 582/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:44:58 2022] GET /identity/v3/role_assignments?user.id=c65dc2974e044fd0bd0104a70e2469d3&scope.project.id=3d176034a19841ed80678b51e636eff2&role.id=6c5b161dbf33447fa1d383915d3c9382 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:45:00.989455 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b9c47-3a89-4383-8ace-da63cc8fe735 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:00.990478 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b9c47-3a89-4383-8ace-da63cc8fe735 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:00.990478 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b9c47-3a89-4383-8ace-da63cc8fe735 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:00.992715 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 580/1162] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:45:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:45:00.999363 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9bd43-27ee-41ff-8118-c340ac373756 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:00.999827 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9bd43-27ee-41ff-8118-c340ac373756 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:00.999923 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9bd43-27ee-41ff-8118-c340ac373756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:01.024658 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d9c9bd43-27ee-41ff-8118-c340ac373756 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:45:01.025845 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d9c9bd43-27ee-41ff-8118-c340ac373756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:45:01.051892 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:45:01.094571 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 583/1163] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:45:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:45:01.125951 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b9c47-3a89-4383-8ace-da63cc8fe735 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:45:01.231907 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b9c47-3a89-4383-8ace-da63cc8fe735 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:45:01.269676 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb3bf1-cc10-44e0-93fd-fde44402fe2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:45:01.270270 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb3bf1-cc10-44e0-93fd-fde44402fe2c None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:01.270551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb3bf1-cc10-44e0-93fd-fde44402fe2c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:01.270828 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb3bf1-cc10-44e0-93fd-fde44402fe2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:01.301086 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:45:01.344421 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb3bf1-cc10-44e0-93fd-fde44402fe2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:45:01.345859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb3bf1-cc10-44e0-93fd-fde44402fe2c None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:45:01.444955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 581/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:45:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 05:45:01.451869 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9bd43-27ee-41ff-8118-c340ac373756 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:45:01.564451 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9bd43-27ee-41ff-8118-c340ac373756 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:45:01.597192 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20838bcf-e5cc-46c9-ab87-1caf8b82bc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:45:01.597991 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20838bcf-e5cc-46c9-ab87-1caf8b82bc44 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:01.598271 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20838bcf-e5cc-46c9-ab87-1caf8b82bc44 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:01.598547 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20838bcf-e5cc-46c9-ab87-1caf8b82bc44 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:01.605037 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20838bcf-e5cc-46c9-ab87-1caf8b82bc44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:45:01.606490 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20838bcf-e5cc-46c9-ab87-1caf8b82bc44 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:45:01.620932 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-20838bcf-e5cc-46c9-ab87-1caf8b82bc44 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 04 05:45:01.620932 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:45:01.620932 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 04 05:45:01.620932 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 04 05:45:01.620932 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:45:01.620932 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:45:01.620932 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:45:01.620932 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:45:01.620932 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 04 05:45:01.620932 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:45:01.620932 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 05:45:01.620932 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:45:01.620932 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:45:01.620932 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:45:01.620932 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:45:01.620932 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:45:01.620932 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:45:01.622077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:45:01.622077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:45:01.622077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:45:01.622077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:45:01.622077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:45:01.622077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:45:01.622077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:45:01.622077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:45:01.622077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:45:01.622077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:45:01.622077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:45:01.622077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:45:01.622077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:45:01.622077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:45:01.622077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:45:01.622077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:45:01.623234 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:45:01.623234 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:45:01.623234 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:45:01.623234 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:45:01.623234 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:45:01.623234 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:45:01.623234 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:45:01.623234 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:45:01.623234 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:45:01.623234 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:45:01.623234 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 04 05:45:01.623234 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:45:01.623234 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 04 05:45:01.623234 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:45:01.623234 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 584/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jul 4 05:45:01 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:45:01.628344 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb3bf1-cc10-44e0-93fd-fde44402fe2c None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:45:01.700453 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:45:01.742732 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb3bf1-cc10-44e0-93fd-fde44402fe2c None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:45:01.781369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f09602-431f-42eb-b46e-56bf009bec51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:45:01.782015 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f09602-431f-42eb-b46e-56bf009bec51 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:01.782294 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f09602-431f-42eb-b46e-56bf009bec51 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:01.782567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f09602-431f-42eb-b46e-56bf009bec51 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:01.783305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f09602-431f-42eb-b46e-56bf009bec51 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:45:01.783606 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f09602-431f-42eb-b46e-56bf009bec51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:45:01.784963 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f09602-431f-42eb-b46e-56bf009bec51 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:45:01.792738 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 582/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Mon Jul 4 05:45:01 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:45:03.813657 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b87a3-ebc9-4955-8146-a62bd9e8207c None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:03.814195 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b87a3-ebc9-4955-8146-a62bd9e8207c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:03.814195 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b87a3-ebc9-4955-8146-a62bd9e8207c None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:03.815626 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 585/1167] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:45:03.821955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddcd59-8aa1-4c74-a34a-4d8164528fbb None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:03.822678 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddcd59-8aa1-4c74-a34a-4d8164528fbb None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:03.822817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddcd59-8aa1-4c74-a34a-4d8164528fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:03.844120 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-70ddcd59-8aa1-4c74-a34a-4d8164528fbb None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:45:03.845314 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-70ddcd59-8aa1-4c74-a34a-4d8164528fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:45:03.916939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 583/1168] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:45:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:45:03.939685 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b87a3-ebc9-4955-8146-a62bd9e8207c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:45:03.965686 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:45:04.047050 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b87a3-ebc9-4955-8146-a62bd9e8207c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:45:04.085943 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74e646-e98b-4721-9c9f-942d27bb6980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:45:04.086520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74e646-e98b-4721-9c9f-942d27bb6980 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:04.086859 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74e646-e98b-4721-9c9f-942d27bb6980 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:04.087126 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74e646-e98b-4721-9c9f-942d27bb6980 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:04.087887 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74e646-e98b-4721-9c9f-942d27bb6980 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:45:04.089255 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74e646-e98b-4721-9c9f-942d27bb6980 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:45:04.108648 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 586/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Mon Jul 4 05:45:03 2022] POST /identity/v3/domains => generated 267 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:45:06.111702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f067459-1926-4e56-a993-69d30c1beed9 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:06.112577 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f067459-1926-4e56-a993-69d30c1beed9 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:06.112577 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f067459-1926-4e56-a993-69d30c1beed9 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:06.114886 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 584/1170] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:45:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:45:06.120621 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff64a40-e833-4be0-8e09-c4cde7102644 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:06.121045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff64a40-e833-4be0-8e09-c4cde7102644 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:06.121136 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff64a40-e833-4be0-8e09-c4cde7102644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:06.139596 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-2ff64a40-e833-4be0-8e09-c4cde7102644 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:45:06.140790 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2ff64a40-e833-4be0-8e09-c4cde7102644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:45:06.216173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 587/1171] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:45:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:45:06.249938 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f067459-1926-4e56-a993-69d30c1beed9 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:45:06.307901 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:45:06.356872 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f067459-1926-4e56-a993-69d30c1beed9 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:45:06.400409 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29c084-29b6-42e2-ac41-f4fe0d9cdbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:45:06.401215 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29c084-29b6-42e2-ac41-f4fe0d9cdbd4 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:06.401501 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29c084-29b6-42e2-ac41-f4fe0d9cdbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:06.401771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29c084-29b6-42e2-ac41-f4fe0d9cdbd4 None admin] PATH_INFO: `/v3/domains/584bdee697594a8ba235c75fcd0ae8ca` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:06.413654 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29c084-29b6-42e2-ac41-f4fe0d9cdbd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=584bdee697594a8ba235c75fcd0ae8ca)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:45:06.415110 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29c084-29b6-42e2-ac41-f4fe0d9cdbd4 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:45:06.417058 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 585/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Mon Jul 4 05:45:06 2022] GET /identity/v3/domains/584bdee697594a8ba235c75fcd0ae8ca => generated 267 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:45:06.426586 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff64a40-e833-4be0-8e09-c4cde7102644 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:45:06.447685 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:45:06.540003 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff64a40-e833-4be0-8e09-c4cde7102644 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:45:06.575083 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2a507-f28c-4916-a179-ff5ad8240778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:45:06.575764 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2a507-f28c-4916-a179-ff5ad8240778 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:06.576040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2a507-f28c-4916-a179-ff5ad8240778 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:06.576319 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2a507-f28c-4916-a179-ff5ad8240778 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:06.577020 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2a507-f28c-4916-a179-ff5ad8240778 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:45:06.578461 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2a507-f28c-4916-a179-ff5ad8240778 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:45:06.606322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 588/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 4 05:45:06 2022] POST /identity/v3/projects => generated 361 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:45:08.635282 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2168190-169f-418f-826b-0b2df49575be None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:08.636126 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2168190-169f-418f-826b-0b2df49575be None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:08.636126 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2168190-169f-418f-826b-0b2df49575be None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:08.638434 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 586/1174] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:45:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:45:08.643819 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e3d02-75ab-49a2-9308-6f3bbe3226db None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:08.644245 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e3d02-75ab-49a2-9308-6f3bbe3226db None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:08.644355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e3d02-75ab-49a2-9308-6f3bbe3226db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:08.662661 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-4c9e3d02-75ab-49a2-9308-6f3bbe3226db None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:45:08.663858 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4c9e3d02-75ab-49a2-9308-6f3bbe3226db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:45:08.733603 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:45:08.744865 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 589/1175] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:45:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:45:08.773356 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2168190-169f-418f-826b-0b2df49575be None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:45:08.898596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2168190-169f-418f-826b-0b2df49575be None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:45:08.912421 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:45:08.938554 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb07d8a-f047-48e1-bdf1-62d4c439b5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:45:08.939449 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb07d8a-f047-48e1-bdf1-62d4c439b5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:08.939723 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb07d8a-f047-48e1-bdf1-62d4c439b5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:08.939995 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb07d8a-f047-48e1-bdf1-62d4c439b5b0 None admin] PATH_INFO: `/v3/domains/584bdee697594a8ba235c75fcd0ae8ca` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:08.941245 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb07d8a-f047-48e1-bdf1-62d4c439b5b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=584bdee697594a8ba235c75fcd0ae8ca)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:45:08.942767 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb07d8a-f047-48e1-bdf1-62d4c439b5b0 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:45:08.944427 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 587/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Mon Jul 4 05:45:08 2022] GET /identity/v3/domains/584bdee697594a8ba235c75fcd0ae8ca => generated 267 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:45:08.950559 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e3d02-75ab-49a2-9308-6f3bbe3226db None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:45:09.050584 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e3d02-75ab-49a2-9308-6f3bbe3226db None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:45:09.084606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9a82d-69f1-453b-b126-e381e31287d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:45:09.085252 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9a82d-69f1-453b-b126-e381e31287d3 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:09.085531 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9a82d-69f1-453b-b126-e381e31287d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:09.085798 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9a82d-69f1-453b-b126-e381e31287d3 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:09.086488 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9a82d-69f1-453b-b126-e381e31287d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:45:09.087950 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9a82d-69f1-453b-b126-e381e31287d3 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:45:09.114335 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 590/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 4 05:45:08 2022] POST /identity/v3/users => generated 311 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:45:11.187545 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4133d-e0de-4cbe-abd8-799a546c414b None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:11.188143 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4133d-e0de-4cbe-abd8-799a546c414b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:11.188143 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4133d-e0de-4cbe-abd8-799a546c414b None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:11.189500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 588/1178] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:45:11.195917 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e10d0-d523-45f1-be17-39facbf7ae5c None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:11.196643 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e10d0-d523-45f1-be17-39facbf7ae5c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:11.196784 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e10d0-d523-45f1-be17-39facbf7ae5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:11.224710 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9b3e10d0-d523-45f1-be17-39facbf7ae5c None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:45:11.225922 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9b3e10d0-d523-45f1-be17-39facbf7ae5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:45:11.279206 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:45:11.304076 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 591/1179] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:45:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:45:11.327624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4133d-e0de-4cbe-abd8-799a546c414b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:45:11.437931 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4133d-e0de-4cbe-abd8-799a546c414b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:45:11.481263 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b49f8-1b58-4cb5-898d-e1f23007ea76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:45:11.482065 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b49f8-1b58-4cb5-898d-e1f23007ea76 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:11.482358 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b49f8-1b58-4cb5-898d-e1f23007ea76 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:11.482633 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b49f8-1b58-4cb5-898d-e1f23007ea76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:11.493101 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b49f8-1b58-4cb5-898d-e1f23007ea76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:45:11.501069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-169b49f8-1b58-4cb5-898d-e1f23007ea76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:45:11.501069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:45:11.501069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:45:11.501069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:45:11.501069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:45:11.501069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:45:11.501069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:45:11.501069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:45:11.501069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:45:11.501069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:45:11.501069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:45:11.501069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:45:11.501069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:45:11.501069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:45:11.501069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:45:11.501069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:45:11.502106 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:45:11.502106 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:45:11.502106 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:45:11.502106 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:45:11.502106 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:45:11.502106 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:45:11.502106 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:45:11.502106 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:45:11.502106 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:45:11.502106 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:45:11.502106 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:45:11.502106 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:45:11.502106 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:45:11.502106 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:45:11.502106 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:45:11.502106 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:45:11.503021 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:45:11.503021 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:45:11.503021 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:45:11.503021 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:45:11.503021 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:45:11.503021 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:45:11.503021 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:45:11.503021 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:45:11.503021 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:45:11.503021 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:45:11.503021 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:45:11.503021 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:45:11.503021 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 589/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:45:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:45:11.509078 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e10d0-d523-45f1-be17-39facbf7ae5c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:45:11.616115 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e10d0-d523-45f1-be17-39facbf7ae5c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:45:11.656023 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e999d-55f3-40fc-a778-bc6fc123944d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:45:11.656683 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e999d-55f3-40fc-a778-bc6fc123944d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:11.656962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e999d-55f3-40fc-a778-bc6fc123944d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:11.657223 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e999d-55f3-40fc-a778-bc6fc123944d None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:11.657953 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e999d-55f3-40fc-a778-bc6fc123944d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:45:11.658351 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e999d-55f3-40fc-a778-bc6fc123944d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:45:11.659762 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e999d-55f3-40fc-a778-bc6fc123944d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:45:11.671413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 592/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:45:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:45:11.677692 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b49f8-1b58-4cb5-898d-e1f23007ea76 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:45:11.735335 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:45:11.803037 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b49f8-1b58-4cb5-898d-e1f23007ea76 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:45:11.838420 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e9816-032f-42ab-88ba-db84b138e3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:45:11.839312 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e9816-032f-42ab-88ba-db84b138e3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:11.839593 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e9816-032f-42ab-88ba-db84b138e3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:11.839861 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e9816-032f-42ab-88ba-db84b138e3c2 None admin] PATH_INFO: `/v3/users/f27e3cb30619402aa2b346db7c8257a9` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:11.853058 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e9816-032f-42ab-88ba-db84b138e3c2 None admin] RBAC: Authorizing `identity:get_user(user_id=f27e3cb30619402aa2b346db7c8257a9)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:45:11.854626 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e9816-032f-42ab-88ba-db84b138e3c2 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:45:11.856995 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 590/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:45:11 2022] GET /identity/v3/users/f27e3cb30619402aa2b346db7c8257a9 => generated 311 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:45:11.865376 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e999d-55f3-40fc-a778-bc6fc123944d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:45:11.911653 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:45:11.969885 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e999d-55f3-40fc-a778-bc6fc123944d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:45:12.011379 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b9fc0-260e-4b6c-b08c-5802d92a617b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:45:12.011929 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b9fc0-260e-4b6c-b08c-5802d92a617b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:12.012207 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b9fc0-260e-4b6c-b08c-5802d92a617b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:12.012475 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b9fc0-260e-4b6c-b08c-5802d92a617b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:12.089830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b9fc0-260e-4b6c-b08c-5802d92a617b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:45:12.091290 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b9fc0-260e-4b6c-b08c-5802d92a617b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:45:12.132382 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:45:12.191969 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 593/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:45:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 05:45:12.198875 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e9816-032f-42ab-88ba-db84b138e3c2 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:45:12.305002 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:45:12.308782 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e9816-032f-42ab-88ba-db84b138e3c2 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:45:12.349448 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109fa54-4914-4690-aa0a-c9bf837297a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:45:12.350321 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109fa54-4914-4690-aa0a-c9bf837297a9 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:12.350605 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109fa54-4914-4690-aa0a-c9bf837297a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:12.350880 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109fa54-4914-4690-aa0a-c9bf837297a9 None admin] PATH_INFO: `/v3/projects/8ca5c32e2c534457a1d855ff2df92466` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:12.352177 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a109fa54-4914-4690-aa0a-c9bf837297a9 None admin] RBAC: Authorizing `identity:get_project(project_id=8ca5c32e2c534457a1d855ff2df92466)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:45:12.353623 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a109fa54-4914-4690-aa0a-c9bf837297a9 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:45:12.355393 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 591/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:45:12 2022] GET /identity/v3/projects/8ca5c32e2c534457a1d855ff2df92466 => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:45:12.365150 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b9fc0-260e-4b6c-b08c-5802d92a617b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:45:12.475100 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b9fc0-260e-4b6c-b08c-5802d92a617b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:45:12.511053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fdc3b-150b-4b5f-a68d-2bf4c453a808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:45:12.511722 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fdc3b-150b-4b5f-a68d-2bf4c453a808 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:12.512004 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fdc3b-150b-4b5f-a68d-2bf4c453a808 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:12.512277 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fdc3b-150b-4b5f-a68d-2bf4c453a808 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:12.513101 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445fdc3b-150b-4b5f-a68d-2bf4c453a808 None admin] RBAC: Adding query filter params (role.id=6c5b161dbf33447fa1d383915d3c9382, scope.project.id=8ca5c32e2c534457a1d855ff2df92466, user.id=f27e3cb30619402aa2b346db7c8257a9) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:45:12.513414 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445fdc3b-150b-4b5f-a68d-2bf4c453a808 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:45:12.514859 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445fdc3b-150b-4b5f-a68d-2bf4c453a808 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:45:12.520987 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 594/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:45:12 2022] GET /identity/v3/role_assignments?user.id=f27e3cb30619402aa2b346db7c8257a9&scope.project.id=8ca5c32e2c534457a1d855ff2df92466&role.id=6c5b161dbf33447fa1d383915d3c9382 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:45:14.512859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb835223-d32b-4047-8400-60f38aa9bcf7 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:14.513442 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb835223-d32b-4047-8400-60f38aa9bcf7 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:14.513442 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb835223-d32b-4047-8400-60f38aa9bcf7 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:14.514793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 592/1186] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:45:14.521202 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b0398-c7c4-4ef3-9d87-7ce950002b54 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:14.521930 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b0398-c7c4-4ef3-9d87-7ce950002b54 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:14.522097 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b0398-c7c4-4ef3-9d87-7ce950002b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:14.537530 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:45:14.547164 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-0f4b0398-c7c4-4ef3-9d87-7ce950002b54 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:45:14.549163 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0f4b0398-c7c4-4ef3-9d87-7ce950002b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:45:14.633681 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 595/1187] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:45:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:45:14.661052 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb835223-d32b-4047-8400-60f38aa9bcf7 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:45:14.771129 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb835223-d32b-4047-8400-60f38aa9bcf7 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:45:14.809171 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a24804-be87-45d1-8e54-20e5f8897b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:45:14.809955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a24804-be87-45d1-8e54-20e5f8897b9c None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:14.810236 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a24804-be87-45d1-8e54-20e5f8897b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:14.810512 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a24804-be87-45d1-8e54-20e5f8897b9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:14.821129 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a24804-be87-45d1-8e54-20e5f8897b9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:45:14.828821 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-41a24804-be87-45d1-8e54-20e5f8897b9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:45:14.828821 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:45:14.828821 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:45:14.828821 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:45:14.828821 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:45:14.828821 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:45:14.828821 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:45:14.828821 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:45:14.828821 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:45:14.828821 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:45:14.828821 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:45:14.828821 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:45:14.828821 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:45:14.828821 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:45:14.828821 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:45:14.828821 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:45:14.829916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:45:14.829916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:45:14.829916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:45:14.829916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:45:14.829916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:45:14.829916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:45:14.829916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:45:14.829916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:45:14.829916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:45:14.829916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:45:14.829916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:45:14.829916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:45:14.829916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:45:14.829916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:45:14.829916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:45:14.829916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:45:14.831139 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:45:14.831139 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:45:14.831139 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:45:14.831139 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:45:14.831139 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:45:14.831139 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:45:14.831139 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:45:14.831139 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:45:14.831139 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:45:14.831139 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:45:14.831139 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:45:14.831139 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:45:14.831139 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 593/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:45:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:45:14.838535 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b0398-c7c4-4ef3-9d87-7ce950002b54 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:45:14.945621 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b0398-c7c4-4ef3-9d87-7ce950002b54 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:45:14.980726 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7a83b-4fe6-4288-9d95-1db84160a90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:45:14.981378 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7a83b-4fe6-4288-9d95-1db84160a90e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:14.981666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7a83b-4fe6-4288-9d95-1db84160a90e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:14.981928 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7a83b-4fe6-4288-9d95-1db84160a90e None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:14.982674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7a83b-4fe6-4288-9d95-1db84160a90e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:45:14.982982 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7a83b-4fe6-4288-9d95-1db84160a90e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:45:14.984405 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7a83b-4fe6-4288-9d95-1db84160a90e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:45:14.986758 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:45:14.994712 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 596/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:45:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:45:15.001251 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a24804-be87-45d1-8e54-20e5f8897b9c None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:45:15.032035 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:45:15.107597 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a24804-be87-45d1-8e54-20e5f8897b9c None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:45:15.145376 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6facf1d0-bc27-4f8c-ad00-ea8d1b981474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:45:15.146243 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facf1d0-bc27-4f8c-ad00-ea8d1b981474 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:15.146524 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facf1d0-bc27-4f8c-ad00-ea8d1b981474 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:15.146797 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facf1d0-bc27-4f8c-ad00-ea8d1b981474 None admin] PATH_INFO: `/v3/users/f27e3cb30619402aa2b346db7c8257a9` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:15.148057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6facf1d0-bc27-4f8c-ad00-ea8d1b981474 None admin] RBAC: Authorizing `identity:get_user(user_id=f27e3cb30619402aa2b346db7c8257a9)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:45:15.149506 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6facf1d0-bc27-4f8c-ad00-ea8d1b981474 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:45:15.151144 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 594/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:45:14 2022] GET /identity/v3/users/f27e3cb30619402aa2b346db7c8257a9 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:45:15.159976 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7a83b-4fe6-4288-9d95-1db84160a90e None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:45:15.269511 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7a83b-4fe6-4288-9d95-1db84160a90e None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:45:15.304295 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a248a-bb7e-4caf-936f-346f14b81440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:45:15.305121 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a248a-bb7e-4caf-936f-346f14b81440 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:15.305398 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a248a-bb7e-4caf-936f-346f14b81440 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:15.305671 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a248a-bb7e-4caf-936f-346f14b81440 None admin] PATH_INFO: `/v3/projects/8ca5c32e2c534457a1d855ff2df92466` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:15.306966 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a248a-bb7e-4caf-936f-346f14b81440 None admin] RBAC: Authorizing `identity:get_project(project_id=8ca5c32e2c534457a1d855ff2df92466)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:45:15.308466 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a248a-bb7e-4caf-936f-346f14b81440 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:45:15.310164 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 597/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:45:15 2022] GET /identity/v3/projects/8ca5c32e2c534457a1d855ff2df92466 => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:45:15.319170 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6facf1d0-bc27-4f8c-ad00-ea8d1b981474 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:45:15.416302 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:45:15.423353 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6facf1d0-bc27-4f8c-ad00-ea8d1b981474 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:45:15.458905 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4deef9-1243-4c57-9648-7b10ef5796f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:45:15.459814 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4deef9-1243-4c57-9648-7b10ef5796f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:15.460099 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4deef9-1243-4c57-9648-7b10ef5796f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:15.460372 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4deef9-1243-4c57-9648-7b10ef5796f1 None admin] PATH_INFO: `/v3/projects/8ca5c32e2c534457a1d855ff2df92466/users/f27e3cb30619402aa2b346db7c8257a9/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:15.462418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4deef9-1243-4c57-9648-7b10ef5796f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ca5c32e2c534457a1d855ff2df92466, user_id=f27e3cb30619402aa2b346db7c8257a9, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:45:15.463887 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4deef9-1243-4c57-9648-7b10ef5796f1 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:45:15.479202 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 595/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 4 05:45:15 2022] PUT /identity/v3/projects/8ca5c32e2c534457a1d855ff2df92466/users/f27e3cb30619402aa2b346db7c8257a9/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:45:17.473108 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a72a11-4ffb-449a-a746-811d35722dd4 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:17.473697 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a72a11-4ffb-449a-a746-811d35722dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:17.473697 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a72a11-4ffb-449a-a746-811d35722dd4 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:17.475072 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 598/1193] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:45:17.481432 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5431b-991a-45fb-810a-e05f7be96442 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:17.482150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5431b-991a-45fb-810a-e05f7be96442 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:17.482312 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5431b-991a-45fb-810a-e05f7be96442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:17.503977 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-54e5431b-991a-45fb-810a-e05f7be96442 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:45:17.505142 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-54e5431b-991a-45fb-810a-e05f7be96442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:45:17.578951 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 596/1194] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:45:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:45:17.602651 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a72a11-4ffb-449a-a746-811d35722dd4 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:45:17.674908 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:45:17.725013 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a72a11-4ffb-449a-a746-811d35722dd4 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:45:17.761245 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af229b08-d218-431a-bddc-4c02c819e951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:45:17.762028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af229b08-d218-431a-bddc-4c02c819e951 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:17.762305 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af229b08-d218-431a-bddc-4c02c819e951 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:17.762577 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af229b08-d218-431a-bddc-4c02c819e951 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:17.773307 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af229b08-d218-431a-bddc-4c02c819e951 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:45:17.780899 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-af229b08-d218-431a-bddc-4c02c819e951 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:45:17.780899 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:45:17.780899 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:45:17.780899 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:45:17.780899 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:45:17.780899 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:45:17.780899 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:45:17.780899 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:45:17.780899 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:45:17.780899 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:45:17.780899 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:45:17.780899 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:45:17.780899 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:45:17.780899 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:45:17.780899 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:45:17.780899 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:45:17.781970 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:45:17.781970 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:45:17.781970 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:45:17.781970 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:45:17.781970 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:45:17.781970 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:45:17.781970 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:45:17.781970 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:45:17.781970 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:45:17.781970 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:45:17.781970 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:45:17.781970 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:45:17.781970 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:45:17.781970 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:45:17.781970 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:45:17.781970 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:45:17.782856 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:45:17.782856 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:45:17.782856 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:45:17.782856 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:45:17.782856 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:45:17.782856 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:45:17.782856 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:45:17.782856 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:45:17.782856 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:45:17.782856 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:45:17.782856 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:45:17.782856 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:45:17.782856 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 599/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:45:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:45:17.789096 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5431b-991a-45fb-810a-e05f7be96442 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:45:17.875402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:45:17.894037 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5431b-991a-45fb-810a-e05f7be96442 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:45:17.930897 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a435b4-3d63-4e23-97a8-d58d236bb7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:45:17.931591 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a435b4-3d63-4e23-97a8-d58d236bb7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:17.931874 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a435b4-3d63-4e23-97a8-d58d236bb7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:17.932148 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a435b4-3d63-4e23-97a8-d58d236bb7f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:17.932901 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a435b4-3d63-4e23-97a8-d58d236bb7f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:45:17.933209 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a435b4-3d63-4e23-97a8-d58d236bb7f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:45:17.934599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a435b4-3d63-4e23-97a8-d58d236bb7f4 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:45:17.943240 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 597/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:45:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:45:17.952383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af229b08-d218-431a-bddc-4c02c819e951 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:45:18.059026 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af229b08-d218-431a-bddc-4c02c819e951 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:45:18.087405 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:45:18.104979 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2502322-7ce4-4810-b490-94d01ce96e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:45:18.106933 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2502322-7ce4-4810-b490-94d01ce96e9d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:18.107465 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2502322-7ce4-4810-b490-94d01ce96e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:18.107820 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2502322-7ce4-4810-b490-94d01ce96e9d None admin] PATH_INFO: `/v3/users/f27e3cb30619402aa2b346db7c8257a9` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:18.109838 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2502322-7ce4-4810-b490-94d01ce96e9d None admin] RBAC: Authorizing `identity:get_user(user_id=f27e3cb30619402aa2b346db7c8257a9)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:45:18.112227 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2502322-7ce4-4810-b490-94d01ce96e9d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:45:18.114687 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 600/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Mon Jul 4 05:45:17 2022] GET /identity/v3/users/f27e3cb30619402aa2b346db7c8257a9 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:45:18.121890 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a435b4-3d63-4e23-97a8-d58d236bb7f4 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:45:18.254181 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a435b4-3d63-4e23-97a8-d58d236bb7f4 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:45:18.292640 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4bfb9-8542-4dd6-a809-c27687b55e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:45:18.293278 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4bfb9-8542-4dd6-a809-c27687b55e4d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:18.293561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4bfb9-8542-4dd6-a809-c27687b55e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:18.293836 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4bfb9-8542-4dd6-a809-c27687b55e4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:18.310754 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:45:18.370146 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4bfb9-8542-4dd6-a809-c27687b55e4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:45:18.371632 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4bfb9-8542-4dd6-a809-c27687b55e4d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:45:18.471441 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 598/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:45:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 05:45:18.480921 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2502322-7ce4-4810-b490-94d01ce96e9d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:45:18.611309 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2502322-7ce4-4810-b490-94d01ce96e9d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:45:18.646777 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da389b2a-038f-4731-a092-ba6341d5baf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:45:18.647678 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da389b2a-038f-4731-a092-ba6341d5baf9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:18.647964 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da389b2a-038f-4731-a092-ba6341d5baf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:18.648241 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da389b2a-038f-4731-a092-ba6341d5baf9 None admin] PATH_INFO: `/v3/projects/8ca5c32e2c534457a1d855ff2df92466` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:18.649516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da389b2a-038f-4731-a092-ba6341d5baf9 None admin] RBAC: Authorizing `identity:get_project(project_id=8ca5c32e2c534457a1d855ff2df92466)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:45:18.650978 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da389b2a-038f-4731-a092-ba6341d5baf9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:45:18.652803 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 601/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Mon Jul 4 05:45:18 2022] GET /identity/v3/projects/8ca5c32e2c534457a1d855ff2df92466 => generated 361 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:45:18.662771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4bfb9-8542-4dd6-a809-c27687b55e4d None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:45:18.719656 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:45:18.778526 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4bfb9-8542-4dd6-a809-c27687b55e4d None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:45:18.814407 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b875e-5819-4995-8f3c-81687a4f71ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:45:18.815051 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b875e-5819-4995-8f3c-81687a4f71ab None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:45:18.815365 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b875e-5819-4995-8f3c-81687a4f71ab None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:45:18.815651 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b875e-5819-4995-8f3c-81687a4f71ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:45:18.816481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b875e-5819-4995-8f3c-81687a4f71ab None admin] RBAC: Adding query filter params (role.id=6c5b161dbf33447fa1d383915d3c9382, scope.project.id=8ca5c32e2c534457a1d855ff2df92466, user.id=f27e3cb30619402aa2b346db7c8257a9) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:45:18.816791 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b875e-5819-4995-8f3c-81687a4f71ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:45:18.818229 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b875e-5819-4995-8f3c-81687a4f71ab None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:45:18.824263 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 599/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:45:18 2022] GET /identity/v3/role_assignments?user.id=f27e3cb30619402aa2b346db7c8257a9&scope.project.id=8ca5c32e2c534457a1d855ff2df92466&role.id=6c5b161dbf33447fa1d383915d3c9382 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:45:28.641557 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=69 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:45:28.821529 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=45 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:14.035721 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bede9f-bf05-45db-bd15-5c0dceb3657a None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:14.036330 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bede9f-bf05-45db-bd15-5c0dceb3657a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:14.036436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bede9f-bf05-45db-bd15-5c0dceb3657a None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:14.037979 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 602/1201] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:46:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:46:14.044294 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b69c9a-148b-40e5-860e-f23ce3e346d2 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:14.044872 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b69c9a-148b-40e5-860e-f23ce3e346d2 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:14.044872 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b69c9a-148b-40e5-860e-f23ce3e346d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:14.067650 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-47b69c9a-148b-40e5-860e-f23ce3e346d2 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:46:14.069071 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-47b69c9a-148b-40e5-860e-f23ce3e346d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:46:14.149241 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 600/1202] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:46:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:46:14.176966 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bede9f-bf05-45db-bd15-5c0dceb3657a None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:14.305674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bede9f-bf05-45db-bd15-5c0dceb3657a None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:14.352317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd28199-6376-4036-abd9-f628d7059902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:14.353185 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd28199-6376-4036-abd9-f628d7059902 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:14.353463 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd28199-6376-4036-abd9-f628d7059902 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:14.353713 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd28199-6376-4036-abd9-f628d7059902 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:14.367371 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd28199-6376-4036-abd9-f628d7059902 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:14.368872 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd28199-6376-4036-abd9-f628d7059902 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:14.388967 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-3bd28199-6376-4036-abd9-f628d7059902 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:46:14.388967 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:14.388967 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:46:14.388967 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:46:14.388967 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:46:14.388967 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:46:14.388967 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:46:14.388967 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:46:14.388967 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:46:14.388967 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:46:14.388967 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:46:14.388967 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:46:14.388967 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:46:14.388967 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:46:14.388967 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:46:14.389972 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:46:14.389972 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:46:14.389972 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:46:14.389972 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:46:14.389972 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:46:14.389972 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:46:14.389972 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:46:14.389972 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:46:14.389972 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:46:14.389972 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:46:14.389972 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:46:14.389972 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:46:14.389972 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:46:14.389972 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:46:14.389972 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:46:14.389972 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:46:14.389972 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:46:14.391095 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:46:14.391095 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:46:14.391095 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:46:14.391095 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:46:14.391095 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 603/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:46:14.398481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b69c9a-148b-40e5-860e-f23ce3e346d2 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:14.514568 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b69c9a-148b-40e5-860e-f23ce3e346d2 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:14.550829 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:14.557994 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9f966-62e4-4478-85fd-445dc046a065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:14.559258 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9f966-62e4-4478-85fd-445dc046a065 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:14.559559 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9f966-62e4-4478-85fd-445dc046a065 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:14.559969 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9f966-62e4-4478-85fd-445dc046a065 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:14.560842 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9f966-62e4-4478-85fd-445dc046a065 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:14.561401 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9f966-62e4-4478-85fd-445dc046a065 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:14.563965 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9f966-62e4-4478-85fd-445dc046a065 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:14.581677 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 601/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:46:14.590452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd28199-6376-4036-abd9-f628d7059902 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:14.663017 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:14.726957 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd28199-6376-4036-abd9-f628d7059902 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:14.772747 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f981c-3d1d-4a2c-988d-053e578a9416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:14.773722 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f981c-3d1d-4a2c-988d-053e578a9416 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:14.774166 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f981c-3d1d-4a2c-988d-053e578a9416 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:14.774559 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f981c-3d1d-4a2c-988d-053e578a9416 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:14.775429 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f981c-3d1d-4a2c-988d-053e578a9416 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:14.777179 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f981c-3d1d-4a2c-988d-053e578a9416 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:14.807541 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 604/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Mon Jul 4 05:46:14 2022] POST /identity/v3/users => generated 251 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 05:46:16.992819 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872bd953-06ae-4926-8cfd-0e454582f4d5 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:16.993371 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872bd953-06ae-4926-8cfd-0e454582f4d5 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:16.993481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872bd953-06ae-4926-8cfd-0e454582f4d5 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:17.000149 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 602/1206] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:46:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:46:17.006152 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463f9cc-7635-4a99-9540-2cf338bead63 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:17.006652 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463f9cc-7635-4a99-9540-2cf338bead63 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:17.006756 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463f9cc-7635-4a99-9540-2cf338bead63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:17.025517 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-5463f9cc-7635-4a99-9540-2cf338bead63 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:46:17.026773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5463f9cc-7635-4a99-9540-2cf338bead63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:46:17.123229 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 605/1207] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:46:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:46:17.142706 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872bd953-06ae-4926-8cfd-0e454582f4d5 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:17.299244 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872bd953-06ae-4926-8cfd-0e454582f4d5 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:17.345099 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73696180-98aa-4df0-b918-4fa11da85e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:17.346186 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73696180-98aa-4df0-b918-4fa11da85e53 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:17.346516 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73696180-98aa-4df0-b918-4fa11da85e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:17.346897 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73696180-98aa-4df0-b918-4fa11da85e53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:17.358563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73696180-98aa-4df0-b918-4fa11da85e53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:46:17.370704 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-73696180-98aa-4df0-b918-4fa11da85e53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:46:17.370704 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:17.370704 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:46:17.370704 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:46:17.370704 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:46:17.370704 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:46:17.370704 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:46:17.370704 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:46:17.370704 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:46:17.370704 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:46:17.370704 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:46:17.370704 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:46:17.370704 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:46:17.370704 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:46:17.370704 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:46:17.370704 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:46:17.371735 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:46:17.371735 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:46:17.371735 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:46:17.371735 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:46:17.371735 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:46:17.371735 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:46:17.371735 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:46:17.371735 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:46:17.371735 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:46:17.371735 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:46:17.371735 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:46:17.371735 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:46:17.371735 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:46:17.371735 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:46:17.371735 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:46:17.371735 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:46:17.372580 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:46:17.372580 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:46:17.372580 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:46:17.372580 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:46:17.372580 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:46:17.372580 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:46:17.372580 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:46:17.372580 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:46:17.372580 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:46:17.372580 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:46:17.372580 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:46:17.372580 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:46:17.372580 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 603/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 4 05:46:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:46:17.375209 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463f9cc-7635-4a99-9540-2cf338bead63 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:17.418255 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:17.492998 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463f9cc-7635-4a99-9540-2cf338bead63 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:17.539211 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a0cf5-aecd-4f87-8ced-2fbb72532bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:17.539211 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a0cf5-aecd-4f87-8ced-2fbb72532bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:17.539211 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a0cf5-aecd-4f87-8ced-2fbb72532bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:17.539211 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a0cf5-aecd-4f87-8ced-2fbb72532bd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:17.540336 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a0cf5-aecd-4f87-8ced-2fbb72532bd1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:17.540336 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a0cf5-aecd-4f87-8ced-2fbb72532bd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:17.541774 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a0cf5-aecd-4f87-8ced-2fbb72532bd1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:17.555277 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 606/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 4 05:46:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:46:17.558864 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73696180-98aa-4df0-b918-4fa11da85e53 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:17.616153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:17.677896 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73696180-98aa-4df0-b918-4fa11da85e53 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:17.718631 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f30812-bc69-49c4-b308-7d871a0e43d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:17.719655 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f30812-bc69-49c4-b308-7d871a0e43d1 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:17.719943 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f30812-bc69-49c4-b308-7d871a0e43d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:17.720219 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f30812-bc69-49c4-b308-7d871a0e43d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:17.731147 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f30812-bc69-49c4-b308-7d871a0e43d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:17.735479 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f30812-bc69-49c4-b308-7d871a0e43d1 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:17.753202 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-16f30812-bc69-49c4-b308-7d871a0e43d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:46:17.753202 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:17.753202 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:46:17.753202 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:46:17.753202 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:46:17.753202 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:46:17.753202 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:46:17.753202 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:46:17.753202 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:46:17.753202 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:46:17.753202 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:46:17.753202 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:46:17.753202 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:46:17.753202 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:46:17.753202 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:46:17.754183 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:46:17.754183 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:46:17.754183 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:46:17.754183 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:46:17.754183 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:46:17.754183 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:46:17.754183 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:46:17.754183 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:46:17.754183 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:46:17.754183 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:46:17.754183 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:46:17.754183 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:46:17.754183 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:46:17.754183 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:46:17.754183 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:46:17.754183 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:46:17.754183 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:46:17.755091 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:46:17.755091 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:46:17.755091 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:46:17.755091 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:46:17.755091 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 604/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:46:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:46:17.760708 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a0cf5-aecd-4f87-8ced-2fbb72532bd1 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:17.864349 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:17.869991 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a0cf5-aecd-4f87-8ced-2fbb72532bd1 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:17.908685 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292008d-6e09-4166-8d02-0c75ee72633d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:17.909408 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292008d-6e09-4166-8d02-0c75ee72633d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:17.909773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292008d-6e09-4166-8d02-0c75ee72633d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:17.910120 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292008d-6e09-4166-8d02-0c75ee72633d None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:17.910820 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292008d-6e09-4166-8d02-0c75ee72633d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:17.911147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292008d-6e09-4166-8d02-0c75ee72633d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:17.912730 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292008d-6e09-4166-8d02-0c75ee72633d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:17.926058 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 607/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:46:17.932166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f30812-bc69-49c4-b308-7d871a0e43d1 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:18.042931 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f30812-bc69-49c4-b308-7d871a0e43d1 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:18.044624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:18.080691 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4bdfe0-52fd-45ff-ba85-b5aa4c8d9361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:18.081940 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bdfe0-52fd-45ff-ba85-b5aa4c8d9361 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:18.082212 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bdfe0-52fd-45ff-ba85-b5aa4c8d9361 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:18.082466 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bdfe0-52fd-45ff-ba85-b5aa4c8d9361 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:18.090323 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4bdfe0-52fd-45ff-ba85-b5aa4c8d9361 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:18.091830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4bdfe0-52fd-45ff-ba85-b5aa4c8d9361 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:18.107224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-6d4bdfe0-52fd-45ff-ba85-b5aa4c8d9361 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 04 05:46:18.107224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:18.107224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:46:18.107224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:46:18.107224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:46:18.107224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:46:18.107224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:46:18.107224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:46:18.107224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:46:18.107224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:46:18.107224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:46:18.107224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:46:18.107224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:46:18.107224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:46:18.107224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:46:18.107224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:46:18.114282 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:46:18.114282 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:46:18.114282 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:46:18.114282 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:46:18.114282 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:46:18.114282 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:46:18.114282 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:46:18.114282 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:46:18.114282 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:46:18.114282 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:46:18.114282 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:46:18.114282 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:46:18.114282 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:46:18.114282 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:46:18.114282 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:46:18.114282 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:46:18.114282 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:46:18.114282 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:46:18.115314 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:46:18.115314 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:46:18.115314 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:46:18.115314 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:46:18.115314 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:46:18.115314 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:46:18.115314 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:46:18.115314 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:46:18.115314 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 04 05:46:18.115314 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:46:18.115314 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 605/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:46:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:46:18.116277 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292008d-6e09-4166-8d02-0c75ee72633d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:18.223577 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292008d-6e09-4166-8d02-0c75ee72633d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:18.267238 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751297aa-f88b-47f4-821d-e4598d6d7533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:18.267975 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751297aa-f88b-47f4-821d-e4598d6d7533 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:18.268332 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751297aa-f88b-47f4-821d-e4598d6d7533 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:18.268550 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751297aa-f88b-47f4-821d-e4598d6d7533 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:18.269383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751297aa-f88b-47f4-821d-e4598d6d7533 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:18.269728 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751297aa-f88b-47f4-821d-e4598d6d7533 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:18.271156 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751297aa-f88b-47f4-821d-e4598d6d7533 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:18.294275 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 608/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Jul 4 05:46:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:46:18.300366 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4bdfe0-52fd-45ff-ba85-b5aa4c8d9361 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:18.423313 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4bdfe0-52fd-45ff-ba85-b5aa4c8d9361 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:18.468396 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27f844-dc90-4e4f-8a6d-8ceae2619666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:18.469067 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27f844-dc90-4e4f-8a6d-8ceae2619666 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:18.469351 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27f844-dc90-4e4f-8a6d-8ceae2619666 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:18.469686 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27f844-dc90-4e4f-8a6d-8ceae2619666 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:18.509984 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:18.564233 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27f844-dc90-4e4f-8a6d-8ceae2619666 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:18.566208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27f844-dc90-4e4f-8a6d-8ceae2619666 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:18.684412 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 606/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:46:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 04 05:46:18.689455 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751297aa-f88b-47f4-821d-e4598d6d7533 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:18.716946 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:18.822807 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751297aa-f88b-47f4-821d-e4598d6d7533 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:18.864476 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578f735-17bc-4bf0-9a43-a9816ea41a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:18.867071 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578f735-17bc-4bf0-9a43-a9816ea41a36 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:18.867071 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578f735-17bc-4bf0-9a43-a9816ea41a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:18.867071 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578f735-17bc-4bf0-9a43-a9816ea41a36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:18.877262 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578f735-17bc-4bf0-9a43-a9816ea41a36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:18.878841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578f735-17bc-4bf0-9a43-a9816ea41a36 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:18.897042 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-3578f735-17bc-4bf0-9a43-a9816ea41a36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:46:18.897042 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:18.897042 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:46:18.897042 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:46:18.897042 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:46:18.897042 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:46:18.897042 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:46:18.897042 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:46:18.897042 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:46:18.897042 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:46:18.897042 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:46:18.897042 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:46:18.897042 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:46:18.897042 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:46:18.897042 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:46:18.898085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:46:18.898085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:46:18.898085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:46:18.898085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:46:18.898085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:46:18.898085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:46:18.898085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:46:18.898085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:46:18.898085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:46:18.898085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:46:18.898085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:46:18.898085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:46:18.898085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:46:18.898085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:46:18.898085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:46:18.898085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:46:18.898085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:46:18.899159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:46:18.899159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:46:18.899159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:46:18.899159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:46:18.899159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 609/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:46:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:46:18.904238 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27f844-dc90-4e4f-8a6d-8ceae2619666 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:18.974335 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:19.016145 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27f844-dc90-4e4f-8a6d-8ceae2619666 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:19.058949 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89360565-c251-4a94-bdd2-2aed9c18a2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:19.059770 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89360565-c251-4a94-bdd2-2aed9c18a2a2 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:19.060056 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89360565-c251-4a94-bdd2-2aed9c18a2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:19.060333 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89360565-c251-4a94-bdd2-2aed9c18a2a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:19.061052 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89360565-c251-4a94-bdd2-2aed9c18a2a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:19.061362 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89360565-c251-4a94-bdd2-2aed9c18a2a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:19.062975 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89360565-c251-4a94-bdd2-2aed9c18a2a2 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:19.081328 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 607/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:46:19.082583 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578f735-17bc-4bf0-9a43-a9816ea41a36 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:19.159049 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:19.199703 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578f735-17bc-4bf0-9a43-a9816ea41a36 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:19.236386 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a74219-020d-474e-8d2c-8286c30e1f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:19.237109 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a74219-020d-474e-8d2c-8286c30e1f21 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:19.237385 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a74219-020d-474e-8d2c-8286c30e1f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:19.237666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a74219-020d-474e-8d2c-8286c30e1f21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:19.245699 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a74219-020d-474e-8d2c-8286c30e1f21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:19.247356 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a74219-020d-474e-8d2c-8286c30e1f21 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:19.262035 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-b1a74219-020d-474e-8d2c-8286c30e1f21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:46:19.262035 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:19.262035 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:46:19.262035 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:46:19.262035 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:46:19.262035 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:46:19.262035 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:46:19.262035 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:46:19.262035 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:46:19.262035 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:46:19.262035 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:46:19.262035 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:46:19.262035 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:46:19.262035 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:46:19.262035 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:46:19.269644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:46:19.269644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:46:19.269644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:46:19.269644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:46:19.269644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:46:19.269644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:46:19.269644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:46:19.269644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:46:19.269644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:46:19.269644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:46:19.269644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:46:19.269644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:46:19.269644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:46:19.269644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:46:19.269644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:46:19.269644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:46:19.269644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:46:19.270560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:46:19.270560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:46:19.270560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:46:19.270560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:46:19.270560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:46:19.270560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:46:19.270560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:46:19.270560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:46:19.270560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 610/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:46:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:46:19.271091 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89360565-c251-4a94-bdd2-2aed9c18a2a2 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:19.387462 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89360565-c251-4a94-bdd2-2aed9c18a2a2 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:19.414791 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:19.428355 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1db6ff-ed0d-4cd4-8696-2138bfcc1259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:19.429022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1db6ff-ed0d-4cd4-8696-2138bfcc1259 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:19.429308 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1db6ff-ed0d-4cd4-8696-2138bfcc1259 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:19.429572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1db6ff-ed0d-4cd4-8696-2138bfcc1259 None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:19.430359 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1db6ff-ed0d-4cd4-8696-2138bfcc1259 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:19.430672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1db6ff-ed0d-4cd4-8696-2138bfcc1259 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:19.432155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1db6ff-ed0d-4cd4-8696-2138bfcc1259 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:19.446008 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 608/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:46:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:46:19.452080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a74219-020d-474e-8d2c-8286c30e1f21 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:19.563252 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a74219-020d-474e-8d2c-8286c30e1f21 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:19.596391 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:19.604193 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc4e8f-f7d7-45cc-a700-e10556706c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:19.604875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc4e8f-f7d7-45cc-a700-e10556706c5a None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:19.605157 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc4e8f-f7d7-45cc-a700-e10556706c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:19.605431 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc4e8f-f7d7-45cc-a700-e10556706c5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:19.606277 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc4e8f-f7d7-45cc-a700-e10556706c5a None admin] RBAC: Adding query filter params (role.id=d775f350758d4eb8bfceeeb91e54351f, scope.project.id=4bc610fb6724419dac99f2483089c783, user.id=260f58535f4e46a197d00276d37fd515) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:19.606592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc4e8f-f7d7-45cc-a700-e10556706c5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:19.608093 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc4e8f-f7d7-45cc-a700-e10556706c5a None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:19.614575 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 611/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:46:19 2022] GET /identity/v3/role_assignments?user.id=260f58535f4e46a197d00276d37fd515&scope.project.id=4bc610fb6724419dac99f2483089c783&role.id=d775f350758d4eb8bfceeeb91e54351f => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:46:21.619085 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12104c7-3612-4cab-a912-04626d0e9023 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:21.619916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12104c7-3612-4cab-a912-04626d0e9023 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:21.619916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12104c7-3612-4cab-a912-04626d0e9023 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:21.621229 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 609/1220] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:46:21.626864 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e2448-9883-4306-9531-660b04877592 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:21.627374 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e2448-9883-4306-9531-660b04877592 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:21.627498 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e2448-9883-4306-9531-660b04877592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:21.644839 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-2a0e2448-9883-4306-9531-660b04877592 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:46:21.646045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2a0e2448-9883-4306-9531-660b04877592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:46:21.717369 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 612/1221] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:46:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:46:21.741810 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12104c7-3612-4cab-a912-04626d0e9023 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:21.853030 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12104c7-3612-4cab-a912-04626d0e9023 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:21.890870 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9abdbd-4110-497a-b7e8-dc452f9eeb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:21.891763 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9abdbd-4110-497a-b7e8-dc452f9eeb99 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:21.892042 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9abdbd-4110-497a-b7e8-dc452f9eeb99 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:21.892315 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9abdbd-4110-497a-b7e8-dc452f9eeb99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:21.902716 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9abdbd-4110-497a-b7e8-dc452f9eeb99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:46:21.910630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-7b9abdbd-4110-497a-b7e8-dc452f9eeb99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:46:21.910630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:21.910630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:46:21.910630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:46:21.910630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:46:21.910630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:46:21.910630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:46:21.910630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:46:21.910630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:46:21.910630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:46:21.910630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:46:21.910630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:46:21.910630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:46:21.910630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:46:21.910630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:46:21.910630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:46:21.911732 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:46:21.911732 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:46:21.911732 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:46:21.911732 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:46:21.911732 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:46:21.911732 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:46:21.911732 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:46:21.911732 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:46:21.911732 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:46:21.911732 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:46:21.911732 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:46:21.911732 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:46:21.911732 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:46:21.911732 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:46:21.911732 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:46:21.911732 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:46:21.912793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:46:21.912793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:46:21.912793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:46:21.912793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:46:21.912793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:46:21.912793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:46:21.912793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:46:21.912793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:46:21.912793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:46:21.912793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:46:21.912793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:46:21.912793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:46:21.912793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 610/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 4 05:46:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:46:21.919261 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e2448-9883-4306-9531-660b04877592 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:22.024300 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e2448-9883-4306-9531-660b04877592 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:22.052477 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:22.065149 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836b60b-c953-401e-a5c7-c5fbd93d9f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:22.065853 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836b60b-c953-401e-a5c7-c5fbd93d9f84 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:22.066195 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836b60b-c953-401e-a5c7-c5fbd93d9f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:22.066494 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836b60b-c953-401e-a5c7-c5fbd93d9f84 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:22.067272 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836b60b-c953-401e-a5c7-c5fbd93d9f84 None admin] RBAC: Adding query filter params (name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:22.067580 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836b60b-c953-401e-a5c7-c5fbd93d9f84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:22.068972 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836b60b-c953-401e-a5c7-c5fbd93d9f84 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:22.077411 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 613/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 4 05:46:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:46:22.084685 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9abdbd-4110-497a-b7e8-dc452f9eeb99 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:22.136147 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:22.205556 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9abdbd-4110-497a-b7e8-dc452f9eeb99 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:22.245823 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c6e5d-292a-41c0-a9a5-4959d1779648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:22.246702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c6e5d-292a-41c0-a9a5-4959d1779648 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:22.246975 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c6e5d-292a-41c0-a9a5-4959d1779648 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:22.247282 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c6e5d-292a-41c0-a9a5-4959d1779648 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:22.258945 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c6e5d-292a-41c0-a9a5-4959d1779648 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:22.260613 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c6e5d-292a-41c0-a9a5-4959d1779648 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:22.283235 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-864c6e5d-292a-41c0-a9a5-4959d1779648 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:46:22.283235 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:22.283235 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:46:22.283235 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:46:22.283235 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:46:22.283235 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:46:22.283235 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:46:22.283235 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:46:22.283235 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:46:22.283235 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:46:22.283235 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:46:22.283235 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:46:22.283235 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:46:22.283235 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:46:22.283235 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:46:22.284557 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:46:22.284557 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:46:22.284557 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:46:22.284557 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:46:22.284557 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:46:22.284557 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:46:22.284557 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:46:22.284557 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:46:22.284557 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:46:22.284557 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:46:22.284557 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:46:22.284557 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:46:22.284557 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:46:22.284557 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:46:22.284557 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:46:22.284557 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:46:22.284557 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:46:22.285777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:46:22.285777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:46:22.285777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:46:22.285777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:46:22.285777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 611/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:46:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:46:22.291227 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836b60b-c953-401e-a5c7-c5fbd93d9f84 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:22.426235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836b60b-c953-401e-a5c7-c5fbd93d9f84 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:22.462959 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad52059-a056-4af6-b5e4-1f7e79b8141b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:22.463862 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad52059-a056-4af6-b5e4-1f7e79b8141b None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:22.464180 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad52059-a056-4af6-b5e4-1f7e79b8141b None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:22.464457 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad52059-a056-4af6-b5e4-1f7e79b8141b None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:22.465257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad52059-a056-4af6-b5e4-1f7e79b8141b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:22.465655 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad52059-a056-4af6-b5e4-1f7e79b8141b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:22.467489 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad52059-a056-4af6-b5e4-1f7e79b8141b None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:22.481999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 614/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:46:22.488113 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c6e5d-292a-41c0-a9a5-4959d1779648 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:22.596810 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:22.606244 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c6e5d-292a-41c0-a9a5-4959d1779648 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:22.644187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f68c4-3b34-4032-9a10-80a272f296bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:22.645005 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f68c4-3b34-4032-9a10-80a272f296bf None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:22.645290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f68c4-3b34-4032-9a10-80a272f296bf None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:22.645563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f68c4-3b34-4032-9a10-80a272f296bf None admin] PATH_INFO: `/v3/users/placement` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:22.653709 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f68c4-3b34-4032-9a10-80a272f296bf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:22.655267 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f68c4-3b34-4032-9a10-80a272f296bf None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:22.670160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-4c1f68c4-3b34-4032-9a10-80a272f296bf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 04 05:46:22.670160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:22.670160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:46:22.670160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:46:22.670160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:46:22.670160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:46:22.670160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:46:22.670160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:46:22.670160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:46:22.670160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:46:22.670160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:46:22.670160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:46:22.670160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:46:22.670160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:46:22.670160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:46:22.670160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:46:22.671155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:46:22.671155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:46:22.671155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:46:22.671155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:46:22.671155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:46:22.671155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:46:22.671155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:46:22.671155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:46:22.671155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:46:22.671155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:46:22.671155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:46:22.671155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:46:22.671155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:46:22.671155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:46:22.671155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:46:22.671155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:46:22.671155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:46:22.671155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:46:22.672250 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:46:22.672250 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:46:22.672250 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:46:22.672250 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:46:22.672250 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:46:22.672250 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:46:22.672250 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:46:22.672250 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:46:22.672250 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 04 05:46:22.672250 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:46:22.672250 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 612/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:46:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:46:22.678095 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad52059-a056-4af6-b5e4-1f7e79b8141b None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:22.729569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:22.784651 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad52059-a056-4af6-b5e4-1f7e79b8141b None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:22.817996 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793919a4-88d3-48ca-9af2-569aac203aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:22.818700 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793919a4-88d3-48ca-9af2-569aac203aca None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:22.818985 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793919a4-88d3-48ca-9af2-569aac203aca None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:22.819291 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793919a4-88d3-48ca-9af2-569aac203aca None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:22.820125 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793919a4-88d3-48ca-9af2-569aac203aca None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:22.820437 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793919a4-88d3-48ca-9af2-569aac203aca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:22.822028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793919a4-88d3-48ca-9af2-569aac203aca None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:22.839904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 615/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Jul 4 05:46:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:46:22.845793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f68c4-3b34-4032-9a10-80a272f296bf None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:22.951850 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f68c4-3b34-4032-9a10-80a272f296bf None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:22.987107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ccd0a-b8ed-4f8d-b073-0de50b10fd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:22.987966 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ccd0a-b8ed-4f8d-b073-0de50b10fd94 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:22.988253 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ccd0a-b8ed-4f8d-b073-0de50b10fd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:22.988532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ccd0a-b8ed-4f8d-b073-0de50b10fd94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:22.999507 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ccd0a-b8ed-4f8d-b073-0de50b10fd94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:23.001026 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ccd0a-b8ed-4f8d-b073-0de50b10fd94 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:23.021909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-9a7ccd0a-b8ed-4f8d-b073-0de50b10fd94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:46:23.021909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:23.021909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:46:23.021909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:46:23.021909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:46:23.021909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:46:23.021909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:46:23.021909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:46:23.021909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:46:23.021909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:46:23.021909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:46:23.021909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:46:23.021909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:46:23.021909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:46:23.021909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:46:23.023165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:46:23.023165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:46:23.023165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:46:23.023165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:46:23.023165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:46:23.023165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:46:23.023165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:46:23.023165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:46:23.023165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:46:23.023165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:46:23.023165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:46:23.023165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:46:23.023165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:46:23.023165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:46:23.023165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:46:23.023165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:46:23.023165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:46:23.024082 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:46:23.024082 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:46:23.024082 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:46:23.024082 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:46:23.024082 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 613/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:46:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:46:23.028981 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793919a4-88d3-48ca-9af2-569aac203aca None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:23.133190 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793919a4-88d3-48ca-9af2-569aac203aca None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:23.135525 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:23.167944 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eff098-6491-4ad5-88bd-7d8344e36476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:23.168606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eff098-6491-4ad5-88bd-7d8344e36476 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:23.168888 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eff098-6491-4ad5-88bd-7d8344e36476 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:23.169164 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eff098-6491-4ad5-88bd-7d8344e36476 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:23.169878 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eff098-6491-4ad5-88bd-7d8344e36476 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:23.170198 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eff098-6491-4ad5-88bd-7d8344e36476 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:23.171624 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eff098-6491-4ad5-88bd-7d8344e36476 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:23.182966 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 616/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:46:23.189294 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ccd0a-b8ed-4f8d-b073-0de50b10fd94 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:23.201498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:23.302456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ccd0a-b8ed-4f8d-b073-0de50b10fd94 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:23.341797 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8815cdc-0ccf-4cca-90b5-552ad9fd1be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:23.342670 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8815cdc-0ccf-4cca-90b5-552ad9fd1be2 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:23.343040 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8815cdc-0ccf-4cca-90b5-552ad9fd1be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:23.343397 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8815cdc-0ccf-4cca-90b5-552ad9fd1be2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:23.351639 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8815cdc-0ccf-4cca-90b5-552ad9fd1be2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:23.353126 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8815cdc-0ccf-4cca-90b5-552ad9fd1be2 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:23.368791 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-c8815cdc-0ccf-4cca-90b5-552ad9fd1be2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:46:23.368791 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:23.368791 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:46:23.368791 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:46:23.368791 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:46:23.368791 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:46:23.368791 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:46:23.368791 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:46:23.368791 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:46:23.368791 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:46:23.368791 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:46:23.368791 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:46:23.368791 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:46:23.368791 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:46:23.368791 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:46:23.369871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:46:23.369871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:46:23.369871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:46:23.369871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:46:23.369871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:46:23.369871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:46:23.369871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:46:23.369871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:46:23.369871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:46:23.369871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:46:23.369871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:46:23.369871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:46:23.369871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:46:23.369871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:46:23.369871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:46:23.369871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:46:23.369871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:46:23.370872 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:46:23.370872 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:46:23.370872 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:46:23.370872 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:46:23.370872 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:46:23.370872 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:46:23.370872 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:46:23.370872 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:46:23.370872 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 614/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:46:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:46:23.376117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eff098-6491-4ad5-88bd-7d8344e36476 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:23.481862 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eff098-6491-4ad5-88bd-7d8344e36476 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:23.516577 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e25467-a6dd-4f11-a7c4-380474c7ac2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:23.517283 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e25467-a6dd-4f11-a7c4-380474c7ac2e None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:23.517571 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e25467-a6dd-4f11-a7c4-380474c7ac2e None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:23.517845 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e25467-a6dd-4f11-a7c4-380474c7ac2e None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:23.518657 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e25467-a6dd-4f11-a7c4-380474c7ac2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:23.519001 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e25467-a6dd-4f11-a7c4-380474c7ac2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:23.520512 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e25467-a6dd-4f11-a7c4-380474c7ac2e None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:23.535811 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 617/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:46:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:46:23.539685 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8815cdc-0ccf-4cca-90b5-552ad9fd1be2 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:23.609240 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:23.646264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8815cdc-0ccf-4cca-90b5-552ad9fd1be2 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:23.686077 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d0ae3-cab3-4060-8178-5936deb288b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:23.687111 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d0ae3-cab3-4060-8178-5936deb288b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:23.687441 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d0ae3-cab3-4060-8178-5936deb288b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:23.687756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d0ae3-cab3-4060-8178-5936deb288b0 None admin] PATH_INFO: `/v3/projects/4bc610fb6724419dac99f2483089c783/users/260f58535f4e46a197d00276d37fd515/roles/d775f350758d4eb8bfceeeb91e54351f` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:23.703614 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d0ae3-cab3-4060-8178-5936deb288b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=4bc610fb6724419dac99f2483089c783, user_id=260f58535f4e46a197d00276d37fd515, role_id=d775f350758d4eb8bfceeeb91e54351f)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:23.705179 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d0ae3-cab3-4060-8178-5936deb288b0 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:23.718491 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 615/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 4 05:46:23 2022] PUT /identity/v3/projects/4bc610fb6724419dac99f2483089c783/users/260f58535f4e46a197d00276d37fd515/roles/d775f350758d4eb8bfceeeb91e54351f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:46:26.019686 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefc0bd-0cce-4fcb-bff5-7bb862c2c24c None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:26.020298 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefc0bd-0cce-4fcb-bff5-7bb862c2c24c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:26.020298 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefc0bd-0cce-4fcb-bff5-7bb862c2c24c None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:26.021949 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 618/1233] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:46:26.028308 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595873e1-7870-407b-84f2-a6d9d15d5083 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:26.028807 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595873e1-7870-407b-84f2-a6d9d15d5083 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:26.028903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595873e1-7870-407b-84f2-a6d9d15d5083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:26.047144 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-595873e1-7870-407b-84f2-a6d9d15d5083 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:46:26.048629 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-595873e1-7870-407b-84f2-a6d9d15d5083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:46:26.125091 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 616/1234] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:46:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:46:26.154879 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefc0bd-0cce-4fcb-bff5-7bb862c2c24c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:26.182924 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:26.265048 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefc0bd-0cce-4fcb-bff5-7bb862c2c24c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:26.305452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88142ac3-c23e-48fd-859f-d830d81a6036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:26.306335 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88142ac3-c23e-48fd-859f-d830d81a6036 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:26.306734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88142ac3-c23e-48fd-859f-d830d81a6036 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:26.307045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88142ac3-c23e-48fd-859f-d830d81a6036 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:26.320756 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88142ac3-c23e-48fd-859f-d830d81a6036 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:46:26.329992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-88142ac3-c23e-48fd-859f-d830d81a6036 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:46:26.329992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:26.329992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:46:26.329992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:46:26.329992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:46:26.329992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:46:26.329992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:46:26.329992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:46:26.329992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:46:26.329992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:46:26.329992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:46:26.329992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:46:26.329992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:46:26.329992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:46:26.329992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:46:26.329992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:46:26.331095 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:46:26.331095 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:46:26.331095 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:46:26.331095 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:46:26.331095 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:46:26.331095 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:46:26.331095 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:46:26.331095 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:46:26.331095 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:46:26.331095 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:46:26.331095 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:46:26.331095 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:46:26.331095 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:46:26.331095 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:46:26.331095 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:46:26.331095 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:46:26.332052 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:46:26.332052 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:46:26.332052 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:46:26.332052 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:46:26.332052 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:46:26.332052 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:46:26.332052 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:46:26.332052 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:46:26.332052 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:46:26.332052 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:46:26.332052 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 05:46:26.332052 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:46:26.332052 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 619/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Mon Jul 4 05:46:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:46:26.337788 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595873e1-7870-407b-84f2-a6d9d15d5083 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:26.387478 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:26.447769 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595873e1-7870-407b-84f2-a6d9d15d5083 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:26.485722 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9a6cb-5e6f-4b74-9769-11e91937b3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:26.486460 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9a6cb-5e6f-4b74-9769-11e91937b3ef None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:26.486767 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9a6cb-5e6f-4b74-9769-11e91937b3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:26.487068 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9a6cb-5e6f-4b74-9769-11e91937b3ef None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:26.487946 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9a6cb-5e6f-4b74-9769-11e91937b3ef None admin] RBAC: Adding query filter params (name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:26.488257 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9a6cb-5e6f-4b74-9769-11e91937b3ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:26.489704 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9a6cb-5e6f-4b74-9769-11e91937b3ef None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:26.499042 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 617/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Mon Jul 4 05:46:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:46:26.504942 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88142ac3-c23e-48fd-859f-d830d81a6036 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:26.600029 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:26.616176 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88142ac3-c23e-48fd-859f-d830d81a6036 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:26.653169 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f0734-0256-4c70-88eb-147b923ed81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:26.653955 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f0734-0256-4c70-88eb-147b923ed81c None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:26.654231 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f0734-0256-4c70-88eb-147b923ed81c None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:26.654482 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f0734-0256-4c70-88eb-147b923ed81c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:26.665684 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f0734-0256-4c70-88eb-147b923ed81c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:26.667522 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f0734-0256-4c70-88eb-147b923ed81c None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:26.685126 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-1b9f0734-0256-4c70-88eb-147b923ed81c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:46:26.685126 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:26.685126 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:46:26.685126 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:46:26.685126 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:46:26.685126 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:46:26.685126 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:46:26.685126 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:46:26.685126 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:46:26.685126 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:46:26.685126 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:46:26.685126 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:46:26.685126 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:46:26.685126 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:46:26.685126 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:46:26.686212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:46:26.686212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:46:26.686212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:46:26.686212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:46:26.686212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:46:26.686212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:46:26.686212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:46:26.686212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:46:26.686212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:46:26.686212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:46:26.686212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:46:26.686212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:46:26.686212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:46:26.686212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:46:26.686212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:46:26.686212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:46:26.686212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:46:26.687144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:46:26.687144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:46:26.687144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:46:26.687144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:46:26.687144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 620/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:46:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:46:26.692462 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9a6cb-5e6f-4b74-9769-11e91937b3ef None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:26.804338 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9a6cb-5e6f-4b74-9769-11e91937b3ef None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:26.813202 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:26.843906 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b383e1d-0cb7-43f8-a6fa-3836ade87852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:26.844846 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b383e1d-0cb7-43f8-a6fa-3836ade87852 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:26.845204 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b383e1d-0cb7-43f8-a6fa-3836ade87852 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:26.845572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b383e1d-0cb7-43f8-a6fa-3836ade87852 None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:26.846577 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b383e1d-0cb7-43f8-a6fa-3836ade87852 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:26.846994 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b383e1d-0cb7-43f8-a6fa-3836ade87852 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:26.849013 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b383e1d-0cb7-43f8-a6fa-3836ade87852 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:26.863586 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 618/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:46:26.869657 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f0734-0256-4c70-88eb-147b923ed81c None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:26.986977 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f0734-0256-4c70-88eb-147b923ed81c None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:27.021881 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f468f-cc95-45a1-9af8-1d07eb0a8eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:27.022689 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f468f-cc95-45a1-9af8-1d07eb0a8eda None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:27.022973 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f468f-cc95-45a1-9af8-1d07eb0a8eda None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:27.023276 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f468f-cc95-45a1-9af8-1d07eb0a8eda None admin] PATH_INFO: `/v3/users/placement` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:27.026058 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:27.032737 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f468f-cc95-45a1-9af8-1d07eb0a8eda None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:27.034427 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f468f-cc95-45a1-9af8-1d07eb0a8eda None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:27.052612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-f45f468f-cc95-45a1-9af8-1d07eb0a8eda None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 04 05:46:27.052612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:27.052612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:46:27.052612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:46:27.052612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:46:27.052612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:46:27.052612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:46:27.052612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:46:27.052612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:46:27.052612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:46:27.052612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:46:27.052612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:46:27.052612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:46:27.052612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:46:27.052612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:46:27.052612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:46:27.054155 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:46:27.054155 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:46:27.054155 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:46:27.054155 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:46:27.054155 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:46:27.054155 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:46:27.054155 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:46:27.054155 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:46:27.054155 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:46:27.054155 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:46:27.054155 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:46:27.054155 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:46:27.054155 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:46:27.054155 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:46:27.054155 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:46:27.054155 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:46:27.054155 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:46:27.054155 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:46:27.055105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:46:27.055105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:46:27.055105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:46:27.055105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:46:27.055105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:46:27.055105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:46:27.055105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:46:27.055105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:46:27.055105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 04 05:46:27.055105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:46:27.055105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 621/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:46:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:46:27.060258 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b383e1d-0cb7-43f8-a6fa-3836ade87852 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:27.174214 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b383e1d-0cb7-43f8-a6fa-3836ade87852 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:27.211972 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6934d6-8518-4bc1-aa0c-c74b1b880d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:27.212654 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6934d6-8518-4bc1-aa0c-c74b1b880d44 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:27.212940 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6934d6-8518-4bc1-aa0c-c74b1b880d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:27.213216 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6934d6-8518-4bc1-aa0c-c74b1b880d44 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:27.214056 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6934d6-8518-4bc1-aa0c-c74b1b880d44 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:27.214367 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6934d6-8518-4bc1-aa0c-c74b1b880d44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:27.215852 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6934d6-8518-4bc1-aa0c-c74b1b880d44 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:27.235664 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 619/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Jul 4 05:46:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:46:27.245761 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f468f-cc95-45a1-9af8-1d07eb0a8eda None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:27.352447 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f468f-cc95-45a1-9af8-1d07eb0a8eda None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:27.391928 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c15d5-5d26-4bef-9c31-4fbe9edefaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:27.393383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c15d5-5d26-4bef-9c31-4fbe9edefaeb None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:27.393383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c15d5-5d26-4bef-9c31-4fbe9edefaeb None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:27.393572 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c15d5-5d26-4bef-9c31-4fbe9edefaeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:27.465738 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:27.473167 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c15d5-5d26-4bef-9c31-4fbe9edefaeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:27.474640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c15d5-5d26-4bef-9c31-4fbe9edefaeb None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:27.575932 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 622/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:46:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 05:46:27.582101 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6934d6-8518-4bc1-aa0c-c74b1b880d44 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:27.620704 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:27.707920 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6934d6-8518-4bc1-aa0c-c74b1b880d44 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:27.745636 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc587c54-c51f-4e91-91c9-0925989d601a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:27.746339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc587c54-c51f-4e91-91c9-0925989d601a None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:27.746625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc587c54-c51f-4e91-91c9-0925989d601a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:27.746903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc587c54-c51f-4e91-91c9-0925989d601a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:27.757584 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc587c54-c51f-4e91-91c9-0925989d601a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:27.759033 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc587c54-c51f-4e91-91c9-0925989d601a None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:27.777053 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-fc587c54-c51f-4e91-91c9-0925989d601a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:46:27.777053 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:27.777053 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:46:27.777053 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:46:27.777053 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:46:27.777053 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:46:27.777053 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:46:27.777053 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:46:27.777053 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:46:27.777053 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:46:27.777053 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:46:27.777053 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:46:27.777053 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:46:27.777053 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:46:27.777053 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:46:27.778138 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:46:27.778138 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:46:27.778138 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:46:27.778138 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:46:27.778138 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:46:27.778138 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:46:27.778138 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:46:27.778138 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:46:27.778138 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:46:27.778138 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:46:27.778138 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:46:27.778138 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:46:27.778138 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:46:27.778138 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:46:27.778138 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:46:27.778138 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:46:27.778138 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:46:27.779073 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:46:27.779073 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:46:27.779073 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:46:27.779073 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:46:27.779073 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 620/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:46:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:46:27.785119 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c15d5-5d26-4bef-9c31-4fbe9edefaeb None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:27.896035 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:27.902714 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c15d5-5d26-4bef-9c31-4fbe9edefaeb None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:27.938417 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d352537-98a3-4a58-9e00-21b1c8d7b6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:27.939097 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d352537-98a3-4a58-9e00-21b1c8d7b6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:27.939389 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d352537-98a3-4a58-9e00-21b1c8d7b6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:27.939651 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d352537-98a3-4a58-9e00-21b1c8d7b6a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:27.940384 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d352537-98a3-4a58-9e00-21b1c8d7b6a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:27.940689 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d352537-98a3-4a58-9e00-21b1c8d7b6a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:27.942188 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d352537-98a3-4a58-9e00-21b1c8d7b6a7 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:27.953680 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 623/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:46:27.959977 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc587c54-c51f-4e91-91c9-0925989d601a None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:28.054869 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:28.077239 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc587c54-c51f-4e91-91c9-0925989d601a None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:28.112337 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2a2f4-f009-4d7e-af6e-9f1663763cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:28.113163 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2a2f4-f009-4d7e-af6e-9f1663763cae None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:28.113447 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2a2f4-f009-4d7e-af6e-9f1663763cae None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:28.113729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2a2f4-f009-4d7e-af6e-9f1663763cae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:28.121502 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2a2f4-f009-4d7e-af6e-9f1663763cae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:28.123010 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2a2f4-f009-4d7e-af6e-9f1663763cae None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:28.137264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-a8b2a2f4-f009-4d7e-af6e-9f1663763cae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:46:28.137264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:28.137264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:46:28.137264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:46:28.137264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:46:28.137264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:46:28.137264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:46:28.137264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:46:28.137264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:46:28.137264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:46:28.137264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:46:28.137264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:46:28.137264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:46:28.137264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:46:28.137264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:46:28.138302 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:46:28.138302 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:46:28.138302 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:46:28.138302 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:46:28.138302 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:46:28.138302 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:46:28.138302 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:46:28.138302 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:46:28.138302 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:46:28.138302 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:46:28.138302 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:46:28.138302 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:46:28.138302 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:46:28.138302 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:46:28.138302 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:46:28.138302 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:46:28.138302 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:46:28.139204 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:46:28.139204 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:46:28.139204 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:46:28.139204 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:46:28.139204 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:46:28.139204 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:46:28.139204 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:46:28.139204 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:46:28.139204 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 621/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:46:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:46:28.144637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d352537-98a3-4a58-9e00-21b1c8d7b6a7 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:28.253642 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d352537-98a3-4a58-9e00-21b1c8d7b6a7 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:28.294061 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cb9c5-4a9a-46e3-a738-00989a0557c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:28.294754 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cb9c5-4a9a-46e3-a738-00989a0557c1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:28.295016 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cb9c5-4a9a-46e3-a738-00989a0557c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:28.295306 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cb9c5-4a9a-46e3-a738-00989a0557c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:28.296088 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72cb9c5-4a9a-46e3-a738-00989a0557c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:28.296429 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72cb9c5-4a9a-46e3-a738-00989a0557c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:28.297859 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72cb9c5-4a9a-46e3-a738-00989a0557c1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:28.311746 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 624/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:46:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:46:28.318821 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2a2f4-f009-4d7e-af6e-9f1663763cae None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:28.432585 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2a2f4-f009-4d7e-af6e-9f1663763cae None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:28.473898 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9980d2-d04d-48fc-bc66-ecf9f9af396d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:28.474572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9980d2-d04d-48fc-bc66-ecf9f9af396d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:28.474852 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9980d2-d04d-48fc-bc66-ecf9f9af396d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:28.475210 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9980d2-d04d-48fc-bc66-ecf9f9af396d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:28.476051 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9980d2-d04d-48fc-bc66-ecf9f9af396d None admin] RBAC: Adding query filter params (role.id=d775f350758d4eb8bfceeeb91e54351f, scope.project.id=4bc610fb6724419dac99f2483089c783, user.id=260f58535f4e46a197d00276d37fd515) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:28.476361 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9980d2-d04d-48fc-bc66-ecf9f9af396d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:28.477821 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9980d2-d04d-48fc-bc66-ecf9f9af396d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:28.484525 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 622/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:46:28 2022] GET /identity/v3/role_assignments?user.id=260f58535f4e46a197d00276d37fd515&scope.project.id=4bc610fb6724419dac99f2483089c783&role.id=d775f350758d4eb8bfceeeb91e54351f => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:46:30.853382 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2334a9-bb34-46b3-8ff8-09c1855604b6 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:30.853963 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2334a9-bb34-46b3-8ff8-09c1855604b6 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:30.854261 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2334a9-bb34-46b3-8ff8-09c1855604b6 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:30.855737 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 625/1247] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:46:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:46:30.862650 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dbf5d-ec3b-4d1c-af39-29ffea344ee5 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:30.863065 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dbf5d-ec3b-4d1c-af39-29ffea344ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:30.863266 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dbf5d-ec3b-4d1c-af39-29ffea344ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:30.868947 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:30.882901 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-f83dbf5d-ec3b-4d1c-af39-29ffea344ee5 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:46:30.884374 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f83dbf5d-ec3b-4d1c-af39-29ffea344ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:46:30.964007 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 623/1248] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:46:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:46:30.987616 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2334a9-bb34-46b3-8ff8-09c1855604b6 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:31.008007 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:31.100085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2334a9-bb34-46b3-8ff8-09c1855604b6 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:31.136718 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15535a-c0f0-499d-8d60-c504517cc2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:31.137424 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15535a-c0f0-499d-8d60-c504517cc2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:31.137703 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15535a-c0f0-499d-8d60-c504517cc2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:31.137974 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15535a-c0f0-499d-8d60-c504517cc2f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:31.150507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee15535a-c0f0-499d-8d60-c504517cc2f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:46:31.160123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-ee15535a-c0f0-499d-8d60-c504517cc2f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:46:31.160123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:31.160123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:46:31.160123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:46:31.160123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:46:31.160123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:46:31.160123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:46:31.160123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:46:31.160123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:46:31.160123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:46:31.160123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:46:31.160123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:46:31.160123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:46:31.160123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:46:31.160123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:46:31.160123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:46:31.161298 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:46:31.161298 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:46:31.161298 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:46:31.161298 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:46:31.161298 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:46:31.161298 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:46:31.161298 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:46:31.161298 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:46:31.161298 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:46:31.161298 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:46:31.161298 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:46:31.161298 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:46:31.161298 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:46:31.161298 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:46:31.161298 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:46:31.161298 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:46:31.162426 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:46:31.162426 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:46:31.162426 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:46:31.162426 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:46:31.162426 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:46:31.162426 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:46:31.162426 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:46:31.162426 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:46:31.162426 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:46:31.162426 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:46:31.162426 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:46:31.162426 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:46:31.162426 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 626/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:46:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:46:31.168042 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dbf5d-ec3b-4d1c-af39-29ffea344ee5 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:31.272683 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dbf5d-ec3b-4d1c-af39-29ffea344ee5 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:31.308198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:31.313991 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084d49a-1f2d-49af-8fd4-92eff7ea3d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:31.314988 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084d49a-1f2d-49af-8fd4-92eff7ea3d49 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:31.315303 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084d49a-1f2d-49af-8fd4-92eff7ea3d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:31.315701 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084d49a-1f2d-49af-8fd4-92eff7ea3d49 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:31.316808 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084d49a-1f2d-49af-8fd4-92eff7ea3d49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:31.317237 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084d49a-1f2d-49af-8fd4-92eff7ea3d49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:31.319288 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084d49a-1f2d-49af-8fd4-92eff7ea3d49 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:31.330151 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 624/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:46:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:46:31.337172 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15535a-c0f0-499d-8d60-c504517cc2f2 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:31.425387 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:31.451410 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15535a-c0f0-499d-8d60-c504517cc2f2 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:31.490700 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b32a57-6aae-4240-a3a8-75c0ebcb6426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:31.491530 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b32a57-6aae-4240-a3a8-75c0ebcb6426 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:31.491805 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b32a57-6aae-4240-a3a8-75c0ebcb6426 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:31.492190 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b32a57-6aae-4240-a3a8-75c0ebcb6426 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:31.505728 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b32a57-6aae-4240-a3a8-75c0ebcb6426 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:31.507861 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b32a57-6aae-4240-a3a8-75c0ebcb6426 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:31.526272 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-18b32a57-6aae-4240-a3a8-75c0ebcb6426 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:46:31.526272 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:31.526272 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:46:31.526272 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:46:31.526272 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:46:31.526272 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:46:31.526272 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:46:31.526272 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:46:31.526272 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:46:31.526272 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:46:31.526272 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:46:31.526272 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:46:31.526272 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:46:31.526272 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:46:31.526272 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:46:31.527370 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:46:31.527370 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:46:31.527370 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:46:31.527370 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:46:31.527370 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:46:31.527370 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:46:31.527370 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:46:31.527370 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:46:31.527370 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:46:31.527370 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:46:31.527370 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:46:31.527370 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:46:31.527370 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:46:31.527370 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:46:31.527370 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:46:31.527370 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:46:31.527370 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:46:31.528276 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:46:31.528276 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:46:31.528276 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:46:31.528276 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:46:31.528276 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 627/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:46:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 05:46:31.534455 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084d49a-1f2d-49af-8fd4-92eff7ea3d49 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:31.645327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084d49a-1f2d-49af-8fd4-92eff7ea3d49 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:31.679626 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e136cd4-bac9-47cf-b05d-6088650a43ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:31.680323 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e136cd4-bac9-47cf-b05d-6088650a43ae None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:31.680490 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e136cd4-bac9-47cf-b05d-6088650a43ae None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:31.680776 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e136cd4-bac9-47cf-b05d-6088650a43ae None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:31.681544 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e136cd4-bac9-47cf-b05d-6088650a43ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:31.681851 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e136cd4-bac9-47cf-b05d-6088650a43ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:31.683430 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e136cd4-bac9-47cf-b05d-6088650a43ae None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:31.695598 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 625/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:46:31.703412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b32a57-6aae-4240-a3a8-75c0ebcb6426 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:31.811988 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b32a57-6aae-4240-a3a8-75c0ebcb6426 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:31.840138 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:31.848690 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60037005-9548-42e5-9b97-c8de23e10c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:31.849494 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60037005-9548-42e5-9b97-c8de23e10c25 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:31.849737 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60037005-9548-42e5-9b97-c8de23e10c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:31.850009 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60037005-9548-42e5-9b97-c8de23e10c25 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:31.859286 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60037005-9548-42e5-9b97-c8de23e10c25 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:31.860811 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60037005-9548-42e5-9b97-c8de23e10c25 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:31.875672 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-60037005-9548-42e5-9b97-c8de23e10c25 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 04 05:46:31.875672 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:31.875672 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:46:31.875672 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:46:31.875672 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:46:31.875672 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:46:31.875672 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:46:31.875672 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:46:31.875672 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:46:31.875672 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:46:31.875672 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:46:31.875672 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:46:31.875672 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:46:31.875672 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:46:31.875672 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:46:31.875672 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:46:31.876887 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:46:31.876887 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:46:31.876887 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:46:31.876887 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:46:31.876887 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:46:31.876887 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:46:31.876887 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:46:31.876887 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:46:31.876887 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:46:31.876887 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:46:31.876887 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:46:31.876887 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:46:31.876887 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:46:31.876887 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:46:31.876887 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:46:31.876887 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:46:31.876887 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:46:31.876887 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:46:31.884390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:46:31.884390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:46:31.884390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:46:31.884390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:46:31.884390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:46:31.884390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:46:31.884390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:46:31.884390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:46:31.884390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 04 05:46:31.884390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:46:31.884390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 628/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:46:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:46:31.887694 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e136cd4-bac9-47cf-b05d-6088650a43ae None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:31.948877 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:31.997952 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e136cd4-bac9-47cf-b05d-6088650a43ae None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:32.037153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3915c-07c1-4f15-8295-67d76267a0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:32.038071 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3915c-07c1-4f15-8295-67d76267a0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:32.038456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3915c-07c1-4f15-8295-67d76267a0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:32.038857 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3915c-07c1-4f15-8295-67d76267a0b0 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:32.040033 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3915c-07c1-4f15-8295-67d76267a0b0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:32.040466 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3915c-07c1-4f15-8295-67d76267a0b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:32.042415 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3915c-07c1-4f15-8295-67d76267a0b0 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:32.066926 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 626/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Jul 4 05:46:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:46:32.072201 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60037005-9548-42e5-9b97-c8de23e10c25 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:32.183018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60037005-9548-42e5-9b97-c8de23e10c25 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:32.220364 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725bf11d-161a-45ba-abf9-cd543b91d1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:32.220836 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bf11d-161a-45ba-abf9-cd543b91d1f9 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:32.221117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bf11d-161a-45ba-abf9-cd543b91d1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:32.221390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bf11d-161a-45ba-abf9-cd543b91d1f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:32.291278 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:32.308270 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725bf11d-161a-45ba-abf9-cd543b91d1f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:32.310170 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725bf11d-161a-45ba-abf9-cd543b91d1f9 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:32.430576 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 629/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:46:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 05:46:32.436329 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3915c-07c1-4f15-8295-67d76267a0b0 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:32.546490 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3915c-07c1-4f15-8295-67d76267a0b0 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:32.561284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:32.587512 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae022a-673a-4e54-9ddd-fb87cf7ad220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:32.588400 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae022a-673a-4e54-9ddd-fb87cf7ad220 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:32.588735 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae022a-673a-4e54-9ddd-fb87cf7ad220 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:32.589039 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae022a-673a-4e54-9ddd-fb87cf7ad220 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:32.600990 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae022a-673a-4e54-9ddd-fb87cf7ad220 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:32.602497 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae022a-673a-4e54-9ddd-fb87cf7ad220 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:32.622614 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-f0ae022a-673a-4e54-9ddd-fb87cf7ad220 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:46:32.622614 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:32.622614 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:46:32.622614 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:46:32.622614 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:46:32.622614 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:46:32.622614 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:46:32.622614 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:46:32.622614 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:46:32.622614 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:46:32.622614 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:46:32.622614 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:46:32.622614 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:46:32.622614 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:46:32.622614 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:46:32.623680 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:46:32.623680 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:46:32.623680 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:46:32.623680 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:46:32.623680 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:46:32.623680 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:46:32.623680 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:46:32.623680 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:46:32.623680 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:46:32.623680 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:46:32.623680 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:46:32.623680 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:46:32.623680 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:46:32.623680 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:46:32.623680 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:46:32.623680 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:46:32.623680 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:46:32.629543 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:46:32.629543 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:46:32.629543 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:46:32.629543 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:46:32.629543 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 627/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:46:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:46:32.629987 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725bf11d-161a-45ba-abf9-cd543b91d1f9 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:32.726680 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:32.739370 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725bf11d-161a-45ba-abf9-cd543b91d1f9 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:32.777516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b78a1-70be-4033-ac33-0b4cfad1389f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:32.778182 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b78a1-70be-4033-ac33-0b4cfad1389f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:32.778503 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b78a1-70be-4033-ac33-0b4cfad1389f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:32.778750 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b78a1-70be-4033-ac33-0b4cfad1389f None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:32.779651 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b78a1-70be-4033-ac33-0b4cfad1389f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:32.780106 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b78a1-70be-4033-ac33-0b4cfad1389f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:32.782530 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b78a1-70be-4033-ac33-0b4cfad1389f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:32.794568 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 630/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:46:32.802294 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae022a-673a-4e54-9ddd-fb87cf7ad220 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:32.918983 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae022a-673a-4e54-9ddd-fb87cf7ad220 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:32.957162 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24215730-7954-4eb9-b2b7-3a6ac9b6554d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:32.958094 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24215730-7954-4eb9-b2b7-3a6ac9b6554d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:32.958377 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24215730-7954-4eb9-b2b7-3a6ac9b6554d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:32.958689 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24215730-7954-4eb9-b2b7-3a6ac9b6554d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:32.966228 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24215730-7954-4eb9-b2b7-3a6ac9b6554d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:32.967967 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24215730-7954-4eb9-b2b7-3a6ac9b6554d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:32.982830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-24215730-7954-4eb9-b2b7-3a6ac9b6554d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:46:32.982830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:32.982830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:46:32.982830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:46:32.982830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:46:32.982830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:46:32.982830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:46:32.982830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:46:32.982830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:46:32.982830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:46:32.982830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:46:32.982830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:46:32.982830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:46:32.982830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:46:32.982830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:46:32.984012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:46:32.984012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:46:32.984012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:46:32.984012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:46:32.984012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:46:32.984012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:46:32.984012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:46:32.984012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:46:32.984012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:46:32.984012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:46:32.984012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:46:32.984012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:46:32.984012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:46:32.984012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:46:32.984012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:46:32.984012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:46:32.984012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:46:32.984932 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:46:32.984932 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:46:32.984932 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:46:32.984932 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:46:32.984932 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:46:32.984932 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:46:32.984932 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:46:32.984932 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:46:32.984932 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 628/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:46:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:46:32.991027 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b78a1-70be-4033-ac33-0b4cfad1389f None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:33.109641 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b78a1-70be-4033-ac33-0b4cfad1389f None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:33.152925 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd7416-f0cd-49e2-bdb4-d73bcaf967e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:33.153727 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd7416-f0cd-49e2-bdb4-d73bcaf967e6 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:33.154045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd7416-f0cd-49e2-bdb4-d73bcaf967e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:33.154391 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd7416-f0cd-49e2-bdb4-d73bcaf967e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:33.155257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd7416-f0cd-49e2-bdb4-d73bcaf967e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:33.155598 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd7416-f0cd-49e2-bdb4-d73bcaf967e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:33.157203 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd7416-f0cd-49e2-bdb4-d73bcaf967e6 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:33.170028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 631/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:46:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:46:33.176345 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24215730-7954-4eb9-b2b7-3a6ac9b6554d None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:33.202544 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:33.280243 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24215730-7954-4eb9-b2b7-3a6ac9b6554d None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:33.324280 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc3943-aea0-43ad-afcd-1a299909b83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:33.324961 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc3943-aea0-43ad-afcd-1a299909b83a None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:33.325234 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc3943-aea0-43ad-afcd-1a299909b83a None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:33.325513 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc3943-aea0-43ad-afcd-1a299909b83a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:33.326386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc3943-aea0-43ad-afcd-1a299909b83a None admin] RBAC: Adding query filter params (role.id=6c5b161dbf33447fa1d383915d3c9382, scope.project.id=4bc610fb6724419dac99f2483089c783, user.id=260f58535f4e46a197d00276d37fd515) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:33.326668 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc3943-aea0-43ad-afcd-1a299909b83a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:33.328265 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc3943-aea0-43ad-afcd-1a299909b83a None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:33.334669 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 629/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:46:33 2022] GET /identity/v3/role_assignments?user.id=260f58535f4e46a197d00276d37fd515&scope.project.id=4bc610fb6724419dac99f2483089c783&role.id=6c5b161dbf33447fa1d383915d3c9382 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:46:35.361883 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fd740-8287-45cb-b685-82e77bd6af43 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:35.362728 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fd740-8287-45cb-b685-82e77bd6af43 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:35.362728 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fd740-8287-45cb-b685-82e77bd6af43 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:35.364610 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 632/1261] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:46:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:46:35.371244 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56f7d8-deb3-4261-b064-424c9e5bad31 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:35.371958 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56f7d8-deb3-4261-b064-424c9e5bad31 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:35.372226 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56f7d8-deb3-4261-b064-424c9e5bad31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:35.396560 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-5e56f7d8-deb3-4261-b064-424c9e5bad31 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:46:35.397762 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-5e56f7d8-deb3-4261-b064-424c9e5bad31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:46:35.466053 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 630/1262] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:46:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:46:35.488505 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fd740-8287-45cb-b685-82e77bd6af43 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:35.501064 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:35.606038 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fd740-8287-45cb-b685-82e77bd6af43 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:35.642986 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010ba90-2d5a-4326-a826-9aa6634da3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:35.643729 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010ba90-2d5a-4326-a826-9aa6634da3b7 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:35.644009 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010ba90-2d5a-4326-a826-9aa6634da3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:35.644281 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010ba90-2d5a-4326-a826-9aa6634da3b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:35.655292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010ba90-2d5a-4326-a826-9aa6634da3b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:46:35.662962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-5010ba90-2d5a-4326-a826-9aa6634da3b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:46:35.662962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:35.662962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:46:35.662962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:46:35.662962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:46:35.662962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:46:35.662962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:46:35.662962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:46:35.662962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:46:35.662962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:46:35.662962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:46:35.662962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:46:35.662962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:46:35.662962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:46:35.662962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:46:35.662962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:46:35.664015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:46:35.664015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:46:35.664015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:46:35.664015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:46:35.664015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:46:35.664015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:46:35.664015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:46:35.664015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:46:35.664015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:46:35.664015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:46:35.664015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:46:35.664015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:46:35.664015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:46:35.664015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:46:35.664015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:46:35.664015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:46:35.664898 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:46:35.664898 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:46:35.664898 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:46:35.664898 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:46:35.664898 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:46:35.664898 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:46:35.664898 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:46:35.664898 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:46:35.664898 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:46:35.664898 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:46:35.664898 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:46:35.664898 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:46:35.664898 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 633/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:46:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:46:35.671600 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56f7d8-deb3-4261-b064-424c9e5bad31 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:35.695961 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:35.788942 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56f7d8-deb3-4261-b064-424c9e5bad31 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:35.831759 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80344874-cfc7-488d-9ee6-6118808918f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:35.832419 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80344874-cfc7-488d-9ee6-6118808918f0 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:35.832723 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80344874-cfc7-488d-9ee6-6118808918f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:35.832998 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80344874-cfc7-488d-9ee6-6118808918f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:35.833743 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80344874-cfc7-488d-9ee6-6118808918f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:35.834046 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80344874-cfc7-488d-9ee6-6118808918f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:35.835453 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80344874-cfc7-488d-9ee6-6118808918f0 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:35.843727 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 631/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:46:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:46:35.852412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010ba90-2d5a-4326-a826-9aa6634da3b7 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:35.923979 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:35.969323 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010ba90-2d5a-4326-a826-9aa6634da3b7 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:36.006673 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddda93b-79cf-43d9-8e51-67e119fc9dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:36.007479 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddda93b-79cf-43d9-8e51-67e119fc9dce None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:36.007761 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddda93b-79cf-43d9-8e51-67e119fc9dce None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:36.008034 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddda93b-79cf-43d9-8e51-67e119fc9dce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:36.019700 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddda93b-79cf-43d9-8e51-67e119fc9dce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:36.021173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddda93b-79cf-43d9-8e51-67e119fc9dce None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:36.039650 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-0ddda93b-79cf-43d9-8e51-67e119fc9dce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:46:36.039650 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:36.039650 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:46:36.039650 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:46:36.039650 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:46:36.039650 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:46:36.039650 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:46:36.039650 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:46:36.039650 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:46:36.039650 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:46:36.039650 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:46:36.039650 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:46:36.039650 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:46:36.039650 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:46:36.039650 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:46:36.040669 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:46:36.040669 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:46:36.040669 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:46:36.040669 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:46:36.040669 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:46:36.040669 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:46:36.040669 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:46:36.040669 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:46:36.040669 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:46:36.040669 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:46:36.040669 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:46:36.040669 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:46:36.040669 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:46:36.040669 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:46:36.040669 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:46:36.040669 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:46:36.040669 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:46:36.041718 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:46:36.041718 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:46:36.041718 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:46:36.041718 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:46:36.041718 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 634/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:46:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:46:36.049911 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80344874-cfc7-488d-9ee6-6118808918f0 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:36.154224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:36.176387 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80344874-cfc7-488d-9ee6-6118808918f0 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:36.221954 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd97f7-fae3-4dfe-a7b9-90ff69f03aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:36.222605 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd97f7-fae3-4dfe-a7b9-90ff69f03aba None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:36.222883 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd97f7-fae3-4dfe-a7b9-90ff69f03aba None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:36.223152 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd97f7-fae3-4dfe-a7b9-90ff69f03aba None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:36.223903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd97f7-fae3-4dfe-a7b9-90ff69f03aba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:36.224209 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd97f7-fae3-4dfe-a7b9-90ff69f03aba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:36.225571 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd97f7-fae3-4dfe-a7b9-90ff69f03aba None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:36.237228 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 632/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:46:36.243415 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddda93b-79cf-43d9-8e51-67e119fc9dce None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:36.353246 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddda93b-79cf-43d9-8e51-67e119fc9dce None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:36.375192 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:36.390909 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dbb6f1-cb96-4b00-bd06-c984ba3c68cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:36.391745 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbb6f1-cb96-4b00-bd06-c984ba3c68cc None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:36.392028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbb6f1-cb96-4b00-bd06-c984ba3c68cc None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:36.392299 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbb6f1-cb96-4b00-bd06-c984ba3c68cc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:36.400133 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dbb6f1-cb96-4b00-bd06-c984ba3c68cc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:36.401591 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dbb6f1-cb96-4b00-bd06-c984ba3c68cc None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:36.416436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-a5dbb6f1-cb96-4b00-bd06-c984ba3c68cc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 04 05:46:36.416436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:36.416436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:46:36.416436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:46:36.416436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:46:36.416436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:46:36.416436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:46:36.416436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:46:36.416436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:46:36.416436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:46:36.416436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:46:36.416436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:46:36.416436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:46:36.416436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:46:36.416436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:46:36.416436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:46:36.417506 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:46:36.417506 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:46:36.417506 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:46:36.417506 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:46:36.417506 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:46:36.417506 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:46:36.417506 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:46:36.417506 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:46:36.417506 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:46:36.417506 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:46:36.417506 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:46:36.417506 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:46:36.417506 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:46:36.417506 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:46:36.417506 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:46:36.417506 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:46:36.417506 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:46:36.417506 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:46:36.418470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:46:36.418470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:46:36.418470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:46:36.418470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:46:36.418470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:46:36.418470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:46:36.418470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:46:36.418470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:46:36.418470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 04 05:46:36.418470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:46:36.418470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 635/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:46:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:46:36.424279 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd97f7-fae3-4dfe-a7b9-90ff69f03aba None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:36.528996 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd97f7-fae3-4dfe-a7b9-90ff69f03aba None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:36.564675 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b646ffe-b5a0-45d0-96eb-16aa9d089fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:36.565334 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b646ffe-b5a0-45d0-96eb-16aa9d089fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:36.565611 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b646ffe-b5a0-45d0-96eb-16aa9d089fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:36.565882 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b646ffe-b5a0-45d0-96eb-16aa9d089fd4 None admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:36.566718 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b646ffe-b5a0-45d0-96eb-16aa9d089fd4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:36.567014 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b646ffe-b5a0-45d0-96eb-16aa9d089fd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:36.568483 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b646ffe-b5a0-45d0-96eb-16aa9d089fd4 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:36.577211 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:36.591298 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 633/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Jul 4 05:46:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:46:36.597358 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dbb6f1-cb96-4b00-bd06-c984ba3c68cc None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:36.701170 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dbb6f1-cb96-4b00-bd06-c984ba3c68cc None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:36.735791 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a52af-d2df-479a-a8eb-e41c967b5483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:36.736562 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a52af-d2df-479a-a8eb-e41c967b5483 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:36.736844 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a52af-d2df-479a-a8eb-e41c967b5483 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:36.737120 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a52af-d2df-479a-a8eb-e41c967b5483 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:36.748460 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a52af-d2df-479a-a8eb-e41c967b5483 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:36.749989 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a52af-d2df-479a-a8eb-e41c967b5483 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:36.767127 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-af0a52af-d2df-479a-a8eb-e41c967b5483 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:46:36.767127 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:36.767127 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:46:36.767127 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:46:36.767127 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:46:36.767127 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:46:36.767127 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:46:36.767127 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:46:36.767127 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:46:36.767127 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:46:36.767127 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:46:36.767127 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:46:36.767127 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:46:36.767127 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:46:36.767127 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:46:36.768054 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:46:36.768054 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:46:36.768054 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:46:36.768054 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:46:36.768054 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:46:36.768054 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:46:36.768054 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:46:36.768054 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:46:36.768054 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:46:36.768054 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:46:36.768054 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:46:36.768054 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:46:36.768054 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:46:36.768054 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:46:36.768054 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:46:36.768054 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:46:36.768054 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:46:36.769152 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:46:36.769152 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:46:36.769152 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:46:36.769152 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:46:36.769152 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 636/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:46:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:46:36.774269 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b646ffe-b5a0-45d0-96eb-16aa9d089fd4 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:36.875168 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b646ffe-b5a0-45d0-96eb-16aa9d089fd4 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:36.909571 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9fe87c-88b8-449d-a331-2fe6930c281c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:36.910235 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fe87c-88b8-449d-a331-2fe6930c281c None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:36.910518 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fe87c-88b8-449d-a331-2fe6930c281c None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:36.910790 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fe87c-88b8-449d-a331-2fe6930c281c None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:36.911544 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9fe87c-88b8-449d-a331-2fe6930c281c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:36.911847 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9fe87c-88b8-449d-a331-2fe6930c281c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:36.913218 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9fe87c-88b8-449d-a331-2fe6930c281c None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:36.924638 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 634/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:46:36.930564 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a52af-d2df-479a-a8eb-e41c967b5483 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:36.964855 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:37.048111 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a52af-d2df-479a-a8eb-e41c967b5483 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:37.085867 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4d8e0-cc23-4fa4-9aa7-0553e6b05caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:37.086648 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4d8e0-cc23-4fa4-9aa7-0553e6b05caa None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:37.086933 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4d8e0-cc23-4fa4-9aa7-0553e6b05caa None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:37.087223 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4d8e0-cc23-4fa4-9aa7-0553e6b05caa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:37.094096 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e4d8e0-cc23-4fa4-9aa7-0553e6b05caa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:37.095609 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e4d8e0-cc23-4fa4-9aa7-0553e6b05caa None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:37.110704 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-30e4d8e0-cc23-4fa4-9aa7-0553e6b05caa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:46:37.110704 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:37.110704 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:46:37.110704 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:46:37.110704 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:46:37.110704 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:46:37.110704 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:46:37.110704 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:46:37.110704 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:46:37.110704 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:46:37.110704 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:46:37.110704 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:46:37.110704 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:46:37.110704 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:46:37.110704 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:46:37.111731 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:46:37.111731 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:46:37.111731 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:46:37.111731 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:46:37.111731 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:46:37.111731 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:46:37.111731 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:46:37.111731 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:46:37.111731 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:46:37.111731 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:46:37.111731 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:46:37.111731 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:46:37.111731 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:46:37.111731 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:46:37.111731 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:46:37.111731 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:46:37.111731 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:46:37.112647 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:46:37.112647 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:46:37.112647 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:46:37.112647 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:46:37.112647 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:46:37.112647 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:46:37.112647 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:46:37.112647 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:46:37.112647 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 637/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:46:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:46:37.120297 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9fe87c-88b8-449d-a331-2fe6930c281c None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:37.185517 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:37.228158 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9fe87c-88b8-449d-a331-2fe6930c281c None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:37.262816 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90946c3b-58c0-43f4-9fcc-0cb21b6b9f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:37.263494 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90946c3b-58c0-43f4-9fcc-0cb21b6b9f24 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:37.263777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90946c3b-58c0-43f4-9fcc-0cb21b6b9f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:37.264054 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90946c3b-58c0-43f4-9fcc-0cb21b6b9f24 None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:37.264837 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90946c3b-58c0-43f4-9fcc-0cb21b6b9f24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:37.265148 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90946c3b-58c0-43f4-9fcc-0cb21b6b9f24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:37.266620 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90946c3b-58c0-43f4-9fcc-0cb21b6b9f24 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:37.279594 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 635/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:46:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:46:37.285663 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4d8e0-cc23-4fa4-9aa7-0553e6b05caa None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:37.387937 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:37.398667 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4d8e0-cc23-4fa4-9aa7-0553e6b05caa None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:37.437402 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b0335-6f85-4251-8157-fe33a72bc122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:37.438198 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b0335-6f85-4251-8157-fe33a72bc122 None admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:37.438475 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b0335-6f85-4251-8157-fe33a72bc122 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:37.438746 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b0335-6f85-4251-8157-fe33a72bc122 None admin] PATH_INFO: `/v3/projects/4bc610fb6724419dac99f2483089c783/users/260f58535f4e46a197d00276d37fd515/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:37.440841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b0335-6f85-4251-8157-fe33a72bc122 None admin] RBAC: Authorizing `identity:create_grant(project_id=4bc610fb6724419dac99f2483089c783, user_id=260f58535f4e46a197d00276d37fd515, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:37.442297 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b0335-6f85-4251-8157-fe33a72bc122 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:37.456553 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 638/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Mon Jul 4 05:46:37 2022] PUT /identity/v3/projects/4bc610fb6724419dac99f2483089c783/users/260f58535f4e46a197d00276d37fd515/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:46:39.620449 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8333e2f-1ffe-4b57-91fc-e77e9a696d7b None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:39.621281 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8333e2f-1ffe-4b57-91fc-e77e9a696d7b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:39.621281 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8333e2f-1ffe-4b57-91fc-e77e9a696d7b None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:39.623622 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 636/1274] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:46:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:46:39.629452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b46d5-0141-46b0-8491-ae734a90c875 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:39.629887 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b46d5-0141-46b0-8491-ae734a90c875 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:39.629979 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b46d5-0141-46b0-8491-ae734a90c875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:39.649168 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a03b46d5-0141-46b0-8491-ae734a90c875 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:46:39.650372 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a03b46d5-0141-46b0-8491-ae734a90c875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:46:39.720534 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 639/1275] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:46:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:46:39.744793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8333e2f-1ffe-4b57-91fc-e77e9a696d7b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:39.864255 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8333e2f-1ffe-4b57-91fc-e77e9a696d7b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:39.881808 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:39.899625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d89633-ccbd-46e4-bce6-89f857ae202f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:39.900413 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d89633-ccbd-46e4-bce6-89f857ae202f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:39.900692 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d89633-ccbd-46e4-bce6-89f857ae202f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:39.900992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d89633-ccbd-46e4-bce6-89f857ae202f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:39.911224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d89633-ccbd-46e4-bce6-89f857ae202f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 05:46:39.918777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-e4d89633-ccbd-46e4-bce6-89f857ae202f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:46:39.918777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:39.918777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:46:39.918777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:46:39.918777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:46:39.918777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:46:39.918777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:46:39.918777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:46:39.918777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:46:39.918777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:46:39.918777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:46:39.918777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:46:39.918777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 05:46:39.918777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 05:46:39.918777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 05:46:39.918777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 05:46:39.919859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 05:46:39.919859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 05:46:39.919859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 05:46:39.919859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 05:46:39.919859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:46:39.919859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:46:39.919859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:46:39.919859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:46:39.919859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:46:39.919859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:46:39.919859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:46:39.919859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:46:39.919859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:46:39.919859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:46:39.919859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:46:39.919859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:46:39.920729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:46:39.920729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:46:39.920729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:46:39.920729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:46:39.920729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 05:46:39.920729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 05:46:39.920729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 05:46:39.920729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 05:46:39.920729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 05:46:39.920729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 05:46:39.920729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 05:46:39.920729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:46:39.920729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 637/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Mon Jul 4 05:46:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:46:39.926351 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b46d5-0141-46b0-8491-ae734a90c875 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:40.023517 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:40.048611 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b46d5-0141-46b0-8491-ae734a90c875 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:40.085372 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b88793-949e-44a6-8078-fcad9d583d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:40.086040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b88793-949e-44a6-8078-fcad9d583d66 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:40.086321 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b88793-949e-44a6-8078-fcad9d583d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:40.086595 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b88793-949e-44a6-8078-fcad9d583d66 None admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:40.087381 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b88793-949e-44a6-8078-fcad9d583d66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:40.087685 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b88793-949e-44a6-8078-fcad9d583d66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:40.089088 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b88793-949e-44a6-8078-fcad9d583d66 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:40.098721 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 640/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Mon Jul 4 05:46:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:46:40.108395 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d89633-ccbd-46e4-bce6-89f857ae202f None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:40.211977 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d89633-ccbd-46e4-bce6-89f857ae202f None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:40.246007 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf0c88-6fd9-4d63-ab21-b248fa553fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:40.246776 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf0c88-6fd9-4d63-ab21-b248fa553fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:40.247052 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf0c88-6fd9-4d63-ab21-b248fa553fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:40.247348 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf0c88-6fd9-4d63-ab21-b248fa553fa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:40.258148 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf0c88-6fd9-4d63-ab21-b248fa553fa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:40.259710 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf0c88-6fd9-4d63-ab21-b248fa553fa5 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:40.277413 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-6fcf0c88-6fd9-4d63-ab21-b248fa553fa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:46:40.277413 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:40.277413 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:46:40.277413 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:46:40.277413 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:46:40.277413 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:46:40.277413 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:46:40.277413 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:46:40.277413 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:46:40.277413 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:46:40.277413 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:46:40.277413 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:46:40.277413 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:46:40.277413 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:46:40.277413 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:46:40.279673 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:46:40.279673 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:46:40.279673 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:46:40.279673 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:46:40.279673 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:46:40.279673 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:46:40.279673 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:46:40.279673 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:46:40.279673 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:46:40.279673 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:46:40.279673 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:46:40.279673 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:46:40.279673 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:46:40.279673 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:46:40.279673 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:46:40.279673 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:46:40.279673 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:46:40.281020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:46:40.281020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:46:40.281020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:46:40.281020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:46:40.281020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 638/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:46:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:46:40.286298 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b88793-949e-44a6-8078-fcad9d583d66 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:40.403760 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b88793-949e-44a6-8078-fcad9d583d66 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:40.441685 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e3b4f-b202-4032-aef4-cf431ef2cc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:40.442335 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e3b4f-b202-4032-aef4-cf431ef2cc02 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:40.442618 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e3b4f-b202-4032-aef4-cf431ef2cc02 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:40.442895 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e3b4f-b202-4032-aef4-cf431ef2cc02 None admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:40.443639 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e3b4f-b202-4032-aef4-cf431ef2cc02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:40.443943 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e3b4f-b202-4032-aef4-cf431ef2cc02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:40.445330 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e3b4f-b202-4032-aef4-cf431ef2cc02 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:40.457283 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 641/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:46:40.463497 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf0c88-6fd9-4d63-ab21-b248fa553fa5 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:40.497524 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:40.571788 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf0c88-6fd9-4d63-ab21-b248fa553fa5 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:40.611374 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a78d2-8364-44b7-9ce6-bf0302404152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:40.612184 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a78d2-8364-44b7-9ce6-bf0302404152 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:40.612468 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a78d2-8364-44b7-9ce6-bf0302404152 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:40.612741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a78d2-8364-44b7-9ce6-bf0302404152 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:40.621919 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a78d2-8364-44b7-9ce6-bf0302404152 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:40.623412 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a78d2-8364-44b7-9ce6-bf0302404152 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:40.638498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-5a0a78d2-8364-44b7-9ce6-bf0302404152 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 04 05:46:40.638498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:40.638498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:46:40.638498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:46:40.638498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:46:40.638498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:46:40.638498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:46:40.638498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:46:40.638498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:46:40.638498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:46:40.638498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:46:40.638498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:46:40.638498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 05:46:40.638498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 05:46:40.638498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 05:46:40.638498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 05:46:40.639593 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:46:40.639593 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:46:40.639593 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 05:46:40.639593 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:46:40.639593 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 05:46:40.639593 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 05:46:40.639593 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:46:40.639593 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:46:40.639593 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:46:40.639593 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:46:40.639593 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:46:40.639593 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:46:40.639593 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:46:40.639593 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:46:40.639593 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:46:40.639593 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:46:40.639593 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:46:40.639593 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:46:40.641022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:46:40.641022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:46:40.641022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 05:46:40.641022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 05:46:40.641022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 05:46:40.641022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 05:46:40.641022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 05:46:40.641022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 05:46:40.641022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 04 05:46:40.641022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:46:40.641022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 639/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:46:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:46:40.648669 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e3b4f-b202-4032-aef4-cf431ef2cc02 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:40.654616 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:40.755352 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e3b4f-b202-4032-aef4-cf431ef2cc02 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:40.790345 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14619c15-a9f1-49a0-91eb-c1ae47b56ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:40.791153 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14619c15-a9f1-49a0-91eb-c1ae47b56ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:40.791478 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14619c15-a9f1-49a0-91eb-c1ae47b56ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:40.791827 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14619c15-a9f1-49a0-91eb-c1ae47b56ce7 None admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:40.792722 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14619c15-a9f1-49a0-91eb-c1ae47b56ce7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:40.793026 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14619c15-a9f1-49a0-91eb-c1ae47b56ce7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:40.794460 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14619c15-a9f1-49a0-91eb-c1ae47b56ce7 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:40.812326 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 642/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Mon Jul 4 05:46:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:46:40.821414 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a78d2-8364-44b7-9ce6-bf0302404152 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:40.923899 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:40.938014 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a78d2-8364-44b7-9ce6-bf0302404152 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:40.972957 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5361472-0187-4982-98d4-dda33fed092d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:40.973602 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5361472-0187-4982-98d4-dda33fed092d None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:40.973884 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5361472-0187-4982-98d4-dda33fed092d None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:40.974159 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5361472-0187-4982-98d4-dda33fed092d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:41.048077 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5361472-0187-4982-98d4-dda33fed092d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:41.049555 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5361472-0187-4982-98d4-dda33fed092d None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:41.141571 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:41.153707 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 640/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Mon Jul 4 05:46:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 05:46:41.160722 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14619c15-a9f1-49a0-91eb-c1ae47b56ce7 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:41.233524 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:41.272750 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14619c15-a9f1-49a0-91eb-c1ae47b56ce7 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:41.309604 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0abcb8-115c-443e-8506-c88dea5d1cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:41.310376 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0abcb8-115c-443e-8506-c88dea5d1cce None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:41.310663 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0abcb8-115c-443e-8506-c88dea5d1cce None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:41.310928 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0abcb8-115c-443e-8506-c88dea5d1cce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:41.321002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0abcb8-115c-443e-8506-c88dea5d1cce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:41.322485 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0abcb8-115c-443e-8506-c88dea5d1cce None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:41.339912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-8b0abcb8-115c-443e-8506-c88dea5d1cce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:46:41.339912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:41.339912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:46:41.339912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:46:41.339912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:46:41.339912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:46:41.339912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:46:41.339912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:46:41.339912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:46:41.339912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:46:41.339912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:46:41.339912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:46:41.339912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 05:46:41.339912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 05:46:41.339912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 05:46:41.340855 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 05:46:41.340855 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:46:41.340855 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:46:41.340855 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:46:41.340855 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:46:41.340855 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:46:41.340855 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:46:41.340855 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:46:41.340855 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:46:41.340855 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:46:41.340855 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:46:41.340855 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:46:41.340855 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:46:41.340855 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:46:41.340855 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:46:41.340855 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:46:41.340855 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:46:41.341879 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 05:46:41.341879 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 05:46:41.341879 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 05:46:41.341879 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:46:41.341879 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 643/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:46:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:46:41.347070 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5361472-0187-4982-98d4-dda33fed092d None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:41.449162 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5361472-0187-4982-98d4-dda33fed092d None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:41.484707 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f04f3-e8bd-4f96-9f55-614235c62adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:41.485359 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f04f3-e8bd-4f96-9f55-614235c62adc None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:41.485637 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f04f3-e8bd-4f96-9f55-614235c62adc None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:41.485912 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f04f3-e8bd-4f96-9f55-614235c62adc None admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:41.486627 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698f04f3-e8bd-4f96-9f55-614235c62adc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:41.486937 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698f04f3-e8bd-4f96-9f55-614235c62adc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:41.488470 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698f04f3-e8bd-4f96-9f55-614235c62adc None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:41.500153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 641/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Mon Jul 4 05:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:46:41.506528 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0abcb8-115c-443e-8506-c88dea5d1cce None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:41.611631 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0abcb8-115c-443e-8506-c88dea5d1cce None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:41.625764 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:41.647176 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c32088-bdab-44b0-9824-e96f82e1014d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:41.647980 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c32088-bdab-44b0-9824-e96f82e1014d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:41.648254 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c32088-bdab-44b0-9824-e96f82e1014d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:41.648518 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c32088-bdab-44b0-9824-e96f82e1014d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:41.655172 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c32088-bdab-44b0-9824-e96f82e1014d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:41.656698 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c32088-bdab-44b0-9824-e96f82e1014d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:41.670282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application [None req-66c32088-bdab-44b0-9824-e96f82e1014d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:46:41.670282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:41.670282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:46:41.670282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:46:41.670282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:46:41.670282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:46:41.670282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:46:41.670282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:46:41.670282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:46:41.670282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:46:41.670282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:46:41.670282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:46:41.670282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 05:46:41.670282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 05:46:41.670282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 05:46:41.671392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 05:46:41.671392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:46:41.671392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:46:41.671392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:46:41.671392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:46:41.671392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:46:41.671392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:46:41.671392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:46:41.671392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application with Lock( Jul 04 05:46:41.671392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:46:41.671392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:46:41.671392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:46:41.671392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:46:41.671392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:46:41.671392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:46:41.671392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:46:41.671392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:46:41.677620 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 05:46:41.677620 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 05:46:41.677620 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 05:46:41.677620 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 05:46:41.677620 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 05:46:41.677620 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 05:46:41.677620 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 05:46:41.677620 dv-cinder-797333-5-smb devstack@keystone.service[80213]: ERROR keystone.server.flask.application Jul 04 05:46:41.677620 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 644/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Mon Jul 4 05:46:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:46:41.679758 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f04f3-e8bd-4f96-9f55-614235c62adc None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:41.730752 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:41.784188 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f04f3-e8bd-4f96-9f55-614235c62adc None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:41.818376 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50981e6b-ee81-4223-9e47-117211a5c83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:41.819012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50981e6b-ee81-4223-9e47-117211a5c83b None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:41.819316 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50981e6b-ee81-4223-9e47-117211a5c83b None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:41.819590 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50981e6b-ee81-4223-9e47-117211a5c83b None admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:41.820376 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50981e6b-ee81-4223-9e47-117211a5c83b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:41.820683 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50981e6b-ee81-4223-9e47-117211a5c83b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:41.822107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50981e6b-ee81-4223-9e47-117211a5c83b None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:41.834984 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 642/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Mon Jul 4 05:46:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:46:41.841421 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c32088-bdab-44b0-9824-e96f82e1014d None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:41.942224 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c32088-bdab-44b0-9824-e96f82e1014d None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:41.976556 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502968c-e195-489d-b8cc-9a49db06849d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:41.977179 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502968c-e195-489d-b8cc-9a49db06849d None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:41.977452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502968c-e195-489d-b8cc-9a49db06849d None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:41.977722 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502968c-e195-489d-b8cc-9a49db06849d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:41.978530 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502968c-e195-489d-b8cc-9a49db06849d None admin] RBAC: Adding query filter params (role.id=6c5b161dbf33447fa1d383915d3c9382, scope.project.id=4bc610fb6724419dac99f2483089c783, user.id=260f58535f4e46a197d00276d37fd515) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:41.978845 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502968c-e195-489d-b8cc-9a49db06849d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:41.980290 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502968c-e195-489d-b8cc-9a49db06849d None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:41.986156 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 645/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Mon Jul 4 05:46:41 2022] GET /identity/v3/role_assignments?user.id=260f58535f4e46a197d00276d37fd515&scope.project.id=4bc610fb6724419dac99f2483089c783&role.id=6c5b161dbf33447fa1d383915d3c9382 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:46:44.012458 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a966b5c-351a-4ca7-9135-2db7f13260f1 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:44.013443 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a966b5c-351a-4ca7-9135-2db7f13260f1 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:44.013443 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a966b5c-351a-4ca7-9135-2db7f13260f1 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:44.015580 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 643/1288] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:46:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:46:44.023301 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf39487-eefa-43c0-83ba-3c6b902cde79 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:44.023770 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf39487-eefa-43c0-83ba-3c6b902cde79 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:44.023877 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf39487-eefa-43c0-83ba-3c6b902cde79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:44.041913 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-dbf39487-eefa-43c0-83ba-3c6b902cde79 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:46:44.043103 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-dbf39487-eefa-43c0-83ba-3c6b902cde79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:46:44.073445 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:44.114127 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 646/1289] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:46:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:46:44.137314 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a966b5c-351a-4ca7-9135-2db7f13260f1 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:44.250476 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a966b5c-351a-4ca7-9135-2db7f13260f1 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:44.260928 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:44.288439 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407a733-299a-4556-b19e-a072c7239693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:44.289317 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407a733-299a-4556-b19e-a072c7239693 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:44.289678 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407a733-299a-4556-b19e-a072c7239693 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:44.290025 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407a733-299a-4556-b19e-a072c7239693 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:44.290775 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407a733-299a-4556-b19e-a072c7239693 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:44.292346 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407a733-299a-4556-b19e-a072c7239693 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:44.306625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-4407a733-299a-4556-b19e-a072c7239693 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 05:46:44.306625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:44.306625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 05:46:44.306625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 05:46:44.306625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 05:46:44.306625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 05:46:44.306625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 05:46:44.306625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:46:44.306625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 05:46:44.306625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:46:44.306625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 05:46:44.306625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:46:44.306625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:44.306625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:46:44.306625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:46:44.306625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:46:44.306625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:46:44.307778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:46:44.307778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:46:44.307778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:46:44.307778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:46:44.307778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:46:44.307778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:46:44.307778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 05:46:44.307778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 05:46:44.307778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 05:46:44.307778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 05:46:44.307778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:46:44.307778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:46:44.307778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:46:44.307778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:46:44.307778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:46:44.307778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:46:44.313916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:46:44.313916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:46:44.313916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:46:44.313916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:46:44.313916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:46:44.313916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:46:44.313916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:46:44.313916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:46:44.313916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:46:44.313916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:46:44.313916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 05:46:44.313916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:46:44.313916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 05:46:44.313916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:46:44.313916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 644/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jul 4 05:46:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:46:44.314789 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf39487-eefa-43c0-83ba-3c6b902cde79 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:44.421567 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf39487-eefa-43c0-83ba-3c6b902cde79 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:44.455378 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390f6ab-0aea-4591-b3bf-e5cbf7068268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:44.456004 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390f6ab-0aea-4591-b3bf-e5cbf7068268 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:44.456315 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390f6ab-0aea-4591-b3bf-e5cbf7068268 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:44.456549 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390f6ab-0aea-4591-b3bf-e5cbf7068268 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:44.457238 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390f6ab-0aea-4591-b3bf-e5cbf7068268 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:44.457538 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390f6ab-0aea-4591-b3bf-e5cbf7068268 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:44.458905 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390f6ab-0aea-4591-b3bf-e5cbf7068268 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:44.463887 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 647/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Mon Jul 4 05:46:44 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:46:44.472560 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407a733-299a-4556-b19e-a072c7239693 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:44.586909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407a733-299a-4556-b19e-a072c7239693 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:44.621816 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb982b0-c948-4aa0-9acf-f05cb2174df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:44.622471 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb982b0-c948-4aa0-9acf-f05cb2174df1 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:44.622756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb982b0-c948-4aa0-9acf-f05cb2174df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:44.623029 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb982b0-c948-4aa0-9acf-f05cb2174df1 None admin] PATH_INFO: `/v3/services` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:44.623769 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb982b0-c948-4aa0-9acf-f05cb2174df1 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:44.624102 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb982b0-c948-4aa0-9acf-f05cb2174df1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:44.625472 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb982b0-c948-4aa0-9acf-f05cb2174df1 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:44.630123 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 645/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Mon Jul 4 05:46:44 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:46:46.628283 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78013c2b-0be1-4245-bb04-28e67157a0e9 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:46.629135 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78013c2b-0be1-4245-bb04-28e67157a0e9 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:46.629135 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78013c2b-0be1-4245-bb04-28e67157a0e9 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:46.631430 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 648/1293] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:46:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:46:46.637627 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbe86f-2fd8-47e6-b33b-6c54c5b31829 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:46.638399 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbe86f-2fd8-47e6-b33b-6c54c5b31829 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:46.638539 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbe86f-2fd8-47e6-b33b-6c54c5b31829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:46.658223 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-93dbe86f-2fd8-47e6-b33b-6c54c5b31829 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:46:46.659454 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-93dbe86f-2fd8-47e6-b33b-6c54c5b31829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:46:46.692394 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:46.733307 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 646/1294] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:46:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:46:46.756610 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78013c2b-0be1-4245-bb04-28e67157a0e9 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:46.793380 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:46.867914 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78013c2b-0be1-4245-bb04-28e67157a0e9 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:46.903061 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b5f7b-4608-4163-b687-f3fabc8e70c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:46.903744 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b5f7b-4608-4163-b687-f3fabc8e70c2 None admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:46.904017 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b5f7b-4608-4163-b687-f3fabc8e70c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:46.904283 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b5f7b-4608-4163-b687-f3fabc8e70c2 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:46.905004 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b5f7b-4608-4163-b687-f3fabc8e70c2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:46.906464 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b5f7b-4608-4163-b687-f3fabc8e70c2 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:46.922924 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 649/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Mon Jul 4 05:46:46 2022] POST /identity/v3/services => generated 246 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:46:48.920150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd94f3-f461-494b-94f7-fb2bc7e48a6b None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:48.921107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd94f3-f461-494b-94f7-fb2bc7e48a6b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:48.921107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd94f3-f461-494b-94f7-fb2bc7e48a6b None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:48.923482 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 647/1296] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:46:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:46:48.928916 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43342f5-82c5-46e3-8d5f-47eaa96fab99 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:48.929340 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43342f5-82c5-46e3-8d5f-47eaa96fab99 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:48.929470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43342f5-82c5-46e3-8d5f-47eaa96fab99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:48.947997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-f43342f5-82c5-46e3-8d5f-47eaa96fab99 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:46:48.949165 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f43342f5-82c5-46e3-8d5f-47eaa96fab99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:46:49.028796 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 650/1297] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:46:48 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:46:49.052303 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd94f3-f461-494b-94f7-fb2bc7e48a6b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:49.167722 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd94f3-f461-494b-94f7-fb2bc7e48a6b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:49.203234 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2fa1d-a422-4500-a273-b159a77f8f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:49.203969 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2fa1d-a422-4500-a273-b159a77f8f26 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:49.204250 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2fa1d-a422-4500-a273-b159a77f8f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:49.204526 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2fa1d-a422-4500-a273-b159a77f8f26 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:49.205182 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f2fa1d-a422-4500-a273-b159a77f8f26 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:49.206569 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f2fa1d-a422-4500-a273-b159a77f8f26 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:49.218933 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-e2f2fa1d-a422-4500-a273-b159a77f8f26 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 05:46:49.218933 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:49.218933 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 05:46:49.218933 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 05:46:49.218933 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 05:46:49.218933 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 05:46:49.218933 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 05:46:49.218933 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:46:49.218933 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 05:46:49.218933 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:46:49.218933 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 05:46:49.218933 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:46:49.218933 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:49.218933 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:46:49.218933 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:46:49.218933 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:46:49.218933 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:46:49.220107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:46:49.220107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:46:49.220107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:46:49.220107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:46:49.220107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:46:49.220107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:46:49.220107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 05:46:49.220107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 05:46:49.220107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 05:46:49.220107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 05:46:49.220107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:46:49.220107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:46:49.220107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:46:49.220107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:46:49.220107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:46:49.220107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:46:49.220955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:46:49.220955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:46:49.220955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:46:49.220955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:46:49.220955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:46:49.220955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:46:49.220955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:46:49.220955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:46:49.220955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:46:49.220955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:46:49.220955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 05:46:49.220955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:46:49.220955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 05:46:49.220955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:46:49.220955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 648/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jul 4 05:46:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:46:49.228560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43342f5-82c5-46e3-8d5f-47eaa96fab99 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:49.255128 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:49.348630 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43342f5-82c5-46e3-8d5f-47eaa96fab99 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:49.383737 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74d2ae-ebf7-4a48-a3fa-2945877681f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:49.384401 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74d2ae-ebf7-4a48-a3fa-2945877681f1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:49.384681 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74d2ae-ebf7-4a48-a3fa-2945877681f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:49.384953 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74d2ae-ebf7-4a48-a3fa-2945877681f1 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:49.385656 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74d2ae-ebf7-4a48-a3fa-2945877681f1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:49.385958 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74d2ae-ebf7-4a48-a3fa-2945877681f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:49.387370 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74d2ae-ebf7-4a48-a3fa-2945877681f1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:49.392443 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 651/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Mon Jul 4 05:46:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:46:49.398747 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2fa1d-a422-4500-a273-b159a77f8f26 None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:49.432973 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:49.508894 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2fa1d-a422-4500-a273-b159a77f8f26 None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:49.547409 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62bd5b6-ad0b-46ab-9339-22af97c47793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:49.548065 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62bd5b6-ad0b-46ab-9339-22af97c47793 None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:49.548343 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62bd5b6-ad0b-46ab-9339-22af97c47793 None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:49.548610 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62bd5b6-ad0b-46ab-9339-22af97c47793 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:49.549397 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62bd5b6-ad0b-46ab-9339-22af97c47793 None admin] RBAC: Adding query filter params (interface=public, service_id=5b4f6b7584c54d0e84f4d56d1bf8deee, region_id=RegionOne) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:49.549703 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62bd5b6-ad0b-46ab-9339-22af97c47793 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:49.551070 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62bd5b6-ad0b-46ab-9339-22af97c47793 None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:49.556117 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 649/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Mon Jul 4 05:46:49 2022] GET /identity/v3/endpoints?service_id=5b4f6b7584c54d0e84f4d56d1bf8deee&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:46:49.562022 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74d2ae-ebf7-4a48-a3fa-2945877681f1 None admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:49.646320 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:49.665778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74d2ae-ebf7-4a48-a3fa-2945877681f1 None admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:49.700672 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa0ba8-5e56-42ad-bdfd-53d9615d320f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:49.701327 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa0ba8-5e56-42ad-bdfd-53d9615d320f None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:49.701609 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa0ba8-5e56-42ad-bdfd-53d9615d320f None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:49.701934 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa0ba8-5e56-42ad-bdfd-53d9615d320f None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:49.702613 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa0ba8-5e56-42ad-bdfd-53d9615d320f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:49.704031 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa0ba8-5e56-42ad-bdfd-53d9615d320f None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:49.711014 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 652/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Mon Jul 4 05:46:49 2022] GET /identity/v3/services => generated 2191 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:46:51.735042 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac68c47-24b7-4682-9875-a4aaff798f5f None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:51.735974 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac68c47-24b7-4682-9875-a4aaff798f5f None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:51.735974 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac68c47-24b7-4682-9875-a4aaff798f5f None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:51.738143 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 650/1302] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:46:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:46:51.744673 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6d3b0-0b6b-40de-ae5c-c66781ff13b8 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:51.745130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6d3b0-0b6b-40de-ae5c-c66781ff13b8 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:51.745232 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6d3b0-0b6b-40de-ae5c-c66781ff13b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:51.766861 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-5bc6d3b0-0b6b-40de-ae5c-c66781ff13b8 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:46:51.768078 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5bc6d3b0-0b6b-40de-ae5c-c66781ff13b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:46:51.840383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 653/1303] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:46:51 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 05:46:51.863606 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac68c47-24b7-4682-9875-a4aaff798f5f None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:51.972404 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:51.980142 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac68c47-24b7-4682-9875-a4aaff798f5f None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:52.015746 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79115dac-6afc-4dce-9f3f-d5a2f8e2b24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:52.016541 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79115dac-6afc-4dce-9f3f-d5a2f8e2b24f None admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:52.016822 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79115dac-6afc-4dce-9f3f-d5a2f8e2b24f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:52.017096 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79115dac-6afc-4dce-9f3f-d5a2f8e2b24f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:52.017745 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79115dac-6afc-4dce-9f3f-d5a2f8e2b24f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:52.019132 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79115dac-6afc-4dce-9f3f-d5a2f8e2b24f None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:52.031145 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application [None req-79115dac-6afc-4dce-9f3f-d5a2f8e2b24f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 05:46:52.031145 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:52.031145 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 05:46:52.031145 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 05:46:52.031145 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 05:46:52.031145 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 05:46:52.031145 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 05:46:52.031145 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:46:52.031145 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 05:46:52.031145 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:46:52.031145 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 05:46:52.031145 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:46:52.031145 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 05:46:52.031145 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 05:46:52.031145 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 05:46:52.031145 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 05:46:52.031145 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 05:46:52.032267 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 05:46:52.032267 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 05:46:52.032267 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 05:46:52.032267 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 05:46:52.032267 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 05:46:52.032267 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 05:46:52.032267 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 05:46:52.032267 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 05:46:52.032267 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 05:46:52.032267 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 05:46:52.032267 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 05:46:52.032267 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 05:46:52.032267 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 05:46:52.032267 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 05:46:52.032267 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 05:46:52.032267 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 05:46:52.033192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 05:46:52.033192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application with Lock( Jul 04 05:46:52.033192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 05:46:52.033192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self._enter() Jul 04 05:46:52.033192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 05:46:52.033192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 05:46:52.033192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 05:46:52.033192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application return self.creator() Jul 04 05:46:52.033192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 05:46:52.033192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application created_value = creator( Jul 04 05:46:52.033192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 05:46:52.033192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 05:46:52.033192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 05:46:52.033192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: ERROR keystone.server.flask.application Jul 04 05:46:52.033192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 651/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Mon Jul 4 05:46:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 05:46:52.038775 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6d3b0-0b6b-40de-ae5c-c66781ff13b8 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:52.118539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:46:52.142489 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6d3b0-0b6b-40de-ae5c-c66781ff13b8 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:52.178638 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39af451-d909-46d7-810e-2621f7b0aad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:52.179379 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39af451-d909-46d7-810e-2621f7b0aad1 None admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:52.179664 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39af451-d909-46d7-810e-2621f7b0aad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:52.179940 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39af451-d909-46d7-810e-2621f7b0aad1 None admin] PATH_INFO: `/v3/services` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:52.180646 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39af451-d909-46d7-810e-2621f7b0aad1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:46:52.180952 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39af451-d909-46d7-810e-2621f7b0aad1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:52.182325 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39af451-d909-46d7-810e-2621f7b0aad1 None admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:52.189096 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 654/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Mon Jul 4 05:46:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:46:52.195449 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79115dac-6afc-4dce-9f3f-d5a2f8e2b24f None admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:46:52.306710 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79115dac-6afc-4dce-9f3f-d5a2f8e2b24f None admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:46:52.342450 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d0d70-e14d-4355-a739-9b2ef85b783f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:46:52.343100 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d0d70-e14d-4355-a739-9b2ef85b783f None admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:46:52.343414 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d0d70-e14d-4355-a739-9b2ef85b783f None admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:46:52.343683 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d0d70-e14d-4355-a739-9b2ef85b783f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:46:52.344401 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d0d70-e14d-4355-a739-9b2ef85b783f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:46:52.345775 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d0d70-e14d-4355-a739-9b2ef85b783f None admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:46:52.370710 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 652/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Mon Jul 4 05:46:52 2022] POST /identity/v3/endpoints => generated 331 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:47:02.184417 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=30 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:47:02.362855 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:47:55.060742 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04b99e-1137-4a5e-bd60-c744ecca29f8 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:47:55.061235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04b99e-1137-4a5e-bd60-c744ecca29f8 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:47:55.061319 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04b99e-1137-4a5e-bd60-c744ecca29f8 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:47:55.063358 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 655/1307] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:47:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:47:55.068478 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174b5d4-7aae-44f7-a56f-55347663e437 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:47:55.069259 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174b5d4-7aae-44f7-a56f-55347663e437 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:47:55.069433 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174b5d4-7aae-44f7-a56f-55347663e437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:47:55.185840 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d174b5d4-7aae-44f7-a56f-55347663e437 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:47:55.187220 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d174b5d4-7aae-44f7-a56f-55347663e437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:47:55.331129 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 653/1308] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:47:55.384735 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d112e7-46b4-4312-bf5e-b0121519df87 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:47:55.385182 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d112e7-46b4-4312-bf5e-b0121519df87 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:47:55.385537 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d112e7-46b4-4312-bf5e-b0121519df87 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:47:55.387433 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 656/1309] 10.222.0.16 () {54 vars in 964 bytes} [Mon Jul 4 05:47:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:47:55.393620 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6f2b8-c14e-4614-a993-5337611fab67 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:47:55.394046 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6f2b8-c14e-4614-a993-5337611fab67 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:47:55.394441 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6f2b8-c14e-4614-a993-5337611fab67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:47:55.487258 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-71a6f2b8-c14e-4614-a993-5337611fab67 None None] MFA Rules not processed for user `5e5be3de52e945d3af1b2cad1c84c755`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:47:55.488542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-71a6f2b8-c14e-4614-a993-5337611fab67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:47:55.510351 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:47:55.574291 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 654/1310] 10.222.0.16 () {58 vars in 1061 bytes} [Mon Jul 4 05:47:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:47:55.583405 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d112e7-46b4-4312-bf5e-b0121519df87 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:47:55.585342 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-24d112e7-46b4-4312-bf5e-b0121519df87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:47:55.691976 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d112e7-46b4-4312-bf5e-b0121519df87 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:47:55.765432 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf585da-5624-4f80-9e22-c692525a3f48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:47:55.766358 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf585da-5624-4f80-9e22-c692525a3f48 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:47:55.766790 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf585da-5624-4f80-9e22-c692525a3f48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:47:55.767222 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf585da-5624-4f80-9e22-c692525a3f48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:47:55.769049 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ccf585da-5624-4f80-9e22-c692525a3f48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:47:55.827832 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:47:55.887331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf585da-5624-4f80-9e22-c692525a3f48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:47:55.888839 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf585da-5624-4f80-9e22-c692525a3f48 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:47:55.908463 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 657/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:47:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:47:58.219651 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138a5bf-63d9-4cb0-8dc3-434e03f14846 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:47:58.220265 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138a5bf-63d9-4cb0-8dc3-434e03f14846 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:47:58.220265 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138a5bf-63d9-4cb0-8dc3-434e03f14846 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:47:58.221606 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 655/1312] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:47:58.226751 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0285ed-f6ca-4e52-8919-dd8783f6c23d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:47:58.227230 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0285ed-f6ca-4e52-8919-dd8783f6c23d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:47:58.227333 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0285ed-f6ca-4e52-8919-dd8783f6c23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:47:58.298398 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-2c0285ed-f6ca-4e52-8919-dd8783f6c23d None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:47:58.299647 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2c0285ed-f6ca-4e52-8919-dd8783f6c23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:47:58.407107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 658/1313] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:47:58.444660 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138a5bf-63d9-4cb0-8dc3-434e03f14846 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:47:58.446262 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-2138a5bf-63d9-4cb0-8dc3-434e03f14846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:47:58.563047 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138a5bf-63d9-4cb0-8dc3-434e03f14846 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:47:58.647082 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:47:58.650317 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2c257-4e1b-42ba-9516-f80519615c85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:47:58.651392 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2c257-4e1b-42ba-9516-f80519615c85 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:47:58.651392 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2c257-4e1b-42ba-9516-f80519615c85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:47:58.651563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2c257-4e1b-42ba-9516-f80519615c85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:47:58.653900 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-cad2c257-4e1b-42ba-9516-f80519615c85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:47:58.773307 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad2c257-4e1b-42ba-9516-f80519615c85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:47:58.774773 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad2c257-4e1b-42ba-9516-f80519615c85 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:47:58.798054 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 656/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:47:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:48:01.193806 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf5312-bfc1-42a6-aa21-8132d95a6e72 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:01.194709 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf5312-bfc1-42a6-aa21-8132d95a6e72 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:01.194709 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf5312-bfc1-42a6-aa21-8132d95a6e72 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:01.197092 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 659/1315] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:48:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:48:01.204004 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c26ea6-4b32-484e-8d18-9012118a7e00 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:01.204720 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c26ea6-4b32-484e-8d18-9012118a7e00 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:01.204884 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c26ea6-4b32-484e-8d18-9012118a7e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:01.280314 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d0c26ea6-4b32-484e-8d18-9012118a7e00 None None] MFA Rules not processed for user `915c0bffe1874fe6a9640f49dbeefe61`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:48:01.281537 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d0c26ea6-4b32-484e-8d18-9012118a7e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:01.339486 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:48:01.390082 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 657/1316] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:48:01 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:48:01.431872 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf5312-bfc1-42a6-aa21-8132d95a6e72 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:48:01.433355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-53cf5312-bfc1-42a6-aa21-8132d95a6e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:01.444213 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:48:01.551024 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf5312-bfc1-42a6-aa21-8132d95a6e72 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:48:01.628933 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7fe9fa-1db4-47d8-96a8-3fdd628590e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:48:01.629583 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fe9fa-1db4-47d8-96a8-3fdd628590e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:01.629865 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fe9fa-1db4-47d8-96a8-3fdd628590e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:01.630142 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fe9fa-1db4-47d8-96a8-3fdd628590e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:01.631810 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1d7fe9fa-1db4-47d8-96a8-3fdd628590e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:01.702645 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:48:01.751222 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7fe9fa-1db4-47d8-96a8-3fdd628590e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:48:01.752695 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7fe9fa-1db4-47d8-96a8-3fdd628590e8 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:48:01.770947 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 660/1317] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:48:01 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:48:04.313919 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d915f02-b317-449e-8184-cb0cebc5b2cc None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:04.314940 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d915f02-b317-449e-8184-cb0cebc5b2cc None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:04.314940 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d915f02-b317-449e-8184-cb0cebc5b2cc None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:04.317082 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 658/1318] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:48:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:48:04.326079 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6fa15-7d19-4140-a055-633b23cb7fd9 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:04.326576 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6fa15-7d19-4140-a055-633b23cb7fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:04.327061 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6fa15-7d19-4140-a055-633b23cb7fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:04.401997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-3ff6fa15-7d19-4140-a055-633b23cb7fd9 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:48:04.403208 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3ff6fa15-7d19-4140-a055-633b23cb7fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:04.513707 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 661/1319] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:48:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:48:04.565511 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb82d2-c9aa-4723-bfeb-80781fcd740c None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:04.565717 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb82d2-c9aa-4723-bfeb-80781fcd740c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:04.565980 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb82d2-c9aa-4723-bfeb-80781fcd740c None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:04.567445 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 659/1320] 10.222.0.16 () {54 vars in 964 bytes} [Mon Jul 4 05:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:48:04.575094 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266ca7f-6362-472e-9440-fd54141dd11f None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:04.575411 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266ca7f-6362-472e-9440-fd54141dd11f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:04.575691 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266ca7f-6362-472e-9440-fd54141dd11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:04.597133 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:48:04.653560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9266ca7f-6362-472e-9440-fd54141dd11f None None] MFA Rules not processed for user `5e5be3de52e945d3af1b2cad1c84c755`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:48:04.654769 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9266ca7f-6362-472e-9440-fd54141dd11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:04.731657 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 662/1321] 10.222.0.16 () {58 vars in 1061 bytes} [Mon Jul 4 05:48:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:48:04.745220 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb82d2-c9aa-4723-bfeb-80781fcd740c None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:48:04.746735 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9deb82d2-c9aa-4723-bfeb-80781fcd740c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:04.856129 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb82d2-c9aa-4723-bfeb-80781fcd740c None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:48:04.930348 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d316347-f30d-4b4a-b7de-175e7040970b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:48:04.931000 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d316347-f30d-4b4a-b7de-175e7040970b service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:04.931270 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d316347-f30d-4b4a-b7de-175e7040970b service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:04.931672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d316347-f30d-4b4a-b7de-175e7040970b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:04.933319 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-8d316347-f30d-4b4a-b7de-175e7040970b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:04.941180 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:48:05.043324 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d316347-f30d-4b4a-b7de-175e7040970b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:48:05.044899 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d316347-f30d-4b4a-b7de-175e7040970b service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:48:05.063555 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 660/1322] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:48:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:48:08.198942 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334c043-2c5f-42b6-8d30-37b1a8b29256 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:08.199582 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334c043-2c5f-42b6-8d30-37b1a8b29256 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:08.199582 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334c043-2c5f-42b6-8d30-37b1a8b29256 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:08.201085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 663/1323] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:48:08.206144 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea3fc6-ad58-4b71-8605-0fd37d0caaec None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:08.206563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea3fc6-ad58-4b71-8605-0fd37d0caaec None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:08.206717 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea3fc6-ad58-4b71-8605-0fd37d0caaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:08.272181 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-36ea3fc6-ad58-4b71-8605-0fd37d0caaec None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:48:08.273425 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-36ea3fc6-ad58-4b71-8605-0fd37d0caaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:08.333512 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:48:08.379409 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 661/1324] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:48:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:48:08.415515 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334c043-2c5f-42b6-8d30-37b1a8b29256 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:48:08.417214 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c334c043-2c5f-42b6-8d30-37b1a8b29256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:08.527906 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334c043-2c5f-42b6-8d30-37b1a8b29256 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:48:08.540703 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:48:08.604874 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d4bfc-e374-4d66-8066-66d8568030d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:48:08.605525 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d4bfc-e374-4d66-8066-66d8568030d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:08.605805 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d4bfc-e374-4d66-8066-66d8568030d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:08.606083 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d4bfc-e374-4d66-8066-66d8568030d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:08.607746 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-aa2d4bfc-e374-4d66-8066-66d8568030d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:08.717371 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d4bfc-e374-4d66-8066-66d8568030d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:48:08.718825 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d4bfc-e374-4d66-8066-66d8568030d5 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:48:08.737618 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 664/1325] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:48:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:48:10.790286 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478e151-a1fa-4450-8c3d-16adcd531c3a None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:10.790945 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478e151-a1fa-4450-8c3d-16adcd531c3a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:10.790945 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478e151-a1fa-4450-8c3d-16adcd531c3a None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:10.792423 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 662/1326] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:48:10.797723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39428fc-9933-435d-8c50-706e3c9a2917 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:10.798188 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39428fc-9933-435d-8c50-706e3c9a2917 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:10.798285 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39428fc-9933-435d-8c50-706e3c9a2917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:10.845331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:48:10.864742 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d39428fc-9933-435d-8c50-706e3c9a2917 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:48:10.865970 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d39428fc-9933-435d-8c50-706e3c9a2917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:10.964553 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 665/1327] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:48:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:48:11.000181 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478e151-a1fa-4450-8c3d-16adcd531c3a None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:48:11.001766 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-3478e151-a1fa-4450-8c3d-16adcd531c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:11.107240 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478e151-a1fa-4450-8c3d-16adcd531c3a None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:48:11.188035 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47680d-f5b9-44ff-a84e-e45b8a88d592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:48:11.188687 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47680d-f5b9-44ff-a84e-e45b8a88d592 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:11.188968 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47680d-f5b9-44ff-a84e-e45b8a88d592 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:11.189232 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47680d-f5b9-44ff-a84e-e45b8a88d592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:11.190850 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-1b47680d-f5b9-44ff-a84e-e45b8a88d592 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:11.208093 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:48:11.304417 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47680d-f5b9-44ff-a84e-e45b8a88d592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:48:11.305875 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47680d-f5b9-44ff-a84e-e45b8a88d592 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:48:11.325188 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 663/1328] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:48:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:48:13.379210 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce8889-519f-4630-87a8-4ae12839764f None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:13.379765 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce8889-519f-4630-87a8-4ae12839764f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:13.379765 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce8889-519f-4630-87a8-4ae12839764f None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:13.381186 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 666/1329] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:48:13.386548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a6f4c-2616-4fcb-9156-e32d2e2dc47d None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:13.387014 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a6f4c-2616-4fcb-9156-e32d2e2dc47d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:13.387110 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a6f4c-2616-4fcb-9156-e32d2e2dc47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:13.459339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-fd3a6f4c-2616-4fcb-9156-e32d2e2dc47d None None] MFA Rules not processed for user `915c0bffe1874fe6a9640f49dbeefe61`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:48:13.460488 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-fd3a6f4c-2616-4fcb-9156-e32d2e2dc47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:13.529569 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:48:13.567722 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 664/1330] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:48:13 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:48:13.604805 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce8889-519f-4630-87a8-4ae12839764f None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:48:13.606342 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b6ce8889-519f-4630-87a8-4ae12839764f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:13.716430 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce8889-519f-4630-87a8-4ae12839764f None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:48:13.737841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:48:13.794552 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c1969-12f4-4125-a1be-90a302785494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:48:13.795221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c1969-12f4-4125-a1be-90a302785494 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:13.795497 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c1969-12f4-4125-a1be-90a302785494 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:13.795792 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c1969-12f4-4125-a1be-90a302785494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:13.797418 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-787c1969-12f4-4125-a1be-90a302785494 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:13.912239 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c1969-12f4-4125-a1be-90a302785494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:48:13.913744 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c1969-12f4-4125-a1be-90a302785494 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:48:13.938329 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 667/1331] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:48:13 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:48:16.263375 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c937d-fd39-47dd-8048-43b64e9e4008 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:16.264434 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c937d-fd39-47dd-8048-43b64e9e4008 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:16.264434 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c937d-fd39-47dd-8048-43b64e9e4008 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:16.266526 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 665/1332] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:48:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:48:16.272030 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8950d2-e7ed-433f-a71d-a5fe3e58e9cc None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:16.272486 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8950d2-e7ed-433f-a71d-a5fe3e58e9cc None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:16.272592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8950d2-e7ed-433f-a71d-a5fe3e58e9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:16.339978 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:48:16.342802 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9a8950d2-e7ed-433f-a71d-a5fe3e58e9cc None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:48:16.345753 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9a8950d2-e7ed-433f-a71d-a5fe3e58e9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:16.466670 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 668/1333] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:48:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:48:16.506320 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c937d-fd39-47dd-8048-43b64e9e4008 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:48:16.508874 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-558c937d-fd39-47dd-8048-43b64e9e4008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:16.643463 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c937d-fd39-47dd-8048-43b64e9e4008 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:48:16.718463 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c4dcc-4875-4612-ac4e-eea6ab29db97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:48:16.719100 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c4dcc-4875-4612-ac4e-eea6ab29db97 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:16.719417 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c4dcc-4875-4612-ac4e-eea6ab29db97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:16.719697 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c4dcc-4875-4612-ac4e-eea6ab29db97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:16.721346 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-af4c4dcc-4875-4612-ac4e-eea6ab29db97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:16.757630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:48:16.841730 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c4dcc-4875-4612-ac4e-eea6ab29db97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:48:16.843224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c4dcc-4875-4612-ac4e-eea6ab29db97 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:48:16.861931 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 666/1334] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:48:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:48:18.929795 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db59eff-3c8c-4ec5-8d50-7eb4c312406c None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:18.930327 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db59eff-3c8c-4ec5-8d50-7eb4c312406c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:18.930327 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db59eff-3c8c-4ec5-8d50-7eb4c312406c None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:18.931825 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 669/1335] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:48:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:48:18.938160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34acd76-c45e-4edd-b70b-c66d23b7c53d None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:18.938927 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34acd76-c45e-4edd-b70b-c66d23b7c53d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:18.939080 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34acd76-c45e-4edd-b70b-c66d23b7c53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:19.010224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-f34acd76-c45e-4edd-b70b-c66d23b7c53d None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:48:19.011469 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f34acd76-c45e-4edd-b70b-c66d23b7c53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:19.094426 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:48:19.118070 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 667/1336] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:48:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:48:19.161718 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db59eff-3c8c-4ec5-8d50-7eb4c312406c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:48:19.163291 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4db59eff-3c8c-4ec5-8d50-7eb4c312406c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:19.287157 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db59eff-3c8c-4ec5-8d50-7eb4c312406c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:48:19.318113 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:48:19.365561 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3056b-8ead-45d9-9f3a-5166056b56c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:48:19.366207 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3056b-8ead-45d9-9f3a-5166056b56c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:19.366489 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3056b-8ead-45d9-9f3a-5166056b56c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:19.366761 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3056b-8ead-45d9-9f3a-5166056b56c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:19.368525 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-71e3056b-8ead-45d9-9f3a-5166056b56c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:19.489943 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3056b-8ead-45d9-9f3a-5166056b56c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:48:19.491347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3056b-8ead-45d9-9f3a-5166056b56c4 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:48:19.509336 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 670/1337] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:48:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:48:21.821975 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f268e8d-398e-4175-a6f4-f83bad1bde7e None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:21.822856 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f268e8d-398e-4175-a6f4-f83bad1bde7e None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:21.822856 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f268e8d-398e-4175-a6f4-f83bad1bde7e None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:21.824973 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 668/1338] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:48:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:48:21.833540 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845c4f1-3d2a-431d-b0a7-37b561bea8c4 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:21.834018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845c4f1-3d2a-431d-b0a7-37b561bea8c4 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:21.834121 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845c4f1-3d2a-431d-b0a7-37b561bea8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:21.909039 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-3845c4f1-3d2a-431d-b0a7-37b561bea8c4 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:48:21.910246 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3845c4f1-3d2a-431d-b0a7-37b561bea8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:21.918691 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:48:22.019254 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 671/1339] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:48:21 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:48:22.072301 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f268e8d-398e-4175-a6f4-f83bad1bde7e None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:48:22.074633 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-6f268e8d-398e-4175-a6f4-f83bad1bde7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:22.188975 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f268e8d-398e-4175-a6f4-f83bad1bde7e None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:48:22.272337 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d86ba5-70bf-4f58-a9a0-6778dd6e8231 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:48:22.272987 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d86ba5-70bf-4f58-a9a0-6778dd6e8231 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:22.273268 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d86ba5-70bf-4f58-a9a0-6778dd6e8231 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:22.273536 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d86ba5-70bf-4f58-a9a0-6778dd6e8231 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:22.275297 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-11d86ba5-70bf-4f58-a9a0-6778dd6e8231 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:22.315160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:48:22.391908 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d86ba5-70bf-4f58-a9a0-6778dd6e8231 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:48:22.393309 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d86ba5-70bf-4f58-a9a0-6778dd6e8231 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:48:22.411455 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 669/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:48:22 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:48:26.512874 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be97f59-bf5a-4f53-8968-8715a6f52a84 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:26.513431 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be97f59-bf5a-4f53-8968-8715a6f52a84 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:26.513431 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be97f59-bf5a-4f53-8968-8715a6f52a84 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:26.514778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 672/1341] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:48:26.520365 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e97c3-5c5c-4d65-bcb7-923aa77ebf41 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:26.520798 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e97c3-5c5c-4d65-bcb7-923aa77ebf41 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:26.520886 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e97c3-5c5c-4d65-bcb7-923aa77ebf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:26.595142 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-408e97c3-5c5c-4d65-bcb7-923aa77ebf41 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:48:26.596300 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-408e97c3-5c5c-4d65-bcb7-923aa77ebf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:26.692840 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:48:26.705688 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 670/1342] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:48:26.744672 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be97f59-bf5a-4f53-8968-8715a6f52a84 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:48:26.747225 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0be97f59-bf5a-4f53-8968-8715a6f52a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:26.846335 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be97f59-bf5a-4f53-8968-8715a6f52a84 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:48:26.850124 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae57704-4e6a-4dd4-8d63-b8f7be4ad7c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:48:26.850771 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae57704-4e6a-4dd4-8d63-b8f7be4ad7c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:26.851049 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae57704-4e6a-4dd4-8d63-b8f7be4ad7c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:26.851342 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae57704-4e6a-4dd4-8d63-b8f7be4ad7c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:26.860287 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae57704-4e6a-4dd4-8d63-b8f7be4ad7c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:48:26.862047 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae57704-4e6a-4dd4-8d63-b8f7be4ad7c2 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:48:26.871227 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 673/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:48:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:48:29.503489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4e06a-07d5-476d-bf9f-631021eb5e66 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:29.504084 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4e06a-07d5-476d-bf9f-631021eb5e66 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:29.504084 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4e06a-07d5-476d-bf9f-631021eb5e66 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:29.505430 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 671/1344] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:48:29.510871 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f413b81-8336-4c86-92f2-cf9ca6bd2621 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:29.511305 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f413b81-8336-4c86-92f2-cf9ca6bd2621 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:29.511497 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f413b81-8336-4c86-92f2-cf9ca6bd2621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:29.547701 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-2f413b81-8336-4c86-92f2-cf9ca6bd2621 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:48:29.548917 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2f413b81-8336-4c86-92f2-cf9ca6bd2621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:29.580890 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:48:29.636126 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 674/1345] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:48:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:48:29.674488 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4e06a-07d5-476d-bf9f-631021eb5e66 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:48:29.690182 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4e06a-07d5-476d-bf9f-631021eb5e66 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:48:29.695045 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe5e6e-8563-42f3-9ef6-e886baa5400d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:48:29.695754 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe5e6e-8563-42f3-9ef6-e886baa5400d service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:29.696039 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe5e6e-8563-42f3-9ef6-e886baa5400d service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:29.696312 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe5e6e-8563-42f3-9ef6-e886baa5400d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:29.716129 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe5e6e-8563-42f3-9ef6-e886baa5400d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:48:29.718757 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe5e6e-8563-42f3-9ef6-e886baa5400d service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:48:29.731127 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 672/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:48:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 05:48:33.852102 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd66085-306b-4dcd-b4e4-879aca969287 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:33.852537 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd66085-306b-4dcd-b4e4-879aca969287 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:33.852537 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd66085-306b-4dcd-b4e4-879aca969287 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:33.853886 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 675/1347] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:48:33.859276 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ce47c-2d18-4df0-879e-72b1d21417a2 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:33.859720 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ce47c-2d18-4df0-879e-72b1d21417a2 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:33.859992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ce47c-2d18-4df0-879e-72b1d21417a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:33.878139 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-8c4ce47c-2d18-4df0-879e-72b1d21417a2 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:48:33.879369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-8c4ce47c-2d18-4df0-879e-72b1d21417a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:33.887273 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 673/1348] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:48:33.927015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd66085-306b-4dcd-b4e4-879aca969287 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:48:33.928943 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-bdd66085-306b-4dcd-b4e4-879aca969287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:33.943490 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd66085-306b-4dcd-b4e4-879aca969287 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:48:33.947913 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c59035-eff4-4957-bc64-80538f6851cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:48:33.948567 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c59035-eff4-4957-bc64-80538f6851cd service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:33.948847 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c59035-eff4-4957-bc64-80538f6851cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:33.949122 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c59035-eff4-4957-bc64-80538f6851cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:33.958216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c59035-eff4-4957-bc64-80538f6851cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:48:33.959702 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c59035-eff4-4957-bc64-80538f6851cd service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:48:33.968968 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 676/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:48:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:48:38.930261 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe24bf-9bbf-4169-94ab-b4142acdf1f5 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:38.930768 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe24bf-9bbf-4169-94ab-b4142acdf1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:38.930768 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe24bf-9bbf-4169-94ab-b4142acdf1f5 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:38.932484 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 674/1350] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jul 4 05:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:48:38.938130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5df1c6-6a5c-4402-b124-f0cb99881bbe None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:38.939171 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5df1c6-6a5c-4402-b124-f0cb99881bbe None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:38.939798 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5df1c6-6a5c-4402-b124-f0cb99881bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:39.019797 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-aa5df1c6-6a5c-4402-b124-f0cb99881bbe None None] MFA Rules not processed for user `260f58535f4e46a197d00276d37fd515`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:48:39.021436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-aa5df1c6-6a5c-4402-b124-f0cb99881bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:39.100884 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 677/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jul 4 05:48:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:48:43.350795 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a665e98-d488-4c9f-b13f-ee4a9f27b409 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:43.350795 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a665e98-d488-4c9f-b13f-ee4a9f27b409 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:43.350795 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a665e98-d488-4c9f-b13f-ee4a9f27b409 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:43.350795 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 675/1352] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jul 4 05:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:48:43.355221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9da31-b802-4980-9a46-ed639ee7bc90 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:43.355658 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9da31-b802-4980-9a46-ed639ee7bc90 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:43.355772 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9da31-b802-4980-9a46-ed639ee7bc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:43.374913 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a2b9da31-b802-4980-9a46-ed639ee7bc90 None None] MFA Rules not processed for user `260f58535f4e46a197d00276d37fd515`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:48:43.376305 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a2b9da31-b802-4980-9a46-ed639ee7bc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:43.387308 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 678/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jul 4 05:48:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:48:43.873847 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=13 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:48:44.837706 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ab689-f3af-46cb-9be3-693e1aede8d7 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:44.838387 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ab689-f3af-46cb-9be3-693e1aede8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:44.838387 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ab689-f3af-46cb-9be3-693e1aede8d7 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:44.839936 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 676/1354] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jul 4 05:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:48:44.845136 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060df268-74fa-4a89-bee8-9543e3cde638 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:44.845586 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060df268-74fa-4a89-bee8-9543e3cde638 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:44.845682 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060df268-74fa-4a89-bee8-9543e3cde638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:44.864707 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-060df268-74fa-4a89-bee8-9543e3cde638 None None] MFA Rules not processed for user `260f58535f4e46a197d00276d37fd515`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:48:44.865881 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-060df268-74fa-4a89-bee8-9543e3cde638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:44.875033 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 679/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jul 4 05:48:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:48:48.515919 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b91bcc-f0ad-47d8-bba4-0caf70f2ebea None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:48.516524 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b91bcc-f0ad-47d8-bba4-0caf70f2ebea None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:48.516524 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b91bcc-f0ad-47d8-bba4-0caf70f2ebea None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:48.519352 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 677/1356] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:48:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:48:48.526835 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054013f-60d9-4fa9-9639-9063ebe82610 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:48.526835 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054013f-60d9-4fa9-9639-9063ebe82610 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:48.526835 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054013f-60d9-4fa9-9639-9063ebe82610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:48.551852 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-3054013f-60d9-4fa9-9639-9063ebe82610 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:48:48.553314 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3054013f-60d9-4fa9-9639-9063ebe82610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:48.562682 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 680/1357] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:48:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:48:48.619483 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e12ff9-a1ad-410e-9eb0-18c5b3321c44 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:48.619947 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e12ff9-a1ad-410e-9eb0-18c5b3321c44 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:48.620402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e12ff9-a1ad-410e-9eb0-18c5b3321c44 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:48.622645 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 678/1358] 10.222.0.16 () {54 vars in 961 bytes} [Mon Jul 4 05:48:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:48:48.631381 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df724cde-18b9-4ebd-9efa-782b6fe8720b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:48.631899 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df724cde-18b9-4ebd-9efa-782b6fe8720b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:48.632766 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df724cde-18b9-4ebd-9efa-782b6fe8720b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:48.683112 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:48:48.692245 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-df724cde-18b9-4ebd-9efa-782b6fe8720b None None] MFA Rules not processed for user `6f638cc70c994a529a48cb2c92b70384`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:48:48.693964 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-df724cde-18b9-4ebd-9efa-782b6fe8720b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:48.783441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 681/1359] 10.222.0.16 () {58 vars in 1058 bytes} [Mon Jul 4 05:48:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:48:48.792167 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e12ff9-a1ad-410e-9eb0-18c5b3321c44 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:48:48.807129 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e12ff9-a1ad-410e-9eb0-18c5b3321c44 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:48:48.812483 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6ccf0-88e0-4b03-a1e7-f34f8126d6ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:48:48.813123 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6ccf0-88e0-4b03-a1e7-f34f8126d6ab service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:48.813403 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6ccf0-88e0-4b03-a1e7-f34f8126d6ab service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:48.813676 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6ccf0-88e0-4b03-a1e7-f34f8126d6ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:48.822185 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6ccf0-88e0-4b03-a1e7-f34f8126d6ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:48:48.823806 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6ccf0-88e0-4b03-a1e7-f34f8126d6ab service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:48:48.833855 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 679/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:48:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:48:51.027150 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43945d3b-0c85-4994-86a0-5791645ce90e None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:51.027775 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43945d3b-0c85-4994-86a0-5791645ce90e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:51.027775 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43945d3b-0c85-4994-86a0-5791645ce90e None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:51.031559 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 682/1361] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:48:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:48:51.034176 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2271e44-46e4-403b-beda-c850ace4e8bc None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:51.034617 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2271e44-46e4-403b-beda-c850ace4e8bc None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:51.034726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2271e44-46e4-403b-beda-c850ace4e8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:51.052798 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-b2271e44-46e4-403b-beda-c850ace4e8bc None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:48:51.054059 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b2271e44-46e4-403b-beda-c850ace4e8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:51.062838 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 680/1362] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:48:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:48:51.106316 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43945d3b-0c85-4994-86a0-5791645ce90e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:48:51.122191 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43945d3b-0c85-4994-86a0-5791645ce90e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:48:51.127672 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa10d96-dd10-4d03-b46a-670c038b6f52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:48:51.128305 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa10d96-dd10-4d03-b46a-670c038b6f52 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:51.128579 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa10d96-dd10-4d03-b46a-670c038b6f52 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:51.128850 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa10d96-dd10-4d03-b46a-670c038b6f52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:51.137360 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa10d96-dd10-4d03-b46a-670c038b6f52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:48:51.138959 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa10d96-dd10-4d03-b46a-670c038b6f52 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:48:51.148742 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 683/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:48:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:48:53.471202 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4decb9-937a-4d6d-8079-b7a1795b067f None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:53.472155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4decb9-937a-4d6d-8079-b7a1795b067f None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:53.472570 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4decb9-937a-4d6d-8079-b7a1795b067f None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:53.474286 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 681/1364] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:48:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:48:53.481154 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6b2e6-8493-4798-922f-576e6b8c6f65 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:53.482583 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6b2e6-8493-4798-922f-576e6b8c6f65 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:53.483090 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6b2e6-8493-4798-922f-576e6b8c6f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:53.510895 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-bca6b2e6-8493-4798-922f-576e6b8c6f65 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:48:53.512647 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-bca6b2e6-8493-4798-922f-576e6b8c6f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:53.521023 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 684/1365] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:48:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:48:53.566597 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c5b84-0067-4f42-a3d4-5c200590a7f9 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:53.566884 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c5b84-0067-4f42-a3d4-5c200590a7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:53.567164 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c5b84-0067-4f42-a3d4-5c200590a7f9 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:53.568608 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 682/1366] 10.222.0.16 () {54 vars in 961 bytes} [Mon Jul 4 05:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:48:53.574065 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbf6d2-a582-4933-83b1-5e6222292b7b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:53.574355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbf6d2-a582-4933-83b1-5e6222292b7b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:53.574623 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbf6d2-a582-4933-83b1-5e6222292b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:53.592416 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-ebdbf6d2-a582-4933-83b1-5e6222292b7b None None] MFA Rules not processed for user `6f638cc70c994a529a48cb2c92b70384`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:48:53.593594 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ebdbf6d2-a582-4933-83b1-5e6222292b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:53.602896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 685/1367] 10.222.0.16 () {58 vars in 1058 bytes} [Mon Jul 4 05:48:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:48:53.611375 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c5b84-0067-4f42-a3d4-5c200590a7f9 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:48:53.626150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c5b84-0067-4f42-a3d4-5c200590a7f9 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:48:53.632046 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8603b-a659-4398-b131-d6914c472b19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:48:53.632680 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8603b-a659-4398-b131-d6914c472b19 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:53.632963 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8603b-a659-4398-b131-d6914c472b19 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:53.633239 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8603b-a659-4398-b131-d6914c472b19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:53.641645 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8603b-a659-4398-b131-d6914c472b19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:48:53.643271 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8603b-a659-4398-b131-d6914c472b19 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:48:53.653170 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 683/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:48:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:48:55.745812 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e2551-dfd1-4f5a-adb2-02f5273248c5 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:55.746458 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e2551-dfd1-4f5a-adb2-02f5273248c5 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:55.746458 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e2551-dfd1-4f5a-adb2-02f5273248c5 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:55.747923 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 686/1369] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:48:55.754185 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edda72-4d77-492f-969a-61fd43cdc996 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:55.754740 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edda72-4d77-492f-969a-61fd43cdc996 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:55.754740 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edda72-4d77-492f-969a-61fd43cdc996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:55.774538 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-91edda72-4d77-492f-969a-61fd43cdc996 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:48:55.775775 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-91edda72-4d77-492f-969a-61fd43cdc996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:55.784532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 684/1370] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:48:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:48:55.828216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e2551-dfd1-4f5a-adb2-02f5273248c5 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:48:55.844921 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e2551-dfd1-4f5a-adb2-02f5273248c5 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:48:55.853288 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8704978-5534-4ad2-bf8b-420e241f6581 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:48:55.854029 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8704978-5534-4ad2-bf8b-420e241f6581 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:55.854396 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8704978-5534-4ad2-bf8b-420e241f6581 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:55.854733 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8704978-5534-4ad2-bf8b-420e241f6581 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:55.864249 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8704978-5534-4ad2-bf8b-420e241f6581 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:48:55.865977 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8704978-5534-4ad2-bf8b-420e241f6581 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:48:55.876172 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 687/1371] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:48:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:48:56.431173 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5d722-c7ea-4dc6-8183-84bf43a0182e None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:56.431495 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5d722-c7ea-4dc6-8183-84bf43a0182e None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:56.432002 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5d722-c7ea-4dc6-8183-84bf43a0182e None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:56.433379 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 685/1372] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:48:56.438868 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cf1cd-195e-4246-b256-ef538990b394 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:56.439113 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cf1cd-195e-4246-b256-ef538990b394 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:56.439462 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cf1cd-195e-4246-b256-ef538990b394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:56.457903 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-5e6cf1cd-195e-4246-b256-ef538990b394 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:48:56.459089 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5e6cf1cd-195e-4246-b256-ef538990b394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:56.468210 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 688/1373] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:48:56.806355 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca0344-0ca0-4a4b-b0e5-9d3db21860e1 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:56.806355 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca0344-0ca0-4a4b-b0e5-9d3db21860e1 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:56.806355 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca0344-0ca0-4a4b-b0e5-9d3db21860e1 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:56.809205 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 686/1374] 10.222.0.16 () {54 vars in 963 bytes} [Mon Jul 4 05:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:48:56.812181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3477c5-ebe0-41f9-8da0-c707beda4493 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:56.812614 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3477c5-ebe0-41f9-8da0-c707beda4493 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:56.812717 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3477c5-ebe0-41f9-8da0-c707beda4493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:56.866998 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-7a3477c5-ebe0-41f9-8da0-c707beda4493 None None] MFA Rules not processed for user `8103fdfbdcf449a49e770750876bbee3`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:48:56.868340 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7a3477c5-ebe0-41f9-8da0-c707beda4493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:56.941688 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 689/1375] 10.222.0.16 () {58 vars in 1060 bytes} [Mon Jul 4 05:48:56 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:48:56.949513 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca0344-0ca0-4a4b-b0e5-9d3db21860e1 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:48:56.961574 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca0344-0ca0-4a4b-b0e5-9d3db21860e1 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:48:56.965624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c6705-6ce5-4aad-a8b3-9de1ce9acc0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:48:56.966463 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c6705-6ce5-4aad-a8b3-9de1ce9acc0d service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:56.966936 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c6705-6ce5-4aad-a8b3-9de1ce9acc0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:56.967437 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c6705-6ce5-4aad-a8b3-9de1ce9acc0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:56.978408 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c6705-6ce5-4aad-a8b3-9de1ce9acc0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:48:56.980114 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c6705-6ce5-4aad-a8b3-9de1ce9acc0d service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:48:56.994028 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 687/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:48:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:48:57.902981 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bdb58-a772-4b40-9311-b981a458f142 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:57.903636 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bdb58-a772-4b40-9311-b981a458f142 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:57.903729 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bdb58-a772-4b40-9311-b981a458f142 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:57.905066 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 690/1377] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:48:57.910340 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af9549-7839-4025-951c-cb20629a8d2c None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:57.910751 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af9549-7839-4025-951c-cb20629a8d2c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:57.910888 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af9549-7839-4025-951c-cb20629a8d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:57.928640 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-a2af9549-7839-4025-951c-cb20629a8d2c None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:48:57.929816 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-a2af9549-7839-4025-951c-cb20629a8d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:48:57.938122 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 688/1378] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:48:57.980883 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bdb58-a772-4b40-9311-b981a458f142 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:48:57.996620 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bdb58-a772-4b40-9311-b981a458f142 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:48:58.002445 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c0393-e175-4ece-8c7f-d5493a033d4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:48:58.003075 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c0393-e175-4ece-8c7f-d5493a033d4e service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:48:58.003392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c0393-e175-4ece-8c7f-d5493a033d4e service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:48:58.003673 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c0393-e175-4ece-8c7f-d5493a033d4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:48:58.011844 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c0393-e175-4ece-8c7f-d5493a033d4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:48:58.013419 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c0393-e175-4ece-8c7f-d5493a033d4e service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:48:58.017220 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:48:58.023963 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 691/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:48:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:49:00.049317 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c02bb-9182-429d-a6c3-2e4a42639ac7 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:00.049836 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c02bb-9182-429d-a6c3-2e4a42639ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:00.049836 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c02bb-9182-429d-a6c3-2e4a42639ac7 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:00.051130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 689/1380] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:49:00.056610 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf14d98-6d86-4f2a-a2fd-2b7b077a17f9 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:00.057009 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf14d98-6d86-4f2a-a2fd-2b7b077a17f9 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:00.057271 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf14d98-6d86-4f2a-a2fd-2b7b077a17f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:00.075856 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-1cf14d98-6d86-4f2a-a2fd-2b7b077a17f9 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:49:00.077053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1cf14d98-6d86-4f2a-a2fd-2b7b077a17f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:49:00.085960 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 692/1381] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:49:00.129147 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c02bb-9182-429d-a6c3-2e4a42639ac7 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:49:00.144006 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c02bb-9182-429d-a6c3-2e4a42639ac7 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:49:00.149787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee7f96-6c74-46d6-ab1e-601898ab4f0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:49:00.150424 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee7f96-6c74-46d6-ab1e-601898ab4f0e service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:00.150706 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee7f96-6c74-46d6-ab1e-601898ab4f0e service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:00.150983 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee7f96-6c74-46d6-ab1e-601898ab4f0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:00.159557 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee7f96-6c74-46d6-ab1e-601898ab4f0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:49:00.161153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee7f96-6c74-46d6-ab1e-601898ab4f0e service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:49:00.170824 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 690/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:49:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 05:49:02.224152 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b00940-285c-4eb5-90b8-40be1da64f2a None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:02.224729 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b00940-285c-4eb5-90b8-40be1da64f2a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:02.224729 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b00940-285c-4eb5-90b8-40be1da64f2a None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:02.226077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 693/1383] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:49:02.231577 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafb8be-d04e-4828-890a-6d9cb28a1d6a None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:02.232037 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafb8be-d04e-4828-890a-6d9cb28a1d6a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:02.232147 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafb8be-d04e-4828-890a-6d9cb28a1d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:02.252657 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-abafb8be-d04e-4828-890a-6d9cb28a1d6a None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:49:02.253884 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-abafb8be-d04e-4828-890a-6d9cb28a1d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:49:02.262917 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 691/1384] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:49:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:49:02.307336 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b00940-285c-4eb5-90b8-40be1da64f2a None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:49:02.323097 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b00940-285c-4eb5-90b8-40be1da64f2a None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:49:02.330575 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eefcfbd-c1b0-4f56-9cd7-ef4fe40a0b53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:49:02.331359 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefcfbd-c1b0-4f56-9cd7-ef4fe40a0b53 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:02.331811 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefcfbd-c1b0-4f56-9cd7-ef4fe40a0b53 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:02.332155 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefcfbd-c1b0-4f56-9cd7-ef4fe40a0b53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:02.341163 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eefcfbd-c1b0-4f56-9cd7-ef4fe40a0b53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:49:02.342907 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eefcfbd-c1b0-4f56-9cd7-ef4fe40a0b53 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:49:02.353890 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 694/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:49:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 05:49:04.429690 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db917ff-3e36-4b83-8d30-c8557f5303a6 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:04.430255 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db917ff-3e36-4b83-8d30-c8557f5303a6 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:04.430255 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db917ff-3e36-4b83-8d30-c8557f5303a6 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:04.431586 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 692/1386] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:49:04.437131 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837b557-6320-48e7-8747-76613287e5ca None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:04.437569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837b557-6320-48e7-8747-76613287e5ca None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:04.437683 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837b557-6320-48e7-8747-76613287e5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:04.455491 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-b837b557-6320-48e7-8747-76613287e5ca None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:49:04.456679 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b837b557-6320-48e7-8747-76613287e5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:49:04.465117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 695/1387] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:49:04.519673 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db917ff-3e36-4b83-8d30-c8557f5303a6 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:49:04.536137 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db917ff-3e36-4b83-8d30-c8557f5303a6 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:49:04.542512 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca10df-3bc3-45b0-a204-4ed0a70e3102 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:49:04.543166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca10df-3bc3-45b0-a204-4ed0a70e3102 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:04.543473 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca10df-3bc3-45b0-a204-4ed0a70e3102 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:04.543749 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca10df-3bc3-45b0-a204-4ed0a70e3102 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:04.553322 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca10df-3bc3-45b0-a204-4ed0a70e3102 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:49:04.555495 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca10df-3bc3-45b0-a204-4ed0a70e3102 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:49:04.564991 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 693/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:49:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:49:06.580528 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1edf9d-75da-4f44-a962-8be0723627d0 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:06.581365 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1edf9d-75da-4f44-a962-8be0723627d0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:06.581365 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1edf9d-75da-4f44-a962-8be0723627d0 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:06.582521 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 696/1389] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:49:06.587864 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c51da9-3bd5-4a6f-b496-0e8fbb58f456 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:06.588326 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c51da9-3bd5-4a6f-b496-0e8fbb58f456 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:06.588428 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c51da9-3bd5-4a6f-b496-0e8fbb58f456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:06.609998 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-22c51da9-3bd5-4a6f-b496-0e8fbb58f456 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:49:06.612290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-22c51da9-3bd5-4a6f-b496-0e8fbb58f456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:49:06.626654 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 694/1390] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:49:06.669171 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1edf9d-75da-4f44-a962-8be0723627d0 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:49:06.685674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1edf9d-75da-4f44-a962-8be0723627d0 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:49:06.691108 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0e972-f27b-4753-9d42-a416b741e2df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:49:06.691797 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0e972-f27b-4753-9d42-a416b741e2df service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:06.692077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0e972-f27b-4753-9d42-a416b741e2df service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:06.692348 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0e972-f27b-4753-9d42-a416b741e2df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:06.701097 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b0e972-f27b-4753-9d42-a416b741e2df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:49:06.702735 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b0e972-f27b-4753-9d42-a416b741e2df service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:49:06.712452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 697/1391] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:49:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:49:09.071386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c5245-bbd9-4bb8-b543-6cca021f745d None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:09.071974 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c5245-bbd9-4bb8-b543-6cca021f745d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:09.072129 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c5245-bbd9-4bb8-b543-6cca021f745d None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:09.074170 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 695/1392] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:49:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:49:09.081047 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cd1c4-1ee7-4e24-b739-70e7b4ddec50 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:09.081509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cd1c4-1ee7-4e24-b739-70e7b4ddec50 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:09.081608 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cd1c4-1ee7-4e24-b739-70e7b4ddec50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:09.101064 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-f42cd1c4-1ee7-4e24-b739-70e7b4ddec50 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:49:09.102267 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f42cd1c4-1ee7-4e24-b739-70e7b4ddec50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:49:09.111382 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 698/1393] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:49:09.157546 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c5245-bbd9-4bb8-b543-6cca021f745d None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:49:09.173809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c5245-bbd9-4bb8-b543-6cca021f745d None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:49:09.179635 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a1b7a-4fbd-4406-b9fb-46281986597d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:49:09.180281 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a1b7a-4fbd-4406-b9fb-46281986597d service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:09.180565 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a1b7a-4fbd-4406-b9fb-46281986597d service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:09.180864 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a1b7a-4fbd-4406-b9fb-46281986597d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:09.191412 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a1b7a-4fbd-4406-b9fb-46281986597d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:49:09.193596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a1b7a-4fbd-4406-b9fb-46281986597d service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:49:09.205303 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 696/1394] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:49:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:49:11.392918 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4911b5-a4da-48f1-b891-e20a7a047284 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:11.393518 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4911b5-a4da-48f1-b891-e20a7a047284 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:11.393518 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4911b5-a4da-48f1-b891-e20a7a047284 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:11.394857 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 699/1395] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:49:11.400155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057f62c-c55e-42f4-904d-e527aa9723b6 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:11.400605 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057f62c-c55e-42f4-904d-e527aa9723b6 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:11.400712 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057f62c-c55e-42f4-904d-e527aa9723b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:11.418678 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d057f62c-c55e-42f4-904d-e527aa9723b6 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:49:11.419905 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d057f62c-c55e-42f4-904d-e527aa9723b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:49:11.428377 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 697/1396] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:49:11.471809 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4911b5-a4da-48f1-b891-e20a7a047284 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:49:11.487397 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4911b5-a4da-48f1-b891-e20a7a047284 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:49:11.494002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb449d3-6c37-4b9e-814d-b24640f00e7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:49:11.494646 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb449d3-6c37-4b9e-814d-b24640f00e7b service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:11.494928 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb449d3-6c37-4b9e-814d-b24640f00e7b service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:11.495228 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb449d3-6c37-4b9e-814d-b24640f00e7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:11.503663 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb449d3-6c37-4b9e-814d-b24640f00e7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:49:11.505252 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb449d3-6c37-4b9e-814d-b24640f00e7b service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:49:11.514665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 700/1397] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:49:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:49:11.926147 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe5b17-68a7-418d-b835-06790ac48529 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:11.926544 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe5b17-68a7-418d-b835-06790ac48529 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:11.926827 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe5b17-68a7-418d-b835-06790ac48529 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:11.928443 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 698/1398] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:49:11.934103 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d54d8-126f-43ba-9662-818d5b04f12f None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:11.934387 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d54d8-126f-43ba-9662-818d5b04f12f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:11.934661 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d54d8-126f-43ba-9662-818d5b04f12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:11.955706 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-0b3d54d8-126f-43ba-9662-818d5b04f12f None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:49:11.956943 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0b3d54d8-126f-43ba-9662-818d5b04f12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:49:11.966013 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 701/1399] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:49:12.021750 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0614764-dd8e-410e-830e-628c4b4120ef None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:12.022036 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0614764-dd8e-410e-830e-628c4b4120ef None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:12.022313 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0614764-dd8e-410e-830e-628c4b4120ef None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:12.023741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 699/1400] 10.222.0.16 () {54 vars in 962 bytes} [Mon Jul 4 05:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:49:12.029281 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a8ebb-a10b-4488-98d2-90ff20469ec8 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:12.029657 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a8ebb-a10b-4488-98d2-90ff20469ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:12.029997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a8ebb-a10b-4488-98d2-90ff20469ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:12.081084 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6b3a8ebb-a10b-4488-98d2-90ff20469ec8 None None] MFA Rules not processed for user `77f0477631724d7f9c8ba752ba27866d`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:49:12.082306 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6b3a8ebb-a10b-4488-98d2-90ff20469ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:49:12.144310 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 702/1401] 10.222.0.16 () {58 vars in 1059 bytes} [Mon Jul 4 05:49:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:49:12.152075 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0614764-dd8e-410e-830e-628c4b4120ef None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:49:12.162678 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0614764-dd8e-410e-830e-628c4b4120ef None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:49:12.166166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff814a12-5d0a-445a-aa5f-04169fc00b8b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77f0477631724d7f9c8ba752ba27866d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:49:12.166817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff814a12-5d0a-445a-aa5f-04169fc00b8b service glance] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:12.167097 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff814a12-5d0a-445a-aa5f-04169fc00b8b service glance] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:12.167371 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff814a12-5d0a-445a-aa5f-04169fc00b8b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:12.176514 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff814a12-5d0a-445a-aa5f-04169fc00b8b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:49:12.177882 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff814a12-5d0a-445a-aa5f-04169fc00b8b service glance] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:49:12.187496 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 700/1402] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:49:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:49:12.917752 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec578734-c3d2-42c6-bf12-293531705ab7 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:12.918272 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec578734-c3d2-42c6-bf12-293531705ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:12.918359 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec578734-c3d2-42c6-bf12-293531705ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:12.968121 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-ec578734-c3d2-42c6-bf12-293531705ab7 None None] MFA Rules not processed for user `3ed779ae7e0f4c90aaed6d1f9e86a4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:49:12.969357 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ec578734-c3d2-42c6-bf12-293531705ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:49:13.010730 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:49:13.035778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 703/1403] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jul 4 05:49:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:49:13.077825 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeecad7-920f-426a-99d2-54ff28ab2c44 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:13.078345 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeecad7-920f-426a-99d2-54ff28ab2c44 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:13.078446 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeecad7-920f-426a-99d2-54ff28ab2c44 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:13.080027 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 701/1404] 10.222.0.16 () {54 vars in 942 bytes} [Mon Jul 4 05:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:49:13.086799 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489dd1d-0cb0-4ff3-afbc-e3bae4121ce8 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:13.087086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489dd1d-0cb0-4ff3-afbc-e3bae4121ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:13.087393 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489dd1d-0cb0-4ff3-afbc-e3bae4121ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:13.138712 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9489dd1d-0cb0-4ff3-afbc-e3bae4121ce8 None None] MFA Rules not processed for user `e55a1c343c60428db2d9e5e6ed865e21`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:49:13.139953 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9489dd1d-0cb0-4ff3-afbc-e3bae4121ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:49:13.214528 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 704/1405] 10.222.0.16 () {58 vars in 1039 bytes} [Mon Jul 4 05:49:13 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:49:13.223691 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeecad7-920f-426a-99d2-54ff28ab2c44 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:49:13.237344 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeecad7-920f-426a-99d2-54ff28ab2c44 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:49:13.242512 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a58a43-a60b-4638-a4b0-28018e41403c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55a1c343c60428db2d9e5e6ed865e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:49:13.243256 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a58a43-a60b-4638-a4b0-28018e41403c service swift] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:13.243602 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a58a43-a60b-4638-a4b0-28018e41403c service swift] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:13.243943 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a58a43-a60b-4638-a4b0-28018e41403c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:13.252078 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a58a43-a60b-4638-a4b0-28018e41403c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:49:13.253739 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a58a43-a60b-4638-a4b0-28018e41403c service swift] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:49:13.261790 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 702/1406] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 4 05:49:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 04 05:49:13.587704 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4ce66-9e39-426c-959e-c50c3a113440 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:13.588054 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4ce66-9e39-426c-959e-c50c3a113440 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:13.588256 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4ce66-9e39-426c-959e-c50c3a113440 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:13.589910 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 705/1407] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:49:13.598376 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690ff4d-4be8-40df-bb3a-dec795fde8b1 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:13.598659 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690ff4d-4be8-40df-bb3a-dec795fde8b1 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:13.599032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690ff4d-4be8-40df-bb3a-dec795fde8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:13.617293 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-f690ff4d-4be8-40df-bb3a-dec795fde8b1 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:49:13.618488 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f690ff4d-4be8-40df-bb3a-dec795fde8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:49:13.627211 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 703/1408] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:49:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:49:13.672257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4ce66-9e39-426c-959e-c50c3a113440 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:49:13.687580 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4ce66-9e39-426c-959e-c50c3a113440 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:49:13.693195 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998bdec-f872-4b46-8550-0d87a292a824 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:49:13.693946 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998bdec-f872-4b46-8550-0d87a292a824 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:13.694291 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998bdec-f872-4b46-8550-0d87a292a824 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:13.694625 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998bdec-f872-4b46-8550-0d87a292a824 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:13.704336 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998bdec-f872-4b46-8550-0d87a292a824 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:49:13.706226 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998bdec-f872-4b46-8550-0d87a292a824 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:49:13.716433 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 706/1409] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:49:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:49:23.612857 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=69 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:49:23.711808 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=59 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:49:35.153771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae89ace-d224-4f28-8d48-695159a67680 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:35.154338 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae89ace-d224-4f28-8d48-695159a67680 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:35.154338 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae89ace-d224-4f28-8d48-695159a67680 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:35.155760 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 704/1410] 10.222.0.16 () {54 vars in 918 bytes} [Mon Jul 4 05:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:49:35.161926 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea771b20-d448-47e5-b378-9497d64fbd33 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:35.162681 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea771b20-d448-47e5-b378-9497d64fbd33 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:35.162790 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea771b20-d448-47e5-b378-9497d64fbd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:35.186624 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-ea771b20-d448-47e5-b378-9497d64fbd33 None None] MFA Rules not processed for user `260f58535f4e46a197d00276d37fd515`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:49:35.187922 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ea771b20-d448-47e5-b378-9497d64fbd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:49:35.197049 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 707/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Mon Jul 4 05:49:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:49:35.211226 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bafe33-04d2-4fd8-93bf-de60d9c2ff1c None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:35.211508 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bafe33-04d2-4fd8-93bf-de60d9c2ff1c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:35.211757 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bafe33-04d2-4fd8-93bf-de60d9c2ff1c None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:35.213143 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 705/1412] 10.222.0.16 () {54 vars in 918 bytes} [Mon Jul 4 05:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:49:35.218036 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59040e7-1cae-4be8-a0a4-9e62e136c6ae None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:35.218317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59040e7-1cae-4be8-a0a4-9e62e136c6ae None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:35.218585 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59040e7-1cae-4be8-a0a4-9e62e136c6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:35.238079 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d59040e7-1cae-4be8-a0a4-9e62e136c6ae None None] MFA Rules not processed for user `6f638cc70c994a529a48cb2c92b70384`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:49:35.239277 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d59040e7-1cae-4be8-a0a4-9e62e136c6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:49:35.250350 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 708/1413] 10.222.0.16 () {58 vars in 1015 bytes} [Mon Jul 4 05:49:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:49:37.714486 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a0beb-8d47-4d04-8af2-b4820d223e5b None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:37.715009 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a0beb-8d47-4d04-8af2-b4820d223e5b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:37.715009 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a0beb-8d47-4d04-8af2-b4820d223e5b None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:37.716490 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 05:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:49:37.724081 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6f334-05c2-4129-9f5e-08d6555f6f2a None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:37.724549 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6f334-05c2-4129-9f5e-08d6555f6f2a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:37.724728 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6f334-05c2-4129-9f5e-08d6555f6f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:37.743873 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-26f6f334-05c2-4129-9f5e-08d6555f6f2a None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:49:37.745068 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-26f6f334-05c2-4129-9f5e-08d6555f6f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:49:37.754149 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 05:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:49:37.798117 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a0beb-8d47-4d04-8af2-b4820d223e5b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:49:37.814883 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a0beb-8d47-4d04-8af2-b4820d223e5b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:49:37.820624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99242f-c2c7-47c4-afd3-060d164b9f89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:49:37.821266 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99242f-c2c7-47c4-afd3-060d164b9f89 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:37.821547 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99242f-c2c7-47c4-afd3-060d164b9f89 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:37.821821 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99242f-c2c7-47c4-afd3-060d164b9f89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:37.830800 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d99242f-c2c7-47c4-afd3-060d164b9f89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:49:37.832476 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d99242f-c2c7-47c4-afd3-060d164b9f89 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:49:37.842505 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 707/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:49:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:49:38.731754 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59030298-6869-46d8-8637-ab2e05093eff None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:38.732354 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59030298-6869-46d8-8637-ab2e05093eff None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:38.732354 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59030298-6869-46d8-8637-ab2e05093eff None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:38.734783 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 05:49:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:49:38.742255 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a42a0c-2812-42f7-991b-73a62091fb9f None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:38.742688 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a42a0c-2812-42f7-991b-73a62091fb9f None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:38.742796 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a42a0c-2812-42f7-991b-73a62091fb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:38.762713 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-95a42a0c-2812-42f7-991b-73a62091fb9f None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:49:38.763947 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-95a42a0c-2812-42f7-991b-73a62091fb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:49:38.772990 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 05:49:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:49:38.933628 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59030298-6869-46d8-8637-ab2e05093eff None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:49:38.948192 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59030298-6869-46d8-8637-ab2e05093eff None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:49:38.953779 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a355a-6e0d-463a-ba2c-2a5e04fb6367 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:49:38.954413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a355a-6e0d-463a-ba2c-2a5e04fb6367 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:38.954696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a355a-6e0d-463a-ba2c-2a5e04fb6367 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:38.954971 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a355a-6e0d-463a-ba2c-2a5e04fb6367 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:38.963410 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a355a-6e0d-463a-ba2c-2a5e04fb6367 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:49:38.964992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a355a-6e0d-463a-ba2c-2a5e04fb6367 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:49:38.974385 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 711/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:49:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:49:39.847829 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ce91e-9478-4d9f-b93d-bd1dacd3c5b6 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:39.848386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ce91e-9478-4d9f-b93d-bd1dacd3c5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:39.848386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ce91e-9478-4d9f-b93d-bd1dacd3c5b6 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:39.849840 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 05:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:49:39.855585 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd8ca4-fd39-4515-8f13-b278092d9aac None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:39.856055 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd8ca4-fd39-4515-8f13-b278092d9aac None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:39.856153 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd8ca4-fd39-4515-8f13-b278092d9aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:39.874753 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-7fcd8ca4-fd39-4515-8f13-b278092d9aac None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:49:39.875997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7fcd8ca4-fd39-4515-8f13-b278092d9aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:49:39.886127 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 05:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:49:40.042363 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ce91e-9478-4d9f-b93d-bd1dacd3c5b6 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:49:40.067340 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ce91e-9478-4d9f-b93d-bd1dacd3c5b6 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:49:40.074108 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f90ba0-4f7a-4a2d-977b-ccb474d35771 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:49:40.074767 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f90ba0-4f7a-4a2d-977b-ccb474d35771 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:40.075107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f90ba0-4f7a-4a2d-977b-ccb474d35771 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:40.075373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f90ba0-4f7a-4a2d-977b-ccb474d35771 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:40.084204 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f90ba0-4f7a-4a2d-977b-ccb474d35771 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:49:40.085809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f90ba0-4f7a-4a2d-977b-ccb474d35771 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:49:40.095594 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 710/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:49:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:49:40.958958 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786f577-e7d7-4d7e-8bca-83596450c0da None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:40.959431 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786f577-e7d7-4d7e-8bca-83596450c0da None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:40.959533 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786f577-e7d7-4d7e-8bca-83596450c0da None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:40.960965 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 05:49:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:49:40.965839 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c5967-da0d-4d5b-8e82-780c2bf93eb4 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:40.966248 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c5967-da0d-4d5b-8e82-780c2bf93eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:40.966401 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c5967-da0d-4d5b-8e82-780c2bf93eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:40.985455 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-f84c5967-da0d-4d5b-8e82-780c2bf93eb4 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:49:40.986671 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f84c5967-da0d-4d5b-8e82-780c2bf93eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:49:40.994823 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 05:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:49:41.152140 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786f577-e7d7-4d7e-8bca-83596450c0da None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:49:41.172149 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786f577-e7d7-4d7e-8bca-83596450c0da None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:49:41.179279 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9827484-b350-4a5f-8f0f-f4b7e438de78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:49:41.179948 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9827484-b350-4a5f-8f0f-f4b7e438de78 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:41.180228 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9827484-b350-4a5f-8f0f-f4b7e438de78 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:41.180499 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9827484-b350-4a5f-8f0f-f4b7e438de78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:41.189169 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9827484-b350-4a5f-8f0f-f4b7e438de78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:49:41.190781 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9827484-b350-4a5f-8f0f-f4b7e438de78 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:49:41.200394 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 714/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:49:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:49:42.056094 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044a34a-78c8-4412-b320-80b5a6b46093 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:42.057003 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044a34a-78c8-4412-b320-80b5a6b46093 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:42.057003 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044a34a-78c8-4412-b320-80b5a6b46093 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:42.059348 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 05:49:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:49:42.065233 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f9a90-73fa-41b1-8e08-303d538bfdab None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:42.065677 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f9a90-73fa-41b1-8e08-303d538bfdab None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:42.065855 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f9a90-73fa-41b1-8e08-303d538bfdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:42.085326 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-200f9a90-73fa-41b1-8e08-303d538bfdab None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:49:42.086516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-200f9a90-73fa-41b1-8e08-303d538bfdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:49:42.094779 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 05:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:49:42.251502 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044a34a-78c8-4412-b320-80b5a6b46093 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:49:42.275069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044a34a-78c8-4412-b320-80b5a6b46093 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:49:42.285200 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d5e2e-bc73-437d-860d-5546bf7d9709 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:49:42.285840 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d5e2e-bc73-437d-860d-5546bf7d9709 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:42.286119 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d5e2e-bc73-437d-860d-5546bf7d9709 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:42.286389 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d5e2e-bc73-437d-860d-5546bf7d9709 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:42.295592 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d5e2e-bc73-437d-860d-5546bf7d9709 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:49:42.297220 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d5e2e-bc73-437d-860d-5546bf7d9709 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:49:42.307409 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 713/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:49:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:49:43.168955 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a23a31-a430-4b46-b737-b25ad1aeb1be None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:43.169792 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a23a31-a430-4b46-b737-b25ad1aeb1be None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:43.169792 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a23a31-a430-4b46-b737-b25ad1aeb1be None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:43.172002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 05:49:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:49:43.179363 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ddfd12-9db8-425b-85c2-fa85b1a0a439 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:43.179791 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ddfd12-9db8-425b-85c2-fa85b1a0a439 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:43.179896 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ddfd12-9db8-425b-85c2-fa85b1a0a439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:43.199122 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-b7ddfd12-9db8-425b-85c2-fa85b1a0a439 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:49:43.200349 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b7ddfd12-9db8-425b-85c2-fa85b1a0a439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:49:43.209253 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 05:49:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:49:43.357118 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a23a31-a430-4b46-b737-b25ad1aeb1be None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:49:43.374760 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a23a31-a430-4b46-b737-b25ad1aeb1be None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:49:43.381602 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baebe1-373b-49fb-8017-f285877ce449 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:49:43.382243 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baebe1-373b-49fb-8017-f285877ce449 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:43.382523 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baebe1-373b-49fb-8017-f285877ce449 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:43.382795 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baebe1-373b-49fb-8017-f285877ce449 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:43.391519 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29baebe1-373b-49fb-8017-f285877ce449 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:49:43.393143 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29baebe1-373b-49fb-8017-f285877ce449 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:49:43.402748 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 717/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:49:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:49:44.198504 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db2ea2-150b-4d6e-9890-92abb6b506f2 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:44.199066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db2ea2-150b-4d6e-9890-92abb6b506f2 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:44.199066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db2ea2-150b-4d6e-9890-92abb6b506f2 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:44.201143 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 05:49:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:49:44.209191 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644dbbc2-5893-4f17-a023-4cd3713f3100 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:44.209596 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644dbbc2-5893-4f17-a023-4cd3713f3100 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:44.209747 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644dbbc2-5893-4f17-a023-4cd3713f3100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:44.228491 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-644dbbc2-5893-4f17-a023-4cd3713f3100 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:49:44.229702 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-644dbbc2-5893-4f17-a023-4cd3713f3100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:49:44.238486 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 05:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:49:44.399254 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db2ea2-150b-4d6e-9890-92abb6b506f2 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:49:44.420447 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db2ea2-150b-4d6e-9890-92abb6b506f2 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:49:44.426836 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2114c-37d5-424e-9607-e5694ed2e7be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:49:44.427514 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2114c-37d5-424e-9607-e5694ed2e7be service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:44.427799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2114c-37d5-424e-9607-e5694ed2e7be service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:44.428104 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2114c-37d5-424e-9607-e5694ed2e7be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:44.437005 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2114c-37d5-424e-9607-e5694ed2e7be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:49:44.438610 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2114c-37d5-424e-9607-e5694ed2e7be service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:49:44.448447 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 716/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:49:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:49:45.250254 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea138ab-29ad-4ef8-a6f1-3965fd33f080 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:45.251072 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea138ab-29ad-4ef8-a6f1-3965fd33f080 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:45.251072 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea138ab-29ad-4ef8-a6f1-3965fd33f080 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:45.253207 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 05:49:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:49:45.259425 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c6682-c9c1-4fc1-8b99-3df82984aa88 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:45.259850 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c6682-c9c1-4fc1-8b99-3df82984aa88 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:45.260006 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c6682-c9c1-4fc1-8b99-3df82984aa88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:45.278964 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-932c6682-c9c1-4fc1-8b99-3df82984aa88 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:49:45.280181 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-932c6682-c9c1-4fc1-8b99-3df82984aa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:49:45.289194 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 05:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:49:45.440941 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea138ab-29ad-4ef8-a6f1-3965fd33f080 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:49:45.463545 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea138ab-29ad-4ef8-a6f1-3965fd33f080 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:49:45.470141 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18852153-bc3c-4f79-ba74-bd06423eb91d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:49:45.470785 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18852153-bc3c-4f79-ba74-bd06423eb91d service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:45.471065 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18852153-bc3c-4f79-ba74-bd06423eb91d service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:45.471370 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18852153-bc3c-4f79-ba74-bd06423eb91d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:45.480383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18852153-bc3c-4f79-ba74-bd06423eb91d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:49:45.481989 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18852153-bc3c-4f79-ba74-bd06423eb91d service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:49:45.492263 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 720/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:49:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:49:46.299973 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57297c-6947-4020-a620-fb3411f073d9 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:46.300586 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57297c-6947-4020-a620-fb3411f073d9 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:46.300586 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57297c-6947-4020-a620-fb3411f073d9 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:46.302967 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 05:49:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:49:46.308869 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956d36e-32ee-4be2-865c-a713022d29cb None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:46.309303 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956d36e-32ee-4be2-865c-a713022d29cb None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:46.309435 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956d36e-32ee-4be2-865c-a713022d29cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:46.337107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-7956d36e-32ee-4be2-865c-a713022d29cb None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:49:46.338313 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7956d36e-32ee-4be2-865c-a713022d29cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:49:46.347563 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 05:49:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:49:46.498435 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57297c-6947-4020-a620-fb3411f073d9 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:49:46.520020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57297c-6947-4020-a620-fb3411f073d9 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:49:46.526874 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7aad39-0054-4e74-8733-b3cfd9deda83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:49:46.527553 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7aad39-0054-4e74-8733-b3cfd9deda83 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:46.527831 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7aad39-0054-4e74-8733-b3cfd9deda83 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:46.528099 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7aad39-0054-4e74-8733-b3cfd9deda83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:46.538670 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7aad39-0054-4e74-8733-b3cfd9deda83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:49:46.540303 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7aad39-0054-4e74-8733-b3cfd9deda83 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:49:46.550098 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 719/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:49:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:49:48.442942 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8ac72-e753-497d-88de-04cc414ba53d None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:48.443815 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8ac72-e753-497d-88de-04cc414ba53d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:48.443815 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8ac72-e753-497d-88de-04cc414ba53d None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:48.444962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 05:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:49:48.451339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b547106-7290-4f47-aa7a-c2e3f6a4526f None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:48.452105 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b547106-7290-4f47-aa7a-c2e3f6a4526f None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:48.452281 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b547106-7290-4f47-aa7a-c2e3f6a4526f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:48.474215 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-8b547106-7290-4f47-aa7a-c2e3f6a4526f None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:49:48.475439 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-8b547106-7290-4f47-aa7a-c2e3f6a4526f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:49:48.483982 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 05:49:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:49:48.524306 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8ac72-e753-497d-88de-04cc414ba53d None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:49:48.537728 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8ac72-e753-497d-88de-04cc414ba53d None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:49:48.541890 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3502a2-7604-4d18-bd7a-59d61188ff90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:49:48.542535 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3502a2-7604-4d18-bd7a-59d61188ff90 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:48.542815 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3502a2-7604-4d18-bd7a-59d61188ff90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:48.543084 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3502a2-7604-4d18-bd7a-59d61188ff90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:48.553508 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3502a2-7604-4d18-bd7a-59d61188ff90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:49:48.554950 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3502a2-7604-4d18-bd7a-59d61188ff90 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:49:48.564479 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 723/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:49:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:49:50.736055 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc038b-3456-4935-86f9-4ba4480bf56d None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:50.736660 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc038b-3456-4935-86f9-4ba4480bf56d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:50.736660 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc038b-3456-4935-86f9-4ba4480bf56d None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:50.738057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 05:49:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:49:50.743813 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abd945-1318-4f54-bbcd-2bf7601beeca None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:50.744239 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abd945-1318-4f54-bbcd-2bf7601beeca None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:50.744382 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abd945-1318-4f54-bbcd-2bf7601beeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:50.764233 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-c9abd945-1318-4f54-bbcd-2bf7601beeca None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:49:50.765670 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c9abd945-1318-4f54-bbcd-2bf7601beeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:49:50.774645 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 05:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:49:50.816595 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc038b-3456-4935-86f9-4ba4480bf56d None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:49:50.835204 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc038b-3456-4935-86f9-4ba4480bf56d None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:49:50.839704 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9ace5-756a-450d-93d8-38706069650c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:49:50.840343 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9ace5-756a-450d-93d8-38706069650c service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:50.840630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9ace5-756a-450d-93d8-38706069650c service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:50.840972 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9ace5-756a-450d-93d8-38706069650c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:50.849990 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9ace5-756a-450d-93d8-38706069650c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:49:50.851460 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9ace5-756a-450d-93d8-38706069650c service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:49:50.861109 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 722/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:49:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:49:53.172898 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3903d-ee6b-4f1c-aabb-e0223bde5a4b None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:53.173497 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3903d-ee6b-4f1c-aabb-e0223bde5a4b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:53.173497 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3903d-ee6b-4f1c-aabb-e0223bde5a4b None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:53.174813 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 05:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:49:53.181637 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6edf83-f29a-4d38-86c1-878974cb8f68 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:53.182079 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6edf83-f29a-4d38-86c1-878974cb8f68 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:53.182174 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6edf83-f29a-4d38-86c1-878974cb8f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:53.201186 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-de6edf83-f29a-4d38-86c1-878974cb8f68 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:49:53.202367 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-de6edf83-f29a-4d38-86c1-878974cb8f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:49:53.211582 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 05:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:49:53.249993 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3903d-ee6b-4f1c-aabb-e0223bde5a4b None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:49:53.267684 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3903d-ee6b-4f1c-aabb-e0223bde5a4b None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:49:53.273069 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee4451-6c77-4a49-883a-f2c9bd549fe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:49:53.273707 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee4451-6c77-4a49-883a-f2c9bd549fe2 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:53.273984 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee4451-6c77-4a49-883a-f2c9bd549fe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:53.274256 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee4451-6c77-4a49-883a-f2c9bd549fe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:53.285164 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee4451-6c77-4a49-883a-f2c9bd549fe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:49:53.286610 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee4451-6c77-4a49-883a-f2c9bd549fe2 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:49:53.296693 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 726/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:49:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:49:55.495994 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3df8b-23da-4e18-8492-2d30fa9923f7 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:55.496591 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3df8b-23da-4e18-8492-2d30fa9923f7 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:55.496591 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3df8b-23da-4e18-8492-2d30fa9923f7 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:55.497937 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 05:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:49:55.504432 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94416037-088d-49e2-8901-978b24116fd8 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:55.505131 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94416037-088d-49e2-8901-978b24116fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:55.505327 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94416037-088d-49e2-8901-978b24116fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:55.533002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-94416037-088d-49e2-8901-978b24116fd8 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:49:55.534167 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-94416037-088d-49e2-8901-978b24116fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:49:55.543514 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 05:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:49:55.595661 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3df8b-23da-4e18-8492-2d30fa9923f7 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:49:55.607712 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3df8b-23da-4e18-8492-2d30fa9923f7 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:49:55.611852 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bcfa1-53f7-461d-9a4c-f77c547d98cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:49:55.612581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bcfa1-53f7-461d-9a4c-f77c547d98cf service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:55.612915 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bcfa1-53f7-461d-9a4c-f77c547d98cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:55.613223 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bcfa1-53f7-461d-9a4c-f77c547d98cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:55.623004 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6bcfa1-53f7-461d-9a4c-f77c547d98cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:49:55.624468 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6bcfa1-53f7-461d-9a4c-f77c547d98cf service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:49:55.634321 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 725/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:49:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:49:57.710480 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d94f7-f0c0-4ab0-b23d-bf05e84f7e96 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:57.711044 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d94f7-f0c0-4ab0-b23d-bf05e84f7e96 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:57.711044 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d94f7-f0c0-4ab0-b23d-bf05e84f7e96 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:57.712362 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 05:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:49:57.718488 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6c61e-5735-4917-9392-c2b350ad7be3 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:57.718957 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6c61e-5735-4917-9392-c2b350ad7be3 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:57.719053 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6c61e-5735-4917-9392-c2b350ad7be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:57.745385 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-98b6c61e-5735-4917-9392-c2b350ad7be3 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:49:57.746642 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-98b6c61e-5735-4917-9392-c2b350ad7be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:49:57.755823 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 05:49:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:49:57.795347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d94f7-f0c0-4ab0-b23d-bf05e84f7e96 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:49:57.807751 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d94f7-f0c0-4ab0-b23d-bf05e84f7e96 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:49:57.811821 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ff05e-4429-4898-9f7f-5672a3c8cb83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:49:57.812464 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ff05e-4429-4898-9f7f-5672a3c8cb83 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:57.812741 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ff05e-4429-4898-9f7f-5672a3c8cb83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:57.813011 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ff05e-4429-4898-9f7f-5672a3c8cb83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:57.822561 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ff05e-4429-4898-9f7f-5672a3c8cb83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:49:57.824033 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ff05e-4429-4898-9f7f-5672a3c8cb83 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:49:57.833751 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 729/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:49:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:49:59.896088 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda4308-a072-4491-ba4a-b9799c1e15dc None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:59.896674 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda4308-a072-4491-ba4a-b9799c1e15dc None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:59.896674 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda4308-a072-4491-ba4a-b9799c1e15dc None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:59.898101 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 05:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:49:59.903960 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127470ec-03b5-4771-a70a-c5415e243854 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:49:59.904444 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127470ec-03b5-4771-a70a-c5415e243854 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:49:59.904548 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127470ec-03b5-4771-a70a-c5415e243854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:49:59.923559 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-127470ec-03b5-4771-a70a-c5415e243854 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:49:59.924760 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-127470ec-03b5-4771-a70a-c5415e243854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:49:59.934006 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 05:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:49:59.980756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda4308-a072-4491-ba4a-b9799c1e15dc None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:49:59.999087 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda4308-a072-4491-ba4a-b9799c1e15dc None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:50:00.005045 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b70b6-b61f-4044-8c09-7eb4a85ca5e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:50:00.005988 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b70b6-b61f-4044-8c09-7eb4a85ca5e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:00.006349 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b70b6-b61f-4044-8c09-7eb4a85ca5e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:00.006681 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b70b6-b61f-4044-8c09-7eb4a85ca5e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:00.022201 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b70b6-b61f-4044-8c09-7eb4a85ca5e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:50:00.023653 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b70b6-b61f-4044-8c09-7eb4a85ca5e5 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:50:00.033297 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 728/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:49:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:50:02.094279 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28713046-c2cd-4ed6-9082-585edc2b2ab7 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:02.094886 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28713046-c2cd-4ed6-9082-585edc2b2ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:02.094886 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28713046-c2cd-4ed6-9082-585edc2b2ab7 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:02.096277 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 05:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:50:02.102629 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc2d4f-86cd-4c86-869c-ad2c50a37c99 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:02.103321 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc2d4f-86cd-4c86-869c-ad2c50a37c99 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:02.103575 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc2d4f-86cd-4c86-869c-ad2c50a37c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:02.127717 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-c3fc2d4f-86cd-4c86-869c-ad2c50a37c99 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:50:02.128925 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c3fc2d4f-86cd-4c86-869c-ad2c50a37c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:50:02.138010 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 05:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:50:02.174877 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28713046-c2cd-4ed6-9082-585edc2b2ab7 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:50:02.187013 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28713046-c2cd-4ed6-9082-585edc2b2ab7 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:50:02.191065 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9fc56-47b6-4258-8906-1f3cf19469d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:50:02.191730 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9fc56-47b6-4258-8906-1f3cf19469d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:02.192006 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9fc56-47b6-4258-8906-1f3cf19469d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:02.192275 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9fc56-47b6-4258-8906-1f3cf19469d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:02.202014 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9fc56-47b6-4258-8906-1f3cf19469d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:50:02.203506 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9fc56-47b6-4258-8906-1f3cf19469d0 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:50:02.213100 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 732/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:50:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:50:04.287815 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545544a-e796-476a-b84a-1b5cdda675ee None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:04.288396 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545544a-e796-476a-b84a-1b5cdda675ee None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:04.288396 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545544a-e796-476a-b84a-1b5cdda675ee None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:04.290499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 05:50:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:50:04.298320 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7452d3-f33f-4d45-983b-9f3e803ec17d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:04.298878 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7452d3-f33f-4d45-983b-9f3e803ec17d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:04.298975 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7452d3-f33f-4d45-983b-9f3e803ec17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:04.305463 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=79 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:50:04.318689 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-4f7452d3-f33f-4d45-983b-9f3e803ec17d None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:50:04.319916 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4f7452d3-f33f-4d45-983b-9f3e803ec17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:50:04.328281 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 05:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:50:04.365243 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545544a-e796-476a-b84a-1b5cdda675ee None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:50:04.371568 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=73 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:50:04.378573 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545544a-e796-476a-b84a-1b5cdda675ee None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:50:04.382543 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399acf2-fa46-47f7-963b-37758f59c46b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:50:04.383202 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399acf2-fa46-47f7-963b-37758f59c46b service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:04.383496 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399acf2-fa46-47f7-963b-37758f59c46b service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:04.383775 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399acf2-fa46-47f7-963b-37758f59c46b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:04.393067 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399acf2-fa46-47f7-963b-37758f59c46b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:50:04.394498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399acf2-fa46-47f7-963b-37758f59c46b service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:50:04.404066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 731/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:50:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 05:50:06.438864 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a7b5e-d0e3-4a85-93a5-c88211714cf0 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:06.439544 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a7b5e-d0e3-4a85-93a5-c88211714cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:06.439544 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a7b5e-d0e3-4a85-93a5-c88211714cf0 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:06.440847 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 05:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:50:06.447400 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828090a-90a8-4e10-b4ef-6f350d6c7f88 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:06.448124 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828090a-90a8-4e10-b4ef-6f350d6c7f88 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:06.448316 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828090a-90a8-4e10-b4ef-6f350d6c7f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:06.471664 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-3828090a-90a8-4e10-b4ef-6f350d6c7f88 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:50:06.472882 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-3828090a-90a8-4e10-b4ef-6f350d6c7f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:50:06.481410 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 05:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:50:06.518499 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a7b5e-d0e3-4a85-93a5-c88211714cf0 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:50:06.531429 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a7b5e-d0e3-4a85-93a5-c88211714cf0 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:50:06.535472 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5118fa9-8f30-4f87-88e2-17b8ff9a86b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:50:06.536183 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5118fa9-8f30-4f87-88e2-17b8ff9a86b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:06.536467 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5118fa9-8f30-4f87-88e2-17b8ff9a86b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:06.536762 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5118fa9-8f30-4f87-88e2-17b8ff9a86b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:06.548620 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5118fa9-8f30-4f87-88e2-17b8ff9a86b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:50:06.550814 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5118fa9-8f30-4f87-88e2-17b8ff9a86b9 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:50:06.561496 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 735/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:50:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:50:08.575843 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15c299-6c38-4d33-8e58-8809cc88d35a None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:08.576342 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15c299-6c38-4d33-8e58-8809cc88d35a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:08.576342 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15c299-6c38-4d33-8e58-8809cc88d35a None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:08.577761 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 05:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:50:08.584157 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddefaa-2c5c-4dfe-b011-1226eefaadf3 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:08.584926 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddefaa-2c5c-4dfe-b011-1226eefaadf3 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:08.585078 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddefaa-2c5c-4dfe-b011-1226eefaadf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:08.609400 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-ceddefaa-2c5c-4dfe-b011-1226eefaadf3 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:50:08.610912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ceddefaa-2c5c-4dfe-b011-1226eefaadf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:50:08.619873 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 05:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:50:08.659242 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15c299-6c38-4d33-8e58-8809cc88d35a None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:50:08.678201 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15c299-6c38-4d33-8e58-8809cc88d35a None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:50:08.682696 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7934c-b821-402d-9187-38df3c989714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:50:08.683383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7934c-b821-402d-9187-38df3c989714 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:08.683666 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7934c-b821-402d-9187-38df3c989714 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:08.683933 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7934c-b821-402d-9187-38df3c989714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:08.693635 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc7934c-b821-402d-9187-38df3c989714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:50:08.695057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc7934c-b821-402d-9187-38df3c989714 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:50:08.704516 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 734/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:50:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:50:18.603845 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=11 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:50:18.700242 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=14 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:50:28.307585 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18ad70-3603-429c-96dc-db16c3ec1a32 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:28.308220 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18ad70-3603-429c-96dc-db16c3ec1a32 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:28.308220 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18ad70-3603-429c-96dc-db16c3ec1a32 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:28.309540 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 737/1471] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:50:28.315536 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee443f-1ef9-4613-ba8a-f125c99653f1 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:28.315996 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee443f-1ef9-4613-ba8a-f125c99653f1 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:28.316103 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee443f-1ef9-4613-ba8a-f125c99653f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:28.337810 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-3cee443f-1ef9-4613-ba8a-f125c99653f1 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:50:28.338997 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-3cee443f-1ef9-4613-ba8a-f125c99653f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:50:28.349096 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 735/1472] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:50:28.434396 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3624f95-58bc-417f-ba92-66af60292b1b None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:28.434682 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3624f95-58bc-417f-ba92-66af60292b1b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:28.434956 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3624f95-58bc-417f-ba92-66af60292b1b None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:28.436465 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 738/1473] 10.222.0.16 () {54 vars in 962 bytes} [Mon Jul 4 05:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:50:28.441450 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda0cba-a8b4-4267-9b61-e8d2616b71ca None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:28.441737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda0cba-a8b4-4267-9b61-e8d2616b71ca None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:28.442012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda0cba-a8b4-4267-9b61-e8d2616b71ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:28.461026 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-1eda0cba-a8b4-4267-9b61-e8d2616b71ca None None] MFA Rules not processed for user `77f0477631724d7f9c8ba752ba27866d`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:50:28.462250 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-1eda0cba-a8b4-4267-9b61-e8d2616b71ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:50:28.469521 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 736/1474] 10.222.0.16 () {58 vars in 1059 bytes} [Mon Jul 4 05:50:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:50:28.476880 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3624f95-58bc-417f-ba92-66af60292b1b None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:50:28.491253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3624f95-58bc-417f-ba92-66af60292b1b None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:50:28.495431 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d572a-d4aa-4fd5-93eb-8fa3d9faa1ef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77f0477631724d7f9c8ba752ba27866d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:50:28.496067 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d572a-d4aa-4fd5-93eb-8fa3d9faa1ef service glance] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:28.496353 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d572a-d4aa-4fd5-93eb-8fa3d9faa1ef service glance] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:28.496626 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d572a-d4aa-4fd5-93eb-8fa3d9faa1ef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:28.505693 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d572a-d4aa-4fd5-93eb-8fa3d9faa1ef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:50:28.507136 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d572a-d4aa-4fd5-93eb-8fa3d9faa1ef service glance] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:50:28.516580 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 739/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:50:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:50:30.630241 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ea59b-ffcb-4e46-b0d5-43851635e878 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:30.631156 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ea59b-ffcb-4e46-b0d5-43851635e878 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:30.631156 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ea59b-ffcb-4e46-b0d5-43851635e878 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:30.634145 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 737/1476] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:50:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:50:30.641950 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f47380-fb7b-4c60-bac7-dcd89df16b59 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:30.642404 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f47380-fb7b-4c60-bac7-dcd89df16b59 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:30.642519 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f47380-fb7b-4c60-bac7-dcd89df16b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:30.661619 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-99f47380-fb7b-4c60-bac7-dcd89df16b59 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:50:30.662814 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-99f47380-fb7b-4c60-bac7-dcd89df16b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:50:30.671136 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 740/1477] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:50:30.694528 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ea59b-ffcb-4e46-b0d5-43851635e878 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:50:30.710151 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ea59b-ffcb-4e46-b0d5-43851635e878 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:50:30.715761 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a4f03-4984-49e1-b1f2-ba2781712649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:50:30.716406 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a4f03-4984-49e1-b1f2-ba2781712649 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:30.716690 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a4f03-4984-49e1-b1f2-ba2781712649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:30.716961 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a4f03-4984-49e1-b1f2-ba2781712649 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:30.717693 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a4f03-4984-49e1-b1f2-ba2781712649 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:50:30.719542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: WARNING py.warnings [None req-7a7a4f03-4984-49e1-b1f2-ba2781712649 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 05:50:30.719542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: warnings.warn(msg) Jul 04 05:50:30.719542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: Jul 04 05:50:30.720713 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a4f03-4984-49e1-b1f2-ba2781712649 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:50:30.741229 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 738/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Mon Jul 4 05:50:30 2022] GET /identity/v3/projects => generated 2553 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:50:32.778483 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682985d8-5f42-4db1-9dc0-5480450bd3ca None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:32.779352 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682985d8-5f42-4db1-9dc0-5480450bd3ca None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:32.779352 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682985d8-5f42-4db1-9dc0-5480450bd3ca None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:32.781633 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 741/1479] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:50:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:50:32.788067 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18751439-7071-4111-9cad-c279676f33ea None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:32.788526 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18751439-7071-4111-9cad-c279676f33ea None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:32.788629 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18751439-7071-4111-9cad-c279676f33ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:32.810163 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-18751439-7071-4111-9cad-c279676f33ea None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:50:32.811397 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-18751439-7071-4111-9cad-c279676f33ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:50:32.820673 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 739/1480] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:50:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:50:32.863840 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682985d8-5f42-4db1-9dc0-5480450bd3ca None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:50:32.879701 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682985d8-5f42-4db1-9dc0-5480450bd3ca None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:50:32.886082 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb158b4-0567-4cb1-a3b1-e7eb5916eb9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:50:32.886729 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb158b4-0567-4cb1-a3b1-e7eb5916eb9b service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:32.887014 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb158b4-0567-4cb1-a3b1-e7eb5916eb9b service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:32.887336 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb158b4-0567-4cb1-a3b1-e7eb5916eb9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:32.895843 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb158b4-0567-4cb1-a3b1-e7eb5916eb9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:50:32.897567 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb158b4-0567-4cb1-a3b1-e7eb5916eb9b service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:50:32.907303 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 742/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:50:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:50:35.176433 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8e25f-5e36-4293-9149-745d95dfc3fa None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:35.177333 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8e25f-5e36-4293-9149-745d95dfc3fa None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:35.177333 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8e25f-5e36-4293-9149-745d95dfc3fa None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:35.179925 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 740/1482] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:50:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:50:35.188633 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667efa5-c4e2-4ab5-b811-d3a2c12fa1ee None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:35.189080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667efa5-c4e2-4ab5-b811-d3a2c12fa1ee None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:35.189214 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667efa5-c4e2-4ab5-b811-d3a2c12fa1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:35.215855 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-e667efa5-c4e2-4ab5-b811-d3a2c12fa1ee None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:50:35.217055 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e667efa5-c4e2-4ab5-b811-d3a2c12fa1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:50:35.226770 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 743/1483] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:50:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:50:35.263471 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8e25f-5e36-4293-9149-745d95dfc3fa None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:50:35.275741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8e25f-5e36-4293-9149-745d95dfc3fa None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:50:35.279760 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef7fa4-9ff2-4638-86dc-15f218dc15cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:50:35.280394 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef7fa4-9ff2-4638-86dc-15f218dc15cf service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:35.280666 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef7fa4-9ff2-4638-86dc-15f218dc15cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:35.280963 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef7fa4-9ff2-4638-86dc-15f218dc15cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:35.291072 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef7fa4-9ff2-4638-86dc-15f218dc15cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:50:35.292566 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef7fa4-9ff2-4638-86dc-15f218dc15cf service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:50:35.302507 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 741/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:50:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:50:37.370698 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a9420-e8ed-47ef-9455-ad5238f533e3 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:37.371257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a9420-e8ed-47ef-9455-ad5238f533e3 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:37.371257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a9420-e8ed-47ef-9455-ad5238f533e3 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:37.373387 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 744/1485] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:50:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:50:37.378812 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c263d-2de1-4751-b231-9e969903f30f None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:37.379306 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c263d-2de1-4751-b231-9e969903f30f None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:37.379412 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c263d-2de1-4751-b231-9e969903f30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:37.398465 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-501c263d-2de1-4751-b231-9e969903f30f None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:50:37.399694 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-501c263d-2de1-4751-b231-9e969903f30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:50:37.408062 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 742/1486] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:50:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:50:37.448463 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a9420-e8ed-47ef-9455-ad5238f533e3 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:50:37.461006 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a9420-e8ed-47ef-9455-ad5238f533e3 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:50:37.465298 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad80ef9-5898-457e-b66f-a4e4f8e24872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:50:37.465937 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad80ef9-5898-457e-b66f-a4e4f8e24872 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:37.466222 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad80ef9-5898-457e-b66f-a4e4f8e24872 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:37.466495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad80ef9-5898-457e-b66f-a4e4f8e24872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:37.476136 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad80ef9-5898-457e-b66f-a4e4f8e24872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:50:37.477586 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad80ef9-5898-457e-b66f-a4e4f8e24872 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:50:37.487529 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 745/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:50:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:50:39.616198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65284399-da4f-4f13-b22a-ae86ff0c290a None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:39.616732 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65284399-da4f-4f13-b22a-ae86ff0c290a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:39.616732 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65284399-da4f-4f13-b22a-ae86ff0c290a None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:39.618154 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 743/1488] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:50:39.627033 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb640d-f57c-4081-887b-805b0bd065d5 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:39.627803 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb640d-f57c-4081-887b-805b0bd065d5 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:39.627982 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb640d-f57c-4081-887b-805b0bd065d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:39.653981 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-75eb640d-f57c-4081-887b-805b0bd065d5 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:50:39.655229 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-75eb640d-f57c-4081-887b-805b0bd065d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:50:39.664119 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 746/1489] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:50:39.705073 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65284399-da4f-4f13-b22a-ae86ff0c290a None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:50:39.717724 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65284399-da4f-4f13-b22a-ae86ff0c290a None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:50:39.721955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14ff7c-4496-404a-a3f2-2ddfa06b9048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:50:39.722589 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14ff7c-4496-404a-a3f2-2ddfa06b9048 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:39.722869 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14ff7c-4496-404a-a3f2-2ddfa06b9048 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:39.723156 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14ff7c-4496-404a-a3f2-2ddfa06b9048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:39.733003 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14ff7c-4496-404a-a3f2-2ddfa06b9048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:50:39.734439 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14ff7c-4496-404a-a3f2-2ddfa06b9048 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:50:39.744531 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 744/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:50:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:50:42.037160 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c74d5-9466-4286-a744-171db1c636c9 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:42.037955 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c74d5-9466-4286-a744-171db1c636c9 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:42.037955 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c74d5-9466-4286-a744-171db1c636c9 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:42.039407 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 747/1491] 10.222.0.16 () {54 vars in 926 bytes} [Mon Jul 4 05:50:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:50:42.044848 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c16e5-4756-415d-a4cd-44cea430c49c None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:42.045311 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c16e5-4756-415d-a4cd-44cea430c49c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:42.045410 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c16e5-4756-415d-a4cd-44cea430c49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:42.067854 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-c96c16e5-4756-415d-a4cd-44cea430c49c None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:50:42.069369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c96c16e5-4756-415d-a4cd-44cea430c49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:50:42.078760 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 745/1492] 10.222.0.16 () {58 vars in 1023 bytes} [Mon Jul 4 05:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:50:42.121110 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c74d5-9466-4286-a744-171db1c636c9 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:50:42.137051 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c74d5-9466-4286-a744-171db1c636c9 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:50:42.141226 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb988139-2b20-443a-844c-c77983661a99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:50:42.141864 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb988139-2b20-443a-844c-c77983661a99 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:50:42.142145 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb988139-2b20-443a-844c-c77983661a99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:50:42.142416 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb988139-2b20-443a-844c-c77983661a99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:50:42.154186 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb988139-2b20-443a-844c-c77983661a99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:50:42.155884 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb988139-2b20-443a-844c-c77983661a99 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:50:42.168107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 748/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:50:52.059911 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=33 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:50:52.163218 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=33 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:52:08.077607 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb404c6-9b4e-4c6c-9772-2c0c6513b1ae None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:52:08.078247 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb404c6-9b4e-4c6c-9772-2c0c6513b1ae None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:52:08.078247 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb404c6-9b4e-4c6c-9772-2c0c6513b1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:52:08.100791 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-3bb404c6-9b4e-4c6c-9772-2c0c6513b1ae None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:52:08.102007 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-3bb404c6-9b4e-4c6c-9772-2c0c6513b1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:52:08.112011 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 746/1494] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:52:08.120614 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f92fa-5b99-4519-9b70-10a7f7a03522 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:52:08.121089 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f92fa-5b99-4519-9b70-10a7f7a03522 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:52:08.121195 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f92fa-5b99-4519-9b70-10a7f7a03522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:52:08.139589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d60f92fa-5b99-4519-9b70-10a7f7a03522 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:52:08.140802 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d60f92fa-5b99-4519-9b70-10a7f7a03522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:52:08.150893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 749/1495] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:52:08.155674 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb404c6-9b4e-4c6c-9772-2c0c6513b1ae None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:52:08.166684 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb404c6-9b4e-4c6c-9772-2c0c6513b1ae None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:52:08.173098 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a81ba1-7827-497b-869e-81377049d647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:52:08.173754 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a81ba1-7827-497b-869e-81377049d647 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:52:08.174037 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a81ba1-7827-497b-869e-81377049d647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:52:08.174311 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a81ba1-7827-497b-869e-81377049d647 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:52:08.175045 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a81ba1-7827-497b-869e-81377049d647 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:52:08.175383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a81ba1-7827-497b-869e-81377049d647 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:52:08.176443 dv-cinder-797333-5-smb devstack@keystone.service[80212]: WARNING py.warnings [None req-a6a81ba1-7827-497b-869e-81377049d647 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 05:52:08.176443 dv-cinder-797333-5-smb devstack@keystone.service[80212]: warnings.warn(msg) Jul 04 05:52:08.176443 dv-cinder-797333-5-smb devstack@keystone.service[80212]: Jul 04 05:52:08.177341 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a81ba1-7827-497b-869e-81377049d647 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:52:08.189491 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 747/1496] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:52:08.197552 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f92fa-5b99-4519-9b70-10a7f7a03522 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:52:08.207026 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f92fa-5b99-4519-9b70-10a7f7a03522 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:52:08.212536 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382a59a-efc6-4032-9dfc-d8316c43b0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:52:08.213184 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382a59a-efc6-4032-9dfc-d8316c43b0a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:52:08.213461 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382a59a-efc6-4032-9dfc-d8316c43b0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:52:08.213734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382a59a-efc6-4032-9dfc-d8316c43b0a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:52:08.214417 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382a59a-efc6-4032-9dfc-d8316c43b0a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:52:08.216279 dv-cinder-797333-5-smb devstack@keystone.service[80213]: WARNING py.warnings [None req-d382a59a-efc6-4032-9dfc-d8316c43b0a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 05:52:08.216279 dv-cinder-797333-5-smb devstack@keystone.service[80213]: warnings.warn(msg) Jul 04 05:52:08.216279 dv-cinder-797333-5-smb devstack@keystone.service[80213]: Jul 04 05:52:08.217520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382a59a-efc6-4032-9dfc-d8316c43b0a5 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:52:08.256552 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 750/1497] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:52:08 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:52:08.262584 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a81ba1-7827-497b-869e-81377049d647 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:52:08.276048 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a81ba1-7827-497b-869e-81377049d647 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:52:08.340785 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346625ca-05d1-40e2-b3bf-1e0038f8d67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:52:08.341377 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346625ca-05d1-40e2-b3bf-1e0038f8d67d admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:52:08.341665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346625ca-05d1-40e2-b3bf-1e0038f8d67d admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:52:08.341942 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346625ca-05d1-40e2-b3bf-1e0038f8d67d admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:52:08.342611 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346625ca-05d1-40e2-b3bf-1e0038f8d67d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:52:08.343686 dv-cinder-797333-5-smb devstack@keystone.service[80212]: WARNING py.warnings [None req-346625ca-05d1-40e2-b3bf-1e0038f8d67d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 05:52:08.343686 dv-cinder-797333-5-smb devstack@keystone.service[80212]: warnings.warn(msg) Jul 04 05:52:08.343686 dv-cinder-797333-5-smb devstack@keystone.service[80212]: Jul 04 05:52:08.344920 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346625ca-05d1-40e2-b3bf-1e0038f8d67d admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:52:08.371726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 748/1498] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:52:08 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:52:08.378322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382a59a-efc6-4032-9dfc-d8316c43b0a5 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:52:08.390664 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382a59a-efc6-4032-9dfc-d8316c43b0a5 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:52:08.395392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c17c1-28dc-405e-a268-8861eeca8d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:52:08.396076 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c17c1-28dc-405e-a268-8861eeca8d8c admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:52:08.396383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c17c1-28dc-405e-a268-8861eeca8d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:52:08.396659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c17c1-28dc-405e-a268-8861eeca8d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:52:08.397385 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c17c1-28dc-405e-a268-8861eeca8d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:52:08.398406 dv-cinder-797333-5-smb devstack@keystone.service[80213]: WARNING py.warnings [None req-4c9c17c1-28dc-405e-a268-8861eeca8d8c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 05:52:08.398406 dv-cinder-797333-5-smb devstack@keystone.service[80213]: warnings.warn(msg) Jul 04 05:52:08.398406 dv-cinder-797333-5-smb devstack@keystone.service[80213]: Jul 04 05:52:08.399339 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c17c1-28dc-405e-a268-8861eeca8d8c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:52:08.412166 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 751/1499] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:52:08.417421 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346625ca-05d1-40e2-b3bf-1e0038f8d67d admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:52:08.427674 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346625ca-05d1-40e2-b3bf-1e0038f8d67d admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:52:08.432585 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49fac3-3303-4355-bfac-d1df8cf01565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:52:08.433242 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49fac3-3303-4355-bfac-d1df8cf01565 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:52:08.433521 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49fac3-3303-4355-bfac-d1df8cf01565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:52:08.433795 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49fac3-3303-4355-bfac-d1df8cf01565 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:52:08.434511 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49fac3-3303-4355-bfac-d1df8cf01565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:52:08.435567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: WARNING py.warnings [None req-fd49fac3-3303-4355-bfac-d1df8cf01565 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 05:52:08.435567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: warnings.warn(msg) Jul 04 05:52:08.435567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: Jul 04 05:52:08.436446 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49fac3-3303-4355-bfac-d1df8cf01565 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:52:08.449725 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 749/1500] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:52:08.453800 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c17c1-28dc-405e-a268-8861eeca8d8c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:52:08.464563 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c17c1-28dc-405e-a268-8861eeca8d8c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:52:08.469980 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202b1b0-bdab-471e-83cc-d810e4776ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:52:08.470861 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202b1b0-bdab-471e-83cc-d810e4776ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:52:08.471136 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202b1b0-bdab-471e-83cc-d810e4776ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:52:08.471445 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202b1b0-bdab-471e-83cc-d810e4776ae2 admin admin] PATH_INFO: `/v3/projects/f47ef2567bf94fbea4ab8207d295418a/users/07d10dfe9c624702902c4b365cba55d5/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:52:08.486949 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f202b1b0-bdab-471e-83cc-d810e4776ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f47ef2567bf94fbea4ab8207d295418a, user_id=07d10dfe9c624702902c4b365cba55d5, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:52:08.488331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: WARNING py.warnings [None req-f202b1b0-bdab-471e-83cc-d810e4776ae2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 05:52:08.488331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: warnings.warn(msg) Jul 04 05:52:08.488331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: Jul 04 05:52:08.490259 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f202b1b0-bdab-471e-83cc-d810e4776ae2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:52:08.504849 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 752/1501] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:52:08 2022] PUT /identity/v3/projects/f47ef2567bf94fbea4ab8207d295418a/users/07d10dfe9c624702902c4b365cba55d5/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:52:08.523406 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8a82d-bdf0-4d08-97c8-b9110e203590 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:52:08.523700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8a82d-bdf0-4d08-97c8-b9110e203590 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:52:08.523976 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8a82d-bdf0-4d08-97c8-b9110e203590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:52:08.551362 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-52b8a82d-bdf0-4d08-97c8-b9110e203590 None None] MFA Rules not processed for user `07d10dfe9c624702902c4b365cba55d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:52:08.552551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-52b8a82d-bdf0-4d08-97c8-b9110e203590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:52:08.622167 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 750/1502] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:52:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:52:08.640577 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ccb95-127a-4cf9-8fc1-4f65bd0c1994 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:52:08.640951 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ccb95-127a-4cf9-8fc1-4f65bd0c1994 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:52:08.641253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ccb95-127a-4cf9-8fc1-4f65bd0c1994 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:52:08.643381 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 753/1503] 10.222.0.16 () {54 vars in 963 bytes} [Mon Jul 4 05:52:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:52:08.650336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e68b98-d55d-4bbd-b5f6-93aabb47c985 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:52:08.650632 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e68b98-d55d-4bbd-b5f6-93aabb47c985 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:52:08.650916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e68b98-d55d-4bbd-b5f6-93aabb47c985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:52:08.673539 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-e6e68b98-d55d-4bbd-b5f6-93aabb47c985 None None] MFA Rules not processed for user `8103fdfbdcf449a49e770750876bbee3`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:52:08.674743 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e6e68b98-d55d-4bbd-b5f6-93aabb47c985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:52:08.727832 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:52:08.737108 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 751/1504] 10.222.0.16 () {58 vars in 1060 bytes} [Mon Jul 4 05:52:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:52:08.745399 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ccb95-127a-4cf9-8fc1-4f65bd0c1994 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:52:08.756935 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ccb95-127a-4cf9-8fc1-4f65bd0c1994 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:52:08.760835 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96570570-2e04-4fe6-b95d-379ef306c87c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:52:08.761469 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96570570-2e04-4fe6-b95d-379ef306c87c service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:52:08.761751 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96570570-2e04-4fe6-b95d-379ef306c87c service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:52:08.762021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96570570-2e04-4fe6-b95d-379ef306c87c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:52:08.770519 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96570570-2e04-4fe6-b95d-379ef306c87c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:52:08.772081 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96570570-2e04-4fe6-b95d-379ef306c87c service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:52:08.780836 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 754/1505] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:52:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:52:08.829409 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016a49a-5f05-4c3a-9e43-2da4e0ecdc33 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:52:08.829704 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016a49a-5f05-4c3a-9e43-2da4e0ecdc33 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:52:08.829980 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016a49a-5f05-4c3a-9e43-2da4e0ecdc33 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:52:08.831328 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 752/1506] 10.222.0.16 () {52 vars in 829 bytes} [Mon Jul 4 05:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:52:08.835129 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96570570-2e04-4fe6-b95d-379ef306c87c service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:52:08.899671 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96570570-2e04-4fe6-b95d-379ef306c87c service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:52:08.904512 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e918b4c-6013-4d84-b591-3f4f300d58d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:52:08.905364 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e918b4c-6013-4d84-b591-3f4f300d58d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:52:08.905649 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e918b4c-6013-4d84-b591-3f4f300d58d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:52:08.905923 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e918b4c-6013-4d84-b591-3f4f300d58d3 admin admin] PATH_INFO: `/v3/users/07d10dfe9c624702902c4b365cba55d5` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:52:08.907159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e918b4c-6013-4d84-b591-3f4f300d58d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07d10dfe9c624702902c4b365cba55d5)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:52:08.908223 dv-cinder-797333-5-smb devstack@keystone.service[80213]: WARNING py.warnings [None req-2e918b4c-6013-4d84-b591-3f4f300d58d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 05:52:08.908223 dv-cinder-797333-5-smb devstack@keystone.service[80213]: warnings.warn(msg) Jul 04 05:52:08.908223 dv-cinder-797333-5-smb devstack@keystone.service[80213]: Jul 04 05:52:08.909443 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e918b4c-6013-4d84-b591-3f4f300d58d3 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:52:08.979717 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2e918b4c-6013-4d84-b591-3f4f300d58d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07d10dfe9c624702902c4b365cba55d5'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:52:08.992852 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2e918b4c-6013-4d84-b591-3f4f300d58d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07d10dfe9c624702902c4b365cba55d5'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:52:09.002905 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2e918b4c-6013-4d84-b591-3f4f300d58d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07d10dfe9c624702902c4b365cba55d5'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:52:09.003722 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2e918b4c-6013-4d84-b591-3f4f300d58d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07d10dfe9c624702902c4b365cba55d5'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:52:09.021401 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:52:09.023902 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2e918b4c-6013-4d84-b591-3f4f300d58d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07d10dfe9c624702902c4b365cba55d5'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:52:09.031635 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 755/1507] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:52:08 2022] DELETE /identity/v3/users/07d10dfe9c624702902c4b365cba55d5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:52:09.036247 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9f2ac-a2f1-4041-bc75-7fb2603a45b7 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:52:09.036591 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9f2ac-a2f1-4041-bc75-7fb2603a45b7 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:52:09.036896 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9f2ac-a2f1-4041-bc75-7fb2603a45b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:52:09.056460 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-fcd9f2ac-a2f1-4041-bc75-7fb2603a45b7 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:52:09.057724 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-fcd9f2ac-a2f1-4041-bc75-7fb2603a45b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:52:09.119285 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 753/1508] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:52:09.129675 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e918b4c-6013-4d84-b591-3f4f300d58d3 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:52:09.131361 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2e918b4c-6013-4d84-b591-3f4f300d58d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:52:09.188905 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e918b4c-6013-4d84-b591-3f4f300d58d3 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:52:09.193133 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba016b2-5c6c-490a-a251-3a0773398be4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:52:09.193818 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba016b2-5c6c-490a-a251-3a0773398be4 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:52:09.194104 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba016b2-5c6c-490a-a251-3a0773398be4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:52:09.194388 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba016b2-5c6c-490a-a251-3a0773398be4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:52:09.203782 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba016b2-5c6c-490a-a251-3a0773398be4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:52:09.205239 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba016b2-5c6c-490a-a251-3a0773398be4 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:52:09.214896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 756/1509] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:52:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:52:09.572811 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9f2ac-a2f1-4041-bc75-7fb2603a45b7 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:52:09.574352 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-fcd9f2ac-a2f1-4041-bc75-7fb2603a45b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:52:09.587716 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9f2ac-a2f1-4041-bc75-7fb2603a45b7 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:52:09.593082 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c816d-6e1c-443b-87fe-245c41019869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:52:09.593961 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c816d-6e1c-443b-87fe-245c41019869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:52:09.594237 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c816d-6e1c-443b-87fe-245c41019869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:52:09.594591 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c816d-6e1c-443b-87fe-245c41019869 admin admin] PATH_INFO: `/v3/projects/f47ef2567bf94fbea4ab8207d295418a` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:52:09.595849 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c816d-6e1c-443b-87fe-245c41019869 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f47ef2567bf94fbea4ab8207d295418a)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:52:09.596917 dv-cinder-797333-5-smb devstack@keystone.service[80212]: WARNING py.warnings [None req-099c816d-6e1c-443b-87fe-245c41019869 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 05:52:09.596917 dv-cinder-797333-5-smb devstack@keystone.service[80212]: warnings.warn(msg) Jul 04 05:52:09.596917 dv-cinder-797333-5-smb devstack@keystone.service[80212]: Jul 04 05:52:09.598127 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c816d-6e1c-443b-87fe-245c41019869 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:52:09.661824 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-099c816d-6e1c-443b-87fe-245c41019869 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f47ef2567bf94fbea4ab8207d295418a', 'request_id': 'req-099c816d-6e1c-443b-87fe-245c41019869'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:52:09.675284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-099c816d-6e1c-443b-87fe-245c41019869 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f47ef2567bf94fbea4ab8207d295418a', 'request_id': 'req-099c816d-6e1c-443b-87fe-245c41019869'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:52:09.690384 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-099c816d-6e1c-443b-87fe-245c41019869 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f47ef2567bf94fbea4ab8207d295418a', 'request_id': 'req-099c816d-6e1c-443b-87fe-245c41019869'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:52:09.701564 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-099c816d-6e1c-443b-87fe-245c41019869 admin admin] The token cache is being invalidate because project f47ef2567bf94fbea4ab8207d295418a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:52:09.701783 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-099c816d-6e1c-443b-87fe-245c41019869 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:52:09.702567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-099c816d-6e1c-443b-87fe-245c41019869 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:52:09.704203 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 754/1510] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:52:09 2022] DELETE /identity/v3/projects/f47ef2567bf94fbea4ab8207d295418a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 05:52:19.210527 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:52:19.698536 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:53:54.693914 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c4884-5b2e-46b1-b1bd-98113410dfe7 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:53:54.694878 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c4884-5b2e-46b1-b1bd-98113410dfe7 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:53:54.694878 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c4884-5b2e-46b1-b1bd-98113410dfe7 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:53:54.697204 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 05:53:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:53:54.703303 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd8c3a-f59f-496d-945b-ae83feb8825e None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:53:54.703916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd8c3a-f59f-496d-945b-ae83feb8825e None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:53:54.704013 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd8c3a-f59f-496d-945b-ae83feb8825e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:53:54.725171 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-f7bd8c3a-f59f-496d-945b-ae83feb8825e None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:53:54.726380 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f7bd8c3a-f59f-496d-945b-ae83feb8825e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:53:54.793693 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 05:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:53:54.950764 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c4884-5b2e-46b1-b1bd-98113410dfe7 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:53:54.952605 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fc5c4884-5b2e-46b1-b1bd-98113410dfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:53:55.038837 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c4884-5b2e-46b1-b1bd-98113410dfe7 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:53:55.045603 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d8d75-dc93-4bd3-9155-960011258339 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:53:55.046240 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d8d75-dc93-4bd3-9155-960011258339 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:53:55.046519 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d8d75-dc93-4bd3-9155-960011258339 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:53:55.046823 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d8d75-dc93-4bd3-9155-960011258339 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:53:55.060295 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d8d75-dc93-4bd3-9155-960011258339 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:53:55.062718 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d8d75-dc93-4bd3-9155-960011258339 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:53:55.074974 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 758/1513] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:53:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:53:55.909830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e866a66-8362-468e-a747-91592b177106 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:53:55.910424 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e866a66-8362-468e-a747-91592b177106 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:53:55.910424 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e866a66-8362-468e-a747-91592b177106 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:53:55.912175 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 05:53:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:53:55.919377 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31249ace-4427-4a08-ba24-1a77cc8369f5 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:53:55.919886 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31249ace-4427-4a08-ba24-1a77cc8369f5 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:53:55.919994 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31249ace-4427-4a08-ba24-1a77cc8369f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:53:55.940536 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-31249ace-4427-4a08-ba24-1a77cc8369f5 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:53:55.941822 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-31249ace-4427-4a08-ba24-1a77cc8369f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:53:55.950610 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 05:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:53:56.106356 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e866a66-8362-468e-a747-91592b177106 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:53:56.122909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e866a66-8362-468e-a747-91592b177106 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:53:56.128945 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbdb35-68da-4fea-ba43-fc33ad6df7d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:53:56.129615 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbdb35-68da-4fea-ba43-fc33ad6df7d9 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:53:56.129907 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbdb35-68da-4fea-ba43-fc33ad6df7d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:53:56.130185 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbdb35-68da-4fea-ba43-fc33ad6df7d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:53:56.139113 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fbdb35-68da-4fea-ba43-fc33ad6df7d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:53:56.140873 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fbdb35-68da-4fea-ba43-fc33ad6df7d9 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:53:56.151426 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 757/1516] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:53:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:53:56.463291 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08038a1-625c-4862-a9c2-df2a80699b5c None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:53:56.463499 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08038a1-625c-4862-a9c2-df2a80699b5c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:53:56.463757 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08038a1-625c-4862-a9c2-df2a80699b5c None None] PATH_INFO: `/v3` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:53:56.465116 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 760/1517] 10.222.0.70 () {54 vars in 925 bytes} [Mon Jul 4 05:53:56 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:53:56.471968 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904ccfb-987f-4a92-8ffe-da7fa52a70e9 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:53:56.472307 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904ccfb-987f-4a92-8ffe-da7fa52a70e9 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:53:56.472590 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904ccfb-987f-4a92-8ffe-da7fa52a70e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:53:56.492550 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-f904ccfb-987f-4a92-8ffe-da7fa52a70e9 None None] MFA Rules not processed for user `260f58535f4e46a197d00276d37fd515`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:53:56.493782 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f904ccfb-987f-4a92-8ffe-da7fa52a70e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:53:56.560804 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 758/1518] 10.222.0.70 () {58 vars in 1015 bytes} [Mon Jul 4 05:53:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:54:00.377602 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78623bb-ae2a-400d-a0ba-61d3748bbc5f None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:54:00.378465 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78623bb-ae2a-400d-a0ba-61d3748bbc5f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:54:00.378465 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78623bb-ae2a-400d-a0ba-61d3748bbc5f None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:54:00.380738 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 761/1519] 10.222.0.16 () {54 vars in 960 bytes} [Mon Jul 4 05:54:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:54:00.389342 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f2cbd-bef8-4be6-a82a-f227874d6888 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:54:00.389799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f2cbd-bef8-4be6-a82a-f227874d6888 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:54:00.389900 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f2cbd-bef8-4be6-a82a-f227874d6888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:54:00.414031 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-c63f2cbd-bef8-4be6-a82a-f227874d6888 None None] MFA Rules not processed for user `260f58535f4e46a197d00276d37fd515`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:54:00.415410 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c63f2cbd-bef8-4be6-a82a-f227874d6888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:54:00.425580 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 759/1520] 10.222.0.16 () {58 vars in 1057 bytes} [Mon Jul 4 05:54:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:54:00.433608 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78623bb-ae2a-400d-a0ba-61d3748bbc5f None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:54:00.450080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78623bb-ae2a-400d-a0ba-61d3748bbc5f None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:54:00.455967 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829cb7ec-0e38-472a-9abe-449790dc66f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260f58535f4e46a197d00276d37fd515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:54:00.456604 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cb7ec-0e38-472a-9abe-449790dc66f4 service placement] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:54:00.456888 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cb7ec-0e38-472a-9abe-449790dc66f4 service placement] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:54:00.457142 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cb7ec-0e38-472a-9abe-449790dc66f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:54:00.465665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829cb7ec-0e38-472a-9abe-449790dc66f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:54:00.467328 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829cb7ec-0e38-472a-9abe-449790dc66f4 service placement] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:54:00.476867 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 762/1521] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:54:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:54:07.385448 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d7e57-742d-45d1-bbd0-cf9af66523ec None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:54:07.386023 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d7e57-742d-45d1-bbd0-cf9af66523ec None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:54:07.386023 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d7e57-742d-45d1-bbd0-cf9af66523ec None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:54:07.387339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 05:54:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:54:07.392518 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51be79-51c9-4449-bff5-1a81761ca160 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:54:07.392974 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51be79-51c9-4449-bff5-1a81761ca160 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:54:07.393069 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51be79-51c9-4449-bff5-1a81761ca160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:54:07.413166 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-dd51be79-51c9-4449-bff5-1a81761ca160 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:54:07.414348 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-dd51be79-51c9-4449-bff5-1a81761ca160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:54:07.422887 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 05:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:54:07.576685 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d7e57-742d-45d1-bbd0-cf9af66523ec None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:54:07.599724 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d7e57-742d-45d1-bbd0-cf9af66523ec None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:54:07.607824 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d746563-640e-421a-b01c-d98b0e6964d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:54:07.608742 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d746563-640e-421a-b01c-d98b0e6964d7 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:54:07.609022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d746563-640e-421a-b01c-d98b0e6964d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:54:07.609290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d746563-640e-421a-b01c-d98b0e6964d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:54:07.617858 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d746563-640e-421a-b01c-d98b0e6964d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:54:07.619510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d746563-640e-421a-b01c-d98b0e6964d7 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:54:07.628810 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 761/1524] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:54:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:54:08.449674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c94132-fd06-4d1d-8a84-dda0953f38bc None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:54:08.450295 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c94132-fd06-4d1d-8a84-dda0953f38bc None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:54:08.450295 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c94132-fd06-4d1d-8a84-dda0953f38bc None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:54:08.451671 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 05:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:54:08.457638 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b81300-0551-4add-942b-26a2b4d676e1 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:54:08.458381 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b81300-0551-4add-942b-26a2b4d676e1 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:54:08.458530 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b81300-0551-4add-942b-26a2b4d676e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:54:08.485435 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-99b81300-0551-4add-942b-26a2b4d676e1 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:54:08.486640 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-99b81300-0551-4add-942b-26a2b4d676e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:54:08.497260 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 05:54:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:54:08.652392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c94132-fd06-4d1d-8a84-dda0953f38bc None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:54:08.675106 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c94132-fd06-4d1d-8a84-dda0953f38bc None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:54:08.683203 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8cd44-79d5-40b5-82af-f12ed81ac421 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:54:08.683870 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8cd44-79d5-40b5-82af-f12ed81ac421 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:54:08.684147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8cd44-79d5-40b5-82af-f12ed81ac421 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:54:08.684420 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8cd44-79d5-40b5-82af-f12ed81ac421 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:54:08.693362 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8cd44-79d5-40b5-82af-f12ed81ac421 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:54:08.694979 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8cd44-79d5-40b5-82af-f12ed81ac421 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:54:08.705209 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 765/1527] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:54:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:54:12.618715 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06023221-973b-4741-9d49-ad986cd1983c None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:54:12.619654 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06023221-973b-4741-9d49-ad986cd1983c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:54:12.619654 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06023221-973b-4741-9d49-ad986cd1983c None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:54:12.621960 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 05:54:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:54:12.627529 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b7752-258e-4eb5-b7fc-6d06b1eb99bc None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:54:12.627961 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b7752-258e-4eb5-b7fc-6d06b1eb99bc None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:54:12.628099 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b7752-258e-4eb5-b7fc-6d06b1eb99bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:54:12.650299 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-468b7752-258e-4eb5-b7fc-6d06b1eb99bc None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:54:12.651623 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-468b7752-258e-4eb5-b7fc-6d06b1eb99bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:54:12.663372 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 05:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:54:12.741396 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06023221-973b-4741-9d49-ad986cd1983c None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:54:12.743596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-06023221-973b-4741-9d49-ad986cd1983c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:54:12.804437 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06023221-973b-4741-9d49-ad986cd1983c None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:54:12.808467 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e42859-1009-4950-b68d-4178f9c991c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:54:12.809108 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e42859-1009-4950-b68d-4178f9c991c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:54:12.809393 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e42859-1009-4950-b68d-4178f9c991c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:54:12.809673 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e42859-1009-4950-b68d-4178f9c991c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:54:12.819368 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e42859-1009-4950-b68d-4178f9c991c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:54:12.820807 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e42859-1009-4950-b68d-4178f9c991c9 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:54:12.825801 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:54:12.831030 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 764/1530] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:54:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 05:54:14.934736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f51cf5-453a-42a8-995f-3c733d8dd9c2 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:54:14.935481 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f51cf5-453a-42a8-995f-3c733d8dd9c2 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:54:14.935481 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f51cf5-453a-42a8-995f-3c733d8dd9c2 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:54:14.936760 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 05:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:54:14.942310 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41228a-234f-44d4-af39-28c5795971b2 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:54:14.942812 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41228a-234f-44d4-af39-28c5795971b2 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:54:14.942909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41228a-234f-44d4-af39-28c5795971b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:54:14.966321 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-fb41228a-234f-44d4-af39-28c5795971b2 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:54:14.967572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-fb41228a-234f-44d4-af39-28c5795971b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:54:14.976179 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 05:54:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:54:15.014384 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f51cf5-453a-42a8-995f-3c733d8dd9c2 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:54:15.026245 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f51cf5-453a-42a8-995f-3c733d8dd9c2 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:54:15.030223 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc460464-50aa-41ae-b008-ef58d521afe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:54:15.030857 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc460464-50aa-41ae-b008-ef58d521afe5 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:54:15.031142 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc460464-50aa-41ae-b008-ef58d521afe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:54:15.031437 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc460464-50aa-41ae-b008-ef58d521afe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:54:15.041290 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc460464-50aa-41ae-b008-ef58d521afe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:54:15.042757 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc460464-50aa-41ae-b008-ef58d521afe5 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:54:15.052466 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 768/1533] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:54:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:54:18.685818 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9504a3-c154-480b-ab57-7e959f56c420 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:54:18.686745 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9504a3-c154-480b-ab57-7e959f56c420 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:54:18.686745 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9504a3-c154-480b-ab57-7e959f56c420 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:54:18.688774 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 05:54:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:54:18.697440 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced3934-ccb5-404d-a653-8defc9efd280 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:54:18.697893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced3934-ccb5-404d-a653-8defc9efd280 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:54:18.698059 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced3934-ccb5-404d-a653-8defc9efd280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:54:18.718291 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-8ced3934-ccb5-404d-a653-8defc9efd280 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:54:18.719508 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8ced3934-ccb5-404d-a653-8defc9efd280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:54:18.727858 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 05:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:54:19.029184 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9504a3-c154-480b-ab57-7e959f56c420 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:54:19.031387 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-2b9504a3-c154-480b-ab57-7e959f56c420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:54:19.091480 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9504a3-c154-480b-ab57-7e959f56c420 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:54:19.095248 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e111e9b-dfc7-466b-8959-188a6f6d5965 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:54:19.095933 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e111e9b-dfc7-466b-8959-188a6f6d5965 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:54:19.096212 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e111e9b-dfc7-466b-8959-188a6f6d5965 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:54:19.096486 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e111e9b-dfc7-466b-8959-188a6f6d5965 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:54:19.106368 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e111e9b-dfc7-466b-8959-188a6f6d5965 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:54:19.107852 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e111e9b-dfc7-466b-8959-188a6f6d5965 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:54:19.118215 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 767/1536] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:54:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:54:21.192641 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae00517-6741-4595-8eef-eb1729c78ad5 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:54:21.193576 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae00517-6741-4595-8eef-eb1729c78ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:54:21.193576 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae00517-6741-4595-8eef-eb1729c78ad5 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:54:21.195827 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 05:54:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:54:21.202127 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a168ce-7389-4506-adf3-eeb4a2ce0017 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:54:21.202599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a168ce-7389-4506-adf3-eeb4a2ce0017 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:54:21.202721 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a168ce-7389-4506-adf3-eeb4a2ce0017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:54:21.224863 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-c8a168ce-7389-4506-adf3-eeb4a2ce0017 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:54:21.226090 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c8a168ce-7389-4506-adf3-eeb4a2ce0017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:54:21.237307 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 05:54:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:54:21.542282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae00517-6741-4595-8eef-eb1729c78ad5 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:54:21.544687 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-cae00517-6741-4595-8eef-eb1729c78ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:54:21.554073 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=65 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:54:21.561982 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae00517-6741-4595-8eef-eb1729c78ad5 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:54:21.567035 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c284ca6-7574-48bc-9906-b6af91502a4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:54:21.567803 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c284ca6-7574-48bc-9906-b6af91502a4f service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:54:21.568092 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c284ca6-7574-48bc-9906-b6af91502a4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:54:21.568368 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c284ca6-7574-48bc-9906-b6af91502a4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:54:21.578124 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c284ca6-7574-48bc-9906-b6af91502a4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:54:21.579601 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c284ca6-7574-48bc-9906-b6af91502a4f service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:54:21.588882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 771/1539] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:54:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:54:31.218678 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=32 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:54:31.585036 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=5 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:55:52.681801 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617d545-f8c6-4ffb-811b-e8c455c1b752 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:52.682979 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617d545-f8c6-4ffb-811b-e8c455c1b752 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:52.683516 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617d545-f8c6-4ffb-811b-e8c455c1b752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:52.710375 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7172d3c-0a7f-46c7-80b7-63af51eed701 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:52.716211 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7172d3c-0a7f-46c7-80b7-63af51eed701 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:52.716211 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7172d3c-0a7f-46c7-80b7-63af51eed701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:52.716429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-2617d545-f8c6-4ffb-811b-e8c455c1b752 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:55:52.716429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-2617d545-f8c6-4ffb-811b-e8c455c1b752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:55:52.724564 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 769/1540] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:55:52.742597 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-c7172d3c-0a7f-46c7-80b7-63af51eed701 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:55:52.744275 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c7172d3c-0a7f-46c7-80b7-63af51eed701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:55:52.748757 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb391d1-8880-443c-a8b5-d38dff384f4f None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:52.749052 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb391d1-8880-443c-a8b5-d38dff384f4f None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:52.749989 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb391d1-8880-443c-a8b5-d38dff384f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:52.757951 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 772/1541] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:55:52.767372 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592d90b-e906-4918-a52b-9b0194bcc2c9 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:52.768017 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592d90b-e906-4918-a52b-9b0194bcc2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:52.768520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592d90b-e906-4918-a52b-9b0194bcc2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:52.780257 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-bcb391d1-8880-443c-a8b5-d38dff384f4f None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:55:52.781513 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-bcb391d1-8880-443c-a8b5-d38dff384f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:55:52.796730 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 770/1542] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:55:52.798015 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ac10e-f0dd-4f00-a8be-f76532dbaf34 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:52.798252 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-8592d90b-e906-4918-a52b-9b0194bcc2c9 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:55:52.798373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ac10e-f0dd-4f00-a8be-f76532dbaf34 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:52.798573 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ac10e-f0dd-4f00-a8be-f76532dbaf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:52.800031 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8592d90b-e906-4918-a52b-9b0194bcc2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:55:52.813979 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 773/1543] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:55:52.815813 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b839680-a852-4cb7-9726-fb0a23615027 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:52.816761 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b839680-a852-4cb7-9726-fb0a23615027 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:52.817260 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b839680-a852-4cb7-9726-fb0a23615027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:52.827271 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-747ac10e-f0dd-4f00-a8be-f76532dbaf34 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:55:52.828489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-747ac10e-f0dd-4f00-a8be-f76532dbaf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:55:52.842164 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 771/1544] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:55:52.843114 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ac10e-f0dd-4f00-a8be-f76532dbaf34 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:52.856331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9b839680-a852-4cb7-9726-fb0a23615027 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:55:52.857570 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9b839680-a852-4cb7-9726-fb0a23615027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:55:52.862618 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ac10e-f0dd-4f00-a8be-f76532dbaf34 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:52.871060 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c02071-568e-4468-8738-90c5bf7da2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:52.871825 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c02071-568e-4468-8738-90c5bf7da2ca admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:52.872110 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c02071-568e-4468-8738-90c5bf7da2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:52.872386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c02071-568e-4468-8738-90c5bf7da2ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:52.873157 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c02071-568e-4468-8738-90c5bf7da2ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:55:52.873510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c02071-568e-4468-8738-90c5bf7da2ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:52.875120 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c02071-568e-4468-8738-90c5bf7da2ca admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:52.876460 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 774/1545] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:55:52.878008 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99725aba-3aef-49d3-9033-6c2544e3e424 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:52.878656 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99725aba-3aef-49d3-9033-6c2544e3e424 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:52.879479 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99725aba-3aef-49d3-9033-6c2544e3e424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:52.899636 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 772/1546] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:55:52.906961 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c02071-568e-4468-8738-90c5bf7da2ca admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:52.907132 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-99725aba-3aef-49d3-9033-6c2544e3e424 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:55:52.909299 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-99725aba-3aef-49d3-9033-6c2544e3e424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:55:52.911725 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c02071-568e-4468-8738-90c5bf7da2ca admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:52.916453 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116058e3-b24e-4196-870a-a801cb708175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:52.917125 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116058e3-b24e-4196-870a-a801cb708175 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:52.917409 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116058e3-b24e-4196-870a-a801cb708175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:52.917686 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116058e3-b24e-4196-870a-a801cb708175 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:52.918431 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 775/1547] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:55:52.918550 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116058e3-b24e-4196-870a-a801cb708175 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:55:52.918731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116058e3-b24e-4196-870a-a801cb708175 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:52.919556 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f0d46-ad4d-4bf3-b465-33de5fec9d40 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:52.919880 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f0d46-ad4d-4bf3-b465-33de5fec9d40 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:52.920159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f0d46-ad4d-4bf3-b465-33de5fec9d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:52.920487 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116058e3-b24e-4196-870a-a801cb708175 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:52.935036 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 773/1548] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:55:52.938737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44605047-136e-4386-9069-5ac6bae5e151 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:52.939211 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44605047-136e-4386-9069-5ac6bae5e151 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:52.939602 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44605047-136e-4386-9069-5ac6bae5e151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:52.950872 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a59f0d46-ad4d-4bf3-b465-33de5fec9d40 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:55:52.952119 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a59f0d46-ad4d-4bf3-b465-33de5fec9d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:55:52.956943 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-44605047-136e-4386-9069-5ac6bae5e151 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:55:52.958126 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-44605047-136e-4386-9069-5ac6bae5e151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:55:52.960087 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 776/1549] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:55:52.961317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d302e17-feb7-4ec1-803a-4c6545cc79cb None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:52.961631 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d302e17-feb7-4ec1-803a-4c6545cc79cb None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:52.961885 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d302e17-feb7-4ec1-803a-4c6545cc79cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:52.966536 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 774/1550] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:55:52.967986 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd7e58-28f5-48d8-9789-37401f4bf0b6 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:52.968386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd7e58-28f5-48d8-9789-37401f4bf0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:52.968504 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd7e58-28f5-48d8-9789-37401f4bf0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:52.980569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-3d302e17-feb7-4ec1-803a-4c6545cc79cb None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:55:52.981795 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3d302e17-feb7-4ec1-803a-4c6545cc79cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:55:52.986427 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-75cd7e58-28f5-48d8-9789-37401f4bf0b6 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:55:52.987973 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-75cd7e58-28f5-48d8-9789-37401f4bf0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:55:52.990390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 777/1551] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:55:52.991238 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d302e17-feb7-4ec1-803a-4c6545cc79cb None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:52.998137 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 775/1552] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:55:52.999462 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8d801-f45f-432c-ba3e-18c84a52d6b5 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:52.999755 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8d801-f45f-432c-ba3e-18c84a52d6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:53.000034 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8d801-f45f-432c-ba3e-18c84a52d6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:53.000809 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d302e17-feb7-4ec1-803a-4c6545cc79cb None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:53.005283 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb3246-e0f0-424d-8497-33d4a0c22e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:53.005926 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb3246-e0f0-424d-8497-33d4a0c22e65 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:53.006210 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb3246-e0f0-424d-8497-33d4a0c22e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:53.006502 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb3246-e0f0-424d-8497-33d4a0c22e65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:53.007983 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb3246-e0f0-424d-8497-33d4a0c22e65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:53.009172 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb3246-e0f0-424d-8497-33d4a0c22e65 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:53.019152 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d5d8d801-f45f-432c-ba3e-18c84a52d6b5 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:55:53.020460 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d5d8d801-f45f-432c-ba3e-18c84a52d6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:55:53.030680 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 776/1553] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:55:53.034779 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb254cb-a44e-4f90-a7c3-e2bfd7adb4c8 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:53.034779 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb254cb-a44e-4f90-a7c3-e2bfd7adb4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:53.034779 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb254cb-a44e-4f90-a7c3-e2bfd7adb4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:53.039340 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 778/1554] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:55:52 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:55:53.039340 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb3246-e0f0-424d-8497-33d4a0c22e65 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:53.103464 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb3246-e0f0-424d-8497-33d4a0c22e65 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:53.108773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9d1a0-fd38-42b3-8973-b1da2cb60173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:53.109524 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9d1a0-fd38-42b3-8973-b1da2cb60173 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:53.109806 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9d1a0-fd38-42b3-8973-b1da2cb60173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:53.110082 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9d1a0-fd38-42b3-8973-b1da2cb60173 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:53.110795 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9d1a0-fd38-42b3-8973-b1da2cb60173 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:53.113345 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9d1a0-fd38-42b3-8973-b1da2cb60173 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:53.144559 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 779/1555] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:55:53 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:55:53.145793 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9d1a0-fd38-42b3-8973-b1da2cb60173 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:53.177096 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-dfb254cb-a44e-4f90-a7c3-e2bfd7adb4c8 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:55:53.178311 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-dfb254cb-a44e-4f90-a7c3-e2bfd7adb4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:55:53.208087 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9d1a0-fd38-42b3-8973-b1da2cb60173 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:53.213678 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a37e3-d289-4619-ad84-379839b85465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:53.214372 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a37e3-d289-4619-ad84-379839b85465 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:53.214686 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a37e3-d289-4619-ad84-379839b85465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:53.214959 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a37e3-d289-4619-ad84-379839b85465 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:53.215734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a37e3-d289-4619-ad84-379839b85465 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:55:53.216044 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a37e3-d289-4619-ad84-379839b85465 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:53.217097 dv-cinder-797333-5-smb devstack@keystone.service[80213]: WARNING py.warnings [None req-e68a37e3-d289-4619-ad84-379839b85465 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 05:55:53.217097 dv-cinder-797333-5-smb devstack@keystone.service[80213]: warnings.warn(msg) Jul 04 05:55:53.217097 dv-cinder-797333-5-smb devstack@keystone.service[80213]: Jul 04 05:55:53.218015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a37e3-d289-4619-ad84-379839b85465 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:53.229940 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 780/1556] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:55:53.231137 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a516e7-f1fa-4f71-a0c4-f9a567af2cbe None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:53.231586 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a516e7-f1fa-4f71-a0c4-f9a567af2cbe None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:53.231872 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a516e7-f1fa-4f71-a0c4-f9a567af2cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:53.238705 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 777/1557] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:55:53.239606 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb254cb-a44e-4f90-a7c3-e2bfd7adb4c8 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:53.249861 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-77a516e7-f1fa-4f71-a0c4-f9a567af2cbe None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:55:53.250588 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb254cb-a44e-4f90-a7c3-e2bfd7adb4c8 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:53.251091 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-77a516e7-f1fa-4f71-a0c4-f9a567af2cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:55:53.255282 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653f030-e177-4f0b-9a18-4780742e3e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:53.255934 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653f030-e177-4f0b-9a18-4780742e3e73 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:53.256210 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653f030-e177-4f0b-9a18-4780742e3e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:53.256481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653f030-e177-4f0b-9a18-4780742e3e73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:53.257206 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653f030-e177-4f0b-9a18-4780742e3e73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:55:53.257506 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653f030-e177-4f0b-9a18-4780742e3e73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:53.259095 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653f030-e177-4f0b-9a18-4780742e3e73 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:53.259221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 781/1558] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:55:53.260375 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069bda6-8da7-4be4-b527-d49aa696c031 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:53.260680 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069bda6-8da7-4be4-b527-d49aa696c031 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:53.260940 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069bda6-8da7-4be4-b527-d49aa696c031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:53.271456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 778/1559] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:55:53.272383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653f030-e177-4f0b-9a18-4780742e3e73 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:53.281699 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653f030-e177-4f0b-9a18-4780742e3e73 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:53.284507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a069bda6-8da7-4be4-b527-d49aa696c031 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:55:53.285780 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a069bda6-8da7-4be4-b527-d49aa696c031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:55:53.286485 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74199890-d4e0-4333-8fd4-dbc4c31b21ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:53.287135 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74199890-d4e0-4333-8fd4-dbc4c31b21ab admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:53.287446 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74199890-d4e0-4333-8fd4-dbc4c31b21ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:53.287719 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74199890-d4e0-4333-8fd4-dbc4c31b21ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:53.288436 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74199890-d4e0-4333-8fd4-dbc4c31b21ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:55:53.288745 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74199890-d4e0-4333-8fd4-dbc4c31b21ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:53.290347 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74199890-d4e0-4333-8fd4-dbc4c31b21ab admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:53.293876 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 782/1560] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:55:53.294539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069bda6-8da7-4be4-b527-d49aa696c031 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:53.300132 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:55:53.303606 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 779/1561] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:55:53.304501 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74199890-d4e0-4333-8fd4-dbc4c31b21ab admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:53.305915 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069bda6-8da7-4be4-b527-d49aa696c031 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:53.311103 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f887bc8-b332-42ba-9787-4c0684da5493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:53.312204 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f887bc8-b332-42ba-9787-4c0684da5493 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:53.312547 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f887bc8-b332-42ba-9787-4c0684da5493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:53.312905 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f887bc8-b332-42ba-9787-4c0684da5493 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:53.313712 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f887bc8-b332-42ba-9787-4c0684da5493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:53.314841 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74199890-d4e0-4333-8fd4-dbc4c31b21ab admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:53.315390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: WARNING py.warnings [None req-3f887bc8-b332-42ba-9787-4c0684da5493 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 05:55:53.315390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: warnings.warn(msg) Jul 04 05:55:53.315390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: Jul 04 05:55:53.316676 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f887bc8-b332-42ba-9787-4c0684da5493 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:53.319666 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cce391-bacb-4aac-8218-16c258274ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:53.320323 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cce391-bacb-4aac-8218-16c258274ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:53.320607 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cce391-bacb-4aac-8218-16c258274ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:53.320880 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cce391-bacb-4aac-8218-16c258274ca5 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:53.321562 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cce391-bacb-4aac-8218-16c258274ca5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:53.323489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cce391-bacb-4aac-8218-16c258274ca5 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:53.336741 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 783/1562] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:55:53 2022] POST /identity/v3/users => generated 290 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:55:53.337643 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f887bc8-b332-42ba-9787-4c0684da5493 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:53.347317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f887bc8-b332-42ba-9787-4c0684da5493 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:53.349537 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 780/1563] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:55:53 2022] POST /identity/v3/users => generated 293 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:55:53.350739 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a093f28-9961-4d16-9634-668ade54217e None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:53.351018 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a093f28-9961-4d16-9634-668ade54217e None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:53.351322 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a093f28-9961-4d16-9634-668ade54217e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:53.352012 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f243da4-fed4-4329-9bfd-2d053da5dbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:53.352694 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f243da4-fed4-4329-9bfd-2d053da5dbe3 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:53.352937 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f243da4-fed4-4329-9bfd-2d053da5dbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:53.353212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f243da4-fed4-4329-9bfd-2d053da5dbe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:53.353956 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f243da4-fed4-4329-9bfd-2d053da5dbe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:53.355835 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f243da4-fed4-4329-9bfd-2d053da5dbe3 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:53.369700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-7a093f28-9961-4d16-9634-668ade54217e None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:55:53.370959 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-7a093f28-9961-4d16-9634-668ade54217e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:55:53.379511 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 781/1564] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:55:53.380298 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a093f28-9961-4d16-9634-668ade54217e None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:53.387033 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 784/1565] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:55:53 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:55:53.388165 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f243da4-fed4-4329-9bfd-2d053da5dbe3 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:53.395539 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a093f28-9961-4d16-9634-668ade54217e None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:53.436283 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:55:53.449010 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f243da4-fed4-4329-9bfd-2d053da5dbe3 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:53.453021 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d6023-7845-4eb8-be46-9cce1762de5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:53.453572 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382dd732-29f6-4255-8a1f-6e628ff95e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:53.453720 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d6023-7845-4eb8-be46-9cce1762de5f admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:53.453995 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d6023-7845-4eb8-be46-9cce1762de5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:53.454225 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dd732-29f6-4255-8a1f-6e628ff95e9d admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:53.454347 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d6023-7845-4eb8-be46-9cce1762de5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:53.454493 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dd732-29f6-4255-8a1f-6e628ff95e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:53.454771 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dd732-29f6-4255-8a1f-6e628ff95e9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:53.455045 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d6023-7845-4eb8-be46-9cce1762de5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:55:53.455390 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d6023-7845-4eb8-be46-9cce1762de5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:53.455494 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382dd732-29f6-4255-8a1f-6e628ff95e9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:53.457050 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d6023-7845-4eb8-be46-9cce1762de5f admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:53.457425 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382dd732-29f6-4255-8a1f-6e628ff95e9d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:53.469107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 782/1566] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:55:53.470132 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d6023-7845-4eb8-be46-9cce1762de5f admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:53.480993 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d6023-7845-4eb8-be46-9cce1762de5f admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:53.486422 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94980285-dce9-4849-9c9f-57c9c1b2f9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:53.487520 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94980285-dce9-4849-9c9f-57c9c1b2f9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:53.487871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94980285-dce9-4849-9c9f-57c9c1b2f9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:53.488352 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94980285-dce9-4849-9c9f-57c9c1b2f9d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:53.488889 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94980285-dce9-4849-9c9f-57c9c1b2f9d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:55:53.489220 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94980285-dce9-4849-9c9f-57c9c1b2f9d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:53.490795 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 785/1567] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:55:53 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:55:53.490926 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94980285-dce9-4849-9c9f-57c9c1b2f9d6 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:53.491657 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382dd732-29f6-4255-8a1f-6e628ff95e9d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:53.506105 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 783/1568] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:55:53.507016 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94980285-dce9-4849-9c9f-57c9c1b2f9d6 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:53.523385 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94980285-dce9-4849-9c9f-57c9c1b2f9d6 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:53.559005 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382dd732-29f6-4255-8a1f-6e628ff95e9d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:53.563690 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f65932-ac99-400d-8645-bddd4b892f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:53.564355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f65932-ac99-400d-8645-bddd4b892f67 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:53.564638 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f65932-ac99-400d-8645-bddd4b892f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:53.564909 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f65932-ac99-400d-8645-bddd4b892f67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:53.565597 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f65932-ac99-400d-8645-bddd4b892f67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:53.567658 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f65932-ac99-400d-8645-bddd4b892f67 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:53.579146 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4421ac-6a39-4199-ae66-958053ced97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:53.580070 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4421ac-6a39-4199-ae66-958053ced97a admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:53.580356 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4421ac-6a39-4199-ae66-958053ced97a admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:53.580627 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4421ac-6a39-4199-ae66-958053ced97a admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:53.581361 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4421ac-6a39-4199-ae66-958053ced97a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:53.582964 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4421ac-6a39-4199-ae66-958053ced97a admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:53.593565 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 784/1569] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:55:53.593836 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 786/1570] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:55:53 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:55:53.594400 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4421ac-6a39-4199-ae66-958053ced97a admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:53.594666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f65932-ac99-400d-8645-bddd4b892f67 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:53.604182 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4421ac-6a39-4199-ae66-958053ced97a admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:53.632597 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:55:53.655972 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f65932-ac99-400d-8645-bddd4b892f67 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:53.658933 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396e557-8171-45b7-9215-f15841b26703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:53.659648 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396e557-8171-45b7-9215-f15841b26703 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:53.659932 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396e557-8171-45b7-9215-f15841b26703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:53.660237 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396e557-8171-45b7-9215-f15841b26703 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:53.660964 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396e557-8171-45b7-9215-f15841b26703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:53.661080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915c1a9-7fb8-4bcf-9247-06b35c02fb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:53.661893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915c1a9-7fb8-4bcf-9247-06b35c02fb88 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:53.662180 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915c1a9-7fb8-4bcf-9247-06b35c02fb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:53.662456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915c1a9-7fb8-4bcf-9247-06b35c02fb88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:53.662568 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396e557-8171-45b7-9215-f15841b26703 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:53.663206 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915c1a9-7fb8-4bcf-9247-06b35c02fb88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:55:53.663519 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915c1a9-7fb8-4bcf-9247-06b35c02fb88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:53.665283 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915c1a9-7fb8-4bcf-9247-06b35c02fb88 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:53.676250 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 785/1571] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:55:53.677239 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396e557-8171-45b7-9215-f15841b26703 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:53.677733 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 787/1572] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:55:53.678476 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915c1a9-7fb8-4bcf-9247-06b35c02fb88 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:53.689117 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396e557-8171-45b7-9215-f15841b26703 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:53.689699 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915c1a9-7fb8-4bcf-9247-06b35c02fb88 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:53.694498 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9316c-1512-482f-8662-803aa708b765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:53.694667 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6614be-f682-4767-9a46-75c9e528c407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:53.695151 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9316c-1512-482f-8662-803aa708b765 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:53.695304 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6614be-f682-4767-9a46-75c9e528c407 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:53.695455 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9316c-1512-482f-8662-803aa708b765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:53.695568 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6614be-f682-4767-9a46-75c9e528c407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:53.695758 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9316c-1512-482f-8662-803aa708b765 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:53.695864 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6614be-f682-4767-9a46-75c9e528c407 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:53.696462 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9316c-1512-482f-8662-803aa708b765 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:53.696572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6614be-f682-4767-9a46-75c9e528c407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:53.698408 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6614be-f682-4767-9a46-75c9e528c407 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:53.698522 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9316c-1512-482f-8662-803aa708b765 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:53.720103 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 786/1573] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:55:53 2022] POST /identity/v3/users => generated 296 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:55:53.721135 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6614be-f682-4767-9a46-75c9e528c407 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:53.726133 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 788/1574] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:55:53 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:55:53.726926 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9316c-1512-482f-8662-803aa708b765 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:53.732753 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6614be-f682-4767-9a46-75c9e528c407 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:53.772559 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:55:53.789222 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9316c-1512-482f-8662-803aa708b765 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:53.792330 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f4f4e-c135-4c19-bada-90e2043c4e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:53.793011 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f4f4e-c135-4c19-bada-90e2043c4e43 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:53.793292 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f4f4e-c135-4c19-bada-90e2043c4e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:53.793567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f4f4e-c135-4c19-bada-90e2043c4e43 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:53.794262 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f4f4e-c135-4c19-bada-90e2043c4e43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:53.794459 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb4c8f-a7fc-4784-9b22-c978072d19e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:53.795096 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb4c8f-a7fc-4784-9b22-c978072d19e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:53.795402 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb4c8f-a7fc-4784-9b22-c978072d19e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:53.795679 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb4c8f-a7fc-4784-9b22-c978072d19e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:53.796243 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f4f4e-c135-4c19-bada-90e2043c4e43 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:53.796364 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb4c8f-a7fc-4784-9b22-c978072d19e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:53.798244 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb4c8f-a7fc-4784-9b22-c978072d19e2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:53.816090 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 787/1575] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:55:53 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:55:53.820196 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f4f4e-c135-4c19-bada-90e2043c4e43 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:53.824354 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 789/1576] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:55:53 2022] POST /identity/v3/projects => generated 369 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:55:53.825143 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb4c8f-a7fc-4784-9b22-c978072d19e2 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:53.831914 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f4f4e-c135-4c19-bada-90e2043c4e43 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:53.890053 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054b909-4d7c-4c5f-b11d-ce4f9c166b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:53.890850 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054b909-4d7c-4c5f-b11d-ce4f9c166b47 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:53.891229 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054b909-4d7c-4c5f-b11d-ce4f9c166b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:53.891577 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054b909-4d7c-4c5f-b11d-ce4f9c166b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:53.892308 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054b909-4d7c-4c5f-b11d-ce4f9c166b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:53.893961 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054b909-4d7c-4c5f-b11d-ce4f9c166b47 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:53.895069 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb4c8f-a7fc-4784-9b22-c978072d19e2 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:53.900972 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64feb99e-41e8-431e-b95a-1dd0710c38cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:53.901667 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64feb99e-41e8-431e-b95a-1dd0710c38cd admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:53.901941 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64feb99e-41e8-431e-b95a-1dd0710c38cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:53.902208 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64feb99e-41e8-431e-b95a-1dd0710c38cd admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:53.902916 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64feb99e-41e8-431e-b95a-1dd0710c38cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:53.908232 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 788/1577] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:55:53.908396 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64feb99e-41e8-431e-b95a-1dd0710c38cd admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:53.908504 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054b909-4d7c-4c5f-b11d-ce4f9c166b47 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:53.917095 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054b909-4d7c-4c5f-b11d-ce4f9c166b47 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:53.922600 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f5dc1-68aa-4f62-b3d2-0a85a82056d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:53.923324 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f5dc1-68aa-4f62-b3d2-0a85a82056d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:53.923609 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f5dc1-68aa-4f62-b3d2-0a85a82056d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:53.923904 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f5dc1-68aa-4f62-b3d2-0a85a82056d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:53.924809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f5dc1-68aa-4f62-b3d2-0a85a82056d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:53.926516 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f5dc1-68aa-4f62-b3d2-0a85a82056d1 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:53.929435 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 790/1578] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:55:53 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:55:53.930231 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64feb99e-41e8-431e-b95a-1dd0710c38cd admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:53.939755 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 789/1579] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:55:53.939755 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f5dc1-68aa-4f62-b3d2-0a85a82056d1 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:53.942428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64feb99e-41e8-431e-b95a-1dd0710c38cd admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:53.947092 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48de2f2-8695-4c62-9722-6d8b00067a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:53.947331 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f5dc1-68aa-4f62-b3d2-0a85a82056d1 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:53.947770 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48de2f2-8695-4c62-9722-6d8b00067a6d admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:53.948051 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48de2f2-8695-4c62-9722-6d8b00067a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:53.948326 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48de2f2-8695-4c62-9722-6d8b00067a6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:53.949007 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48de2f2-8695-4c62-9722-6d8b00067a6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:53.950919 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48de2f2-8695-4c62-9722-6d8b00067a6d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:53.951780 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619c75b-96e7-48d8-bc2f-38cfe7be8da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:53.952432 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619c75b-96e7-48d8-bc2f-38cfe7be8da8 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:53.952716 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619c75b-96e7-48d8-bc2f-38cfe7be8da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:53.952988 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619c75b-96e7-48d8-bc2f-38cfe7be8da8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:53.953710 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619c75b-96e7-48d8-bc2f-38cfe7be8da8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:53.955321 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619c75b-96e7-48d8-bc2f-38cfe7be8da8 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:53.965815 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 790/1580] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:55:53.966799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619c75b-96e7-48d8-bc2f-38cfe7be8da8 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:53.976075 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:55:53.980125 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619c75b-96e7-48d8-bc2f-38cfe7be8da8 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:53.983505 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 791/1581] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:55:53 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:55:53.984379 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48de2f2-8695-4c62-9722-6d8b00067a6d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:53.985046 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d86d3-0ed9-4825-81b7-2aaa71eba2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:53.985703 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d86d3-0ed9-4825-81b7-2aaa71eba2f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:53.985979 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d86d3-0ed9-4825-81b7-2aaa71eba2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:53.986252 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d86d3-0ed9-4825-81b7-2aaa71eba2f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:53.987371 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d86d3-0ed9-4825-81b7-2aaa71eba2f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:53.989538 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d86d3-0ed9-4825-81b7-2aaa71eba2f5 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:54.010823 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 791/1582] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:55:53 2022] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:55:54.011889 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d86d3-0ed9-4825-81b7-2aaa71eba2f5 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:54.021256 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d86d3-0ed9-4825-81b7-2aaa71eba2f5 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:54.048147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48de2f2-8695-4c62-9722-6d8b00067a6d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:54.052710 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec40089-f3d6-4da6-a45e-463278843e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:54.053402 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec40089-f3d6-4da6-a45e-463278843e1a admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:54.053678 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec40089-f3d6-4da6-a45e-463278843e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:54.053948 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec40089-f3d6-4da6-a45e-463278843e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:54.054662 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec40089-f3d6-4da6-a45e-463278843e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:54.056316 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec40089-f3d6-4da6-a45e-463278843e1a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:54.065954 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 792/1583] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:55:54.066814 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec40089-f3d6-4da6-a45e-463278843e1a admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:54.076052 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec40089-f3d6-4da6-a45e-463278843e1a admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:54.076831 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2d699-0ad4-4887-87f3-1688190fb612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:54.077219 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2d699-0ad4-4887-87f3-1688190fb612 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:54.077506 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2d699-0ad4-4887-87f3-1688190fb612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:54.077781 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2d699-0ad4-4887-87f3-1688190fb612 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:54.078512 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2d699-0ad4-4887-87f3-1688190fb612 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:54.080480 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2d699-0ad4-4887-87f3-1688190fb612 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:54.081541 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d3139-e122-43a7-a29b-d92e5d3c6bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:54.082586 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d3139-e122-43a7-a29b-d92e5d3c6bf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:54.082848 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d3139-e122-43a7-a29b-d92e5d3c6bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:54.083120 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d3139-e122-43a7-a29b-d92e5d3c6bf6 admin admin] PATH_INFO: `/v3/projects/f8958024d7994077956f35547e0a0704/users/aab0dd125b4d481fa6a950b1d0269b38/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:54.099226 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d3139-e122-43a7-a29b-d92e5d3c6bf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8958024d7994077956f35547e0a0704, user_id=aab0dd125b4d481fa6a950b1d0269b38, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:54.101381 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 792/1584] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:55:54 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:55:54.103159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d3139-e122-43a7-a29b-d92e5d3c6bf6 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:54.104142 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2d699-0ad4-4887-87f3-1688190fb612 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:54.114748 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2d699-0ad4-4887-87f3-1688190fb612 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:54.119415 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 793/1585] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:55:54 2022] PUT /identity/v3/projects/f8958024d7994077956f35547e0a0704/users/aab0dd125b4d481fa6a950b1d0269b38/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:55:54.120428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d3139-e122-43a7-a29b-d92e5d3c6bf6 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:54.131361 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:55:54.179216 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44b031-da49-4942-9957-33ddf8a3bb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:54.179817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44b031-da49-4942-9957-33ddf8a3bb4a admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:54.180099 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44b031-da49-4942-9957-33ddf8a3bb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:54.180390 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44b031-da49-4942-9957-33ddf8a3bb4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:54.181118 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44b031-da49-4942-9957-33ddf8a3bb4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:54.182750 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44b031-da49-4942-9957-33ddf8a3bb4a admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:54.183558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d3139-e122-43a7-a29b-d92e5d3c6bf6 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:54.188404 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024b97c-b3ed-488d-9976-13540d9874c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:54.189327 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024b97c-b3ed-488d-9976-13540d9874c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:54.189607 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024b97c-b3ed-488d-9976-13540d9874c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:54.189897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024b97c-b3ed-488d-9976-13540d9874c8 admin admin] PATH_INFO: `/v3/projects/76105b4e55f64060abfdcf7f3ce4e9a6/users/80530ec93cb14d3d81032537d21a82f2/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:54.195507 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 793/1586] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:55:54.195507 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44b031-da49-4942-9957-33ddf8a3bb4a admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:54.202659 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44b031-da49-4942-9957-33ddf8a3bb4a admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:54.205262 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024b97c-b3ed-488d-9976-13540d9874c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76105b4e55f64060abfdcf7f3ce4e9a6, user_id=80530ec93cb14d3d81032537d21a82f2, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:54.207249 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553385a9-0217-41bb-834d-6b075f8cb13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:54.207896 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553385a9-0217-41bb-834d-6b075f8cb13f admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:54.208086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024b97c-b3ed-488d-9976-13540d9874c8 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:54.208182 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553385a9-0217-41bb-834d-6b075f8cb13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:54.208441 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553385a9-0217-41bb-834d-6b075f8cb13f admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:54.209148 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553385a9-0217-41bb-834d-6b075f8cb13f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:54.210709 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553385a9-0217-41bb-834d-6b075f8cb13f admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:54.221314 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 794/1587] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:55:54.222094 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 794/1588] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:55:54 2022] PUT /identity/v3/projects/76105b4e55f64060abfdcf7f3ce4e9a6/users/80530ec93cb14d3d81032537d21a82f2/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:55:54.222228 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553385a9-0217-41bb-834d-6b075f8cb13f admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:54.223970 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024b97c-b3ed-488d-9976-13540d9874c8 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:54.234434 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553385a9-0217-41bb-834d-6b075f8cb13f admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:54.285097 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:55:54.291434 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ef13a-8628-4ba7-b432-e5987ba7e4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:54.291592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024b97c-b3ed-488d-9976-13540d9874c8 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:54.292136 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ef13a-8628-4ba7-b432-e5987ba7e4f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:54.292404 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ef13a-8628-4ba7-b432-e5987ba7e4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:54.292738 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ef13a-8628-4ba7-b432-e5987ba7e4f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:54.293413 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ef13a-8628-4ba7-b432-e5987ba7e4f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:54.295389 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ef13a-8628-4ba7-b432-e5987ba7e4f8 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:54.297862 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e03f7-a188-4447-8b72-d987cd31e806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:54.298540 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e03f7-a188-4447-8b72-d987cd31e806 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:54.298816 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e03f7-a188-4447-8b72-d987cd31e806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:54.299086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e03f7-a188-4447-8b72-d987cd31e806 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:54.299873 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e03f7-a188-4447-8b72-d987cd31e806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:54.301544 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e03f7-a188-4447-8b72-d987cd31e806 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:54.312931 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 795/1589] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:55:54.314126 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e03f7-a188-4447-8b72-d987cd31e806 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:54.316192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 795/1590] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:55:54 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:55:54.317040 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ef13a-8628-4ba7-b432-e5987ba7e4f8 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:54.324430 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e03f7-a188-4447-8b72-d987cd31e806 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:54.326663 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ef13a-8628-4ba7-b432-e5987ba7e4f8 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:54.329558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370b1bd-2599-4ab4-905e-661eebbd2eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:54.330209 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370b1bd-2599-4ab4-905e-661eebbd2eee admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:54.330489 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370b1bd-2599-4ab4-905e-661eebbd2eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:54.330761 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370b1bd-2599-4ab4-905e-661eebbd2eee admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:54.331163 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17019f5-e9b4-4afd-901e-ac8b9544e5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:54.331633 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370b1bd-2599-4ab4-905e-661eebbd2eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:54.331883 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17019f5-e9b4-4afd-901e-ac8b9544e5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:54.332172 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17019f5-e9b4-4afd-901e-ac8b9544e5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:54.332453 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17019f5-e9b4-4afd-901e-ac8b9544e5e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:54.333177 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17019f5-e9b4-4afd-901e-ac8b9544e5e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:54.333317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370b1bd-2599-4ab4-905e-661eebbd2eee admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:54.334778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17019f5-e9b4-4afd-901e-ac8b9544e5e6 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:54.343656 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 796/1591] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:55:54.345002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001b667-c1ec-40df-bc41-3878d663e1ef None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:54.348046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001b667-c1ec-40df-bc41-3878d663e1ef None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:54.348224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 796/1592] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:55:54.348338 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001b667-c1ec-40df-bc41-3878d663e1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:54.348431 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17019f5-e9b4-4afd-901e-ac8b9544e5e6 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:54.355818 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17019f5-e9b4-4afd-901e-ac8b9544e5e6 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:54.360248 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd417f-8c67-492c-a1d5-793a76749231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:54.360890 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd417f-8c67-492c-a1d5-793a76749231 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:54.361167 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd417f-8c67-492c-a1d5-793a76749231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:54.361442 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd417f-8c67-492c-a1d5-793a76749231 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:54.362488 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd417f-8c67-492c-a1d5-793a76749231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:54.363387 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-1001b667-c1ec-40df-bc41-3878d663e1ef None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:55:54.364100 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd417f-8c67-492c-a1d5-793a76749231 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:54.364592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1001b667-c1ec-40df-bc41-3878d663e1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:55:54.372517 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 797/1593] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:55:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:55:54.373275 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001b667-c1ec-40df-bc41-3878d663e1ef None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:54.378883 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 797/1594] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:55:54.380291 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62a32e-fe51-44aa-a7bb-d7ebfccddd36 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:54.380699 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62a32e-fe51-44aa-a7bb-d7ebfccddd36 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:54.380979 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62a32e-fe51-44aa-a7bb-d7ebfccddd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:54.383261 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001b667-c1ec-40df-bc41-3878d663e1ef None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:54.387984 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1dc44b-dee7-45a0-ae7f-665d76927652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:54.388903 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1dc44b-dee7-45a0-ae7f-665d76927652 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:54.389185 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1dc44b-dee7-45a0-ae7f-665d76927652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:54.389460 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1dc44b-dee7-45a0-ae7f-665d76927652 admin admin] PATH_INFO: `/v3/projects/9550f8cb26ff4319ab4706466fc22f11/users/bd06f1f3ff124acbaede2c9fb1f116a0/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:54.405431 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1dc44b-dee7-45a0-ae7f-665d76927652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9550f8cb26ff4319ab4706466fc22f11, user_id=bd06f1f3ff124acbaede2c9fb1f116a0, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:54.407111 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-9f62a32e-fe51-44aa-a7bb-d7ebfccddd36 None None] MFA Rules not processed for user `80530ec93cb14d3d81032537d21a82f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:55:54.408187 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1dc44b-dee7-45a0-ae7f-665d76927652 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:54.408357 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9f62a32e-fe51-44aa-a7bb-d7ebfccddd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:55:54.422358 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 798/1595] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:55:54 2022] PUT /identity/v3/projects/9550f8cb26ff4319ab4706466fc22f11/users/bd06f1f3ff124acbaede2c9fb1f116a0/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:55:54.423003 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1dc44b-dee7-45a0-ae7f-665d76927652 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:54.472904 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:55:54.483026 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 798/1596] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:55:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:55:54.483026 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62a32e-fe51-44aa-a7bb-d7ebfccddd36 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:54.490889 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1dc44b-dee7-45a0-ae7f-665d76927652 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:54.491497 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62a32e-fe51-44aa-a7bb-d7ebfccddd36 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:54.495775 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fcdee3-9c0d-4f24-a2af-8e48541035ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:54.495946 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a738654-f73c-4544-9a75-bc15e63b19c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:54.496600 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a738654-f73c-4544-9a75-bc15e63b19c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:54.496703 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcdee3-9c0d-4f24-a2af-8e48541035ff admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:54.496879 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a738654-f73c-4544-9a75-bc15e63b19c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:54.496978 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcdee3-9c0d-4f24-a2af-8e48541035ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:54.497153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a738654-f73c-4544-9a75-bc15e63b19c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:54.497251 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcdee3-9c0d-4f24-a2af-8e48541035ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:54.497968 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fcdee3-9c0d-4f24-a2af-8e48541035ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:54.498096 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a738654-f73c-4544-9a75-bc15e63b19c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:54.499800 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fcdee3-9c0d-4f24-a2af-8e48541035ff admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:54.499896 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a738654-f73c-4544-9a75-bc15e63b19c8 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:54.513509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 799/1597] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:55:54.513716 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 799/1598] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:55:54.513813 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fcdee3-9c0d-4f24-a2af-8e48541035ff admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:54.513906 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a738654-f73c-4544-9a75-bc15e63b19c8 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:54.522709 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a738654-f73c-4544-9a75-bc15e63b19c8 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:54.527243 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fcdee3-9c0d-4f24-a2af-8e48541035ff admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:54.531442 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df9597-2762-45b4-b79f-595d866bd865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:54.532130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df9597-2762-45b4-b79f-595d866bd865 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:54.532407 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df9597-2762-45b4-b79f-595d866bd865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:54.532696 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df9597-2762-45b4-b79f-595d866bd865 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:54.533448 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df9597-2762-45b4-b79f-595d866bd865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:54.533779 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b997a-0613-4f43-9a21-e33dc3153062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:54.534684 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b997a-0613-4f43-9a21-e33dc3153062 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:54.534990 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b997a-0613-4f43-9a21-e33dc3153062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:54.535239 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df9597-2762-45b4-b79f-595d866bd865 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:54.535344 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b997a-0613-4f43-9a21-e33dc3153062 admin admin] PATH_INFO: `/v3/projects/586e394b58204dcc86bd39e6383cebb3/users/1c4799b3a1a046aba74e9a6117d4d532/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:54.547154 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 800/1599] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:55:54.548071 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df9597-2762-45b4-b79f-595d866bd865 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:54.550500 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b997a-0613-4f43-9a21-e33dc3153062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=586e394b58204dcc86bd39e6383cebb3, user_id=1c4799b3a1a046aba74e9a6117d4d532, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:54.553283 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b997a-0613-4f43-9a21-e33dc3153062 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:54.557977 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df9597-2762-45b4-b79f-595d866bd865 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:54.562845 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ddc09-0d22-4dc8-bd38-f6b7a633e9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:54.563795 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ddc09-0d22-4dc8-bd38-f6b7a633e9eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:54.564075 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ddc09-0d22-4dc8-bd38-f6b7a633e9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:54.564344 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ddc09-0d22-4dc8-bd38-f6b7a633e9eb admin admin] PATH_INFO: `/v3/projects/4e6e18ce17b44e9cb6479ca7c6d539df/users/b7a58ffc15f44429b59df4b273748483/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:54.567537 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 800/1600] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:55:54 2022] PUT /identity/v3/projects/586e394b58204dcc86bd39e6383cebb3/users/1c4799b3a1a046aba74e9a6117d4d532/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:55:54.568355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b997a-0613-4f43-9a21-e33dc3153062 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:54.570093 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-637b997a-0613-4f43-9a21-e33dc3153062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:55:54.583423 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ddc09-0d22-4dc8-bd38-f6b7a633e9eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e6e18ce17b44e9cb6479ca7c6d539df, user_id=b7a58ffc15f44429b59df4b273748483, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:54.584477 dv-cinder-797333-5-smb devstack@keystone.service[80212]: WARNING py.warnings [None req-ed6ddc09-0d22-4dc8-bd38-f6b7a633e9eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 05:55:54.584477 dv-cinder-797333-5-smb devstack@keystone.service[80212]: warnings.warn(msg) Jul 04 05:55:54.584477 dv-cinder-797333-5-smb devstack@keystone.service[80212]: Jul 04 05:55:54.586491 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ddc09-0d22-4dc8-bd38-f6b7a633e9eb admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:54.602614 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 801/1601] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:55:54 2022] PUT /identity/v3/projects/4e6e18ce17b44e9cb6479ca7c6d539df/users/b7a58ffc15f44429b59df4b273748483/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:55:54.605149 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20594b5a-d2d5-4f09-bc34-8a69759a4881 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:54.605513 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20594b5a-d2d5-4f09-bc34-8a69759a4881 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:54.605859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20594b5a-d2d5-4f09-bc34-8a69759a4881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:54.624609 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-20594b5a-d2d5-4f09-bc34-8a69759a4881 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:55:54.625814 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-20594b5a-d2d5-4f09-bc34-8a69759a4881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:55:54.631085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b997a-0613-4f43-9a21-e33dc3153062 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:54.663072 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:55:54.681107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2daa0-ac95-45d0-b1db-e7cb7a1ff5c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:54.681919 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2daa0-ac95-45d0-b1db-e7cb7a1ff5c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:54.682298 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2daa0-ac95-45d0-b1db-e7cb7a1ff5c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:54.682679 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2daa0-ac95-45d0-b1db-e7cb7a1ff5c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:54.684611 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 802/1602] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:55:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:55:54.685456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20594b5a-d2d5-4f09-bc34-8a69759a4881 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:54.694874 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20594b5a-d2d5-4f09-bc34-8a69759a4881 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:54.696565 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2daa0-ac95-45d0-b1db-e7cb7a1ff5c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:54.698080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2daa0-ac95-45d0-b1db-e7cb7a1ff5c6 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:54.699399 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa39577-8d2c-4e61-af9f-b3b4c5e65b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:54.700066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa39577-8d2c-4e61-af9f-b3b4c5e65b66 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:54.700358 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa39577-8d2c-4e61-af9f-b3b4c5e65b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:54.700623 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa39577-8d2c-4e61-af9f-b3b4c5e65b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:54.701347 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa39577-8d2c-4e61-af9f-b3b4c5e65b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:54.702955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa39577-8d2c-4e61-af9f-b3b4c5e65b66 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:54.708347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 801/1603] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:55:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:55:54.709839 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9230598-d253-4adb-904a-8d3ece552871 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:54.710240 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9230598-d253-4adb-904a-8d3ece552871 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:54.710459 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9230598-d253-4adb-904a-8d3ece552871 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:54.711710 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 802/1604] 10.222.0.16 () {54 vars in 961 bytes} [Mon Jul 4 05:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:55:54.712473 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9230598-d253-4adb-904a-8d3ece552871 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:54.716432 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 803/1605] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:55:54.716432 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa39577-8d2c-4e61-af9f-b3b4c5e65b66 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:54.724159 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa39577-8d2c-4e61-af9f-b3b4c5e65b66 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:54.728112 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9230598-d253-4adb-904a-8d3ece552871 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:54.729208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21819b-3867-42fb-90c7-8b9af1887de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:54.730205 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21819b-3867-42fb-90c7-8b9af1887de5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:54.730610 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21819b-3867-42fb-90c7-8b9af1887de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:54.730984 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21819b-3867-42fb-90c7-8b9af1887de5 admin admin] PATH_INFO: `/v3/projects/a5c6463ebae941cd8603813bf9ea482d/users/2aab05ec4a0a4265be43a6a33b916bdc/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:54.733414 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cdce20-b53b-465c-b6a4-9f6c78c68431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:54.734668 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdce20-b53b-465c-b6a4-9f6c78c68431 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:54.734783 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdce20-b53b-465c-b6a4-9f6c78c68431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:54.735115 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdce20-b53b-465c-b6a4-9f6c78c68431 admin admin] PATH_INFO: `/v3/projects/362564732c384a81937b954dd6e4370e/users/75f4eab7b971447bbe964e79fa6bf3c5/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:54.749618 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21819b-3867-42fb-90c7-8b9af1887de5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5c6463ebae941cd8603813bf9ea482d, user_id=2aab05ec4a0a4265be43a6a33b916bdc, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:54.751142 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cdce20-b53b-465c-b6a4-9f6c78c68431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=362564732c384a81937b954dd6e4370e, user_id=75f4eab7b971447bbe964e79fa6bf3c5, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:54.752590 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21819b-3867-42fb-90c7-8b9af1887de5 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:54.753978 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cdce20-b53b-465c-b6a4-9f6c78c68431 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:54.769519 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 804/1606] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:55:54 2022] PUT /identity/v3/projects/a5c6463ebae941cd8603813bf9ea482d/users/2aab05ec4a0a4265be43a6a33b916bdc/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:55:54.769857 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 803/1607] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:55:54 2022] PUT /identity/v3/projects/362564732c384a81937b954dd6e4370e/users/75f4eab7b971447bbe964e79fa6bf3c5/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:55:54.773635 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97578402-7cf4-4233-8ee3-eafb12081bd0 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:54.773635 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97578402-7cf4-4233-8ee3-eafb12081bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:54.773635 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97578402-7cf4-4233-8ee3-eafb12081bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:54.777107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40fe6e-0cc4-4b70-9622-0d2c4c6d277a None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:54.777600 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40fe6e-0cc4-4b70-9622-0d2c4c6d277a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:54.778073 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40fe6e-0cc4-4b70-9622-0d2c4c6d277a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:54.803533 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-eb40fe6e-0cc4-4b70-9622-0d2c4c6d277a None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:55:54.804777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-eb40fe6e-0cc4-4b70-9622-0d2c4c6d277a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:55:54.815725 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-97578402-7cf4-4233-8ee3-eafb12081bd0 None None] MFA Rules not processed for user `b7a58ffc15f44429b59df4b273748483`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:55:54.817486 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-97578402-7cf4-4233-8ee3-eafb12081bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:55:54.870493 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 805/1608] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:55:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:55:54.874718 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40fe6e-0cc4-4b70-9622-0d2c4c6d277a None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:54.903913 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 804/1609] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:55:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:55:54.904954 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1159b-d86d-46b7-9d6b-1ebbd436b00b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:54.905305 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1159b-d86d-46b7-9d6b-1ebbd436b00b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:54.905665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1159b-d86d-46b7-9d6b-1ebbd436b00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:54.914273 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:55:54.932264 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-aee1159b-d86d-46b7-9d6b-1ebbd436b00b None None] MFA Rules not processed for user `6f638cc70c994a529a48cb2c92b70384`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:55:54.933671 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-aee1159b-d86d-46b7-9d6b-1ebbd436b00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:55:54.968563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40fe6e-0cc4-4b70-9622-0d2c4c6d277a None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:54.972101 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148d233-8bb0-4d16-a06e-8387d91a1f18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:54.972957 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148d233-8bb0-4d16-a06e-8387d91a1f18 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:54.973315 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148d233-8bb0-4d16-a06e-8387d91a1f18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:54.973650 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148d233-8bb0-4d16-a06e-8387d91a1f18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:54.985245 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148d233-8bb0-4d16-a06e-8387d91a1f18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:54.986687 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148d233-8bb0-4d16-a06e-8387d91a1f18 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:54.996700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 806/1610] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:55:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:55:54.997476 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148d233-8bb0-4d16-a06e-8387d91a1f18 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:55.007022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148d233-8bb0-4d16-a06e-8387d91a1f18 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:55.011436 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cd6ce-bfcf-41f9-b4a9-6e739801f822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:55.012311 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cd6ce-bfcf-41f9-b4a9-6e739801f822 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:55.012589 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cd6ce-bfcf-41f9-b4a9-6e739801f822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:55.012858 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cd6ce-bfcf-41f9-b4a9-6e739801f822 admin admin] PATH_INFO: `/v3/projects/b9f1159d6e564565b40744c4d9604b8d/users/d0cbe353ba294cbf8df37ed3a1b37a44/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:55.013475 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 805/1611] 10.222.0.16 () {58 vars in 1058 bytes} [Mon Jul 4 05:55:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:55:55.014742 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf48b35-fb82-488e-ac7b-ddd3ec2d7302 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:55.014946 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf48b35-fb82-488e-ac7b-ddd3ec2d7302 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:55.015274 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf48b35-fb82-488e-ac7b-ddd3ec2d7302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:55.030644 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1cd6ce-bfcf-41f9-b4a9-6e739801f822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9f1159d6e564565b40744c4d9604b8d, user_id=d0cbe353ba294cbf8df37ed3a1b37a44, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:55.033413 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1cd6ce-bfcf-41f9-b4a9-6e739801f822 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:55.035486 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-7bf48b35-fb82-488e-ac7b-ddd3ec2d7302 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:55:55.036787 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7bf48b35-fb82-488e-ac7b-ddd3ec2d7302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:55:55.047894 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 806/1612] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:55:55.049192 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025d895-d2fd-4dfb-b319-bf474178400e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:55.049541 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025d895-d2fd-4dfb-b319-bf474178400e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:55.049993 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025d895-d2fd-4dfb-b319-bf474178400e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:55.051016 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 807/1613] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:55:54 2022] PUT /identity/v3/projects/b9f1159d6e564565b40744c4d9604b8d/users/d0cbe353ba294cbf8df37ed3a1b37a44/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:55:55.055376 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cd6ce-bfcf-41f9-b4a9-6e739801f822 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:55.105109 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-b025d895-d2fd-4dfb-b319-bf474178400e None None] MFA Rules not processed for user `2aab05ec4a0a4265be43a6a33b916bdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:55:55.107879 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b025d895-d2fd-4dfb-b319-bf474178400e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:55:55.136436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:55:55.147268 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cd6ce-bfcf-41f9-b4a9-6e739801f822 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:55.155242 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba42f6-6fa1-458e-b909-ae55f823d329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:55.156365 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba42f6-6fa1-458e-b909-ae55f823d329 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:55.156787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba42f6-6fa1-458e-b909-ae55f823d329 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:55.157209 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba42f6-6fa1-458e-b909-ae55f823d329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:55.220412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 807/1614] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:55:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:55:55.222190 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7a259-c27f-4528-97a2-a96dd2ffa862 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:55.222753 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7a259-c27f-4528-97a2-a96dd2ffa862 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:55.223709 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7a259-c27f-4528-97a2-a96dd2ffa862 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:55.230453 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 808/1615] 10.222.0.16 () {54 vars in 961 bytes} [Mon Jul 4 05:55:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:55:55.231492 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7a259-c27f-4528-97a2-a96dd2ffa862 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:55.245911 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba42f6-6fa1-458e-b909-ae55f823d329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:55.248054 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba42f6-6fa1-458e-b909-ae55f823d329 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:55.260431 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 808/1616] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:55:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:55:55.262006 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba42f6-6fa1-458e-b909-ae55f823d329 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:55.272452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba42f6-6fa1-458e-b909-ae55f823d329 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:55.277070 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e3d9d-735e-4132-9aac-c32f0f2a1d09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:55.278612 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e3d9d-735e-4132-9aac-c32f0f2a1d09 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:55.278612 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e3d9d-735e-4132-9aac-c32f0f2a1d09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:55.279051 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e3d9d-735e-4132-9aac-c32f0f2a1d09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:55.290269 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e3d9d-735e-4132-9aac-c32f0f2a1d09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:55.292464 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e3d9d-735e-4132-9aac-c32f0f2a1d09 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:55.305886 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 809/1617] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:55:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:55:55.308006 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194ffee-51b2-4bf6-bc67-e1497794c347 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:55.308666 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194ffee-51b2-4bf6-bc67-e1497794c347 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:55.308666 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194ffee-51b2-4bf6-bc67-e1497794c347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:55.345301 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-7194ffee-51b2-4bf6-bc67-e1497794c347 None None] MFA Rules not processed for user `d0cbe353ba294cbf8df37ed3a1b37a44`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:55:55.346194 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7a259-c27f-4528-97a2-a96dd2ffa862 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:55.347020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-7194ffee-51b2-4bf6-bc67-e1497794c347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:55:55.353970 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ccfd9-0c2a-4b08-a11d-064c7a22b155 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:55.354614 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ccfd9-0c2a-4b08-a11d-064c7a22b155 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:55.354892 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ccfd9-0c2a-4b08-a11d-064c7a22b155 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:55.355456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ccfd9-0c2a-4b08-a11d-064c7a22b155 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:55.387816 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:55:55.478472 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 810/1618] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:55:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:55:55.478472 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194ffee-51b2-4bf6-bc67-e1497794c347 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:55.487591 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ccfd9-0c2a-4b08-a11d-064c7a22b155 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:55.491855 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ccfd9-0c2a-4b08-a11d-064c7a22b155 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:55.511710 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194ffee-51b2-4bf6-bc67-e1497794c347 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:55.529994 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 809/1619] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:55:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:55:55.533031 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135ab9b-9c52-4d09-b454-344a365d58c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:55.534165 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274bbe7-8ceb-4000-b82b-a973a97b87e2 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:55.535034 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135ab9b-9c52-4d09-b454-344a365d58c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:55.535312 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135ab9b-9c52-4d09-b454-344a365d58c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:55.535525 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274bbe7-8ceb-4000-b82b-a973a97b87e2 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:55.535865 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274bbe7-8ceb-4000-b82b-a973a97b87e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:55.536493 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135ab9b-9c52-4d09-b454-344a365d58c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:55.537206 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135ab9b-9c52-4d09-b454-344a365d58c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:55.538256 dv-cinder-797333-5-smb devstack@keystone.service[80212]: WARNING py.warnings [None req-f135ab9b-9c52-4d09-b454-344a365d58c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 05:55:55.538256 dv-cinder-797333-5-smb devstack@keystone.service[80212]: warnings.warn(msg) Jul 04 05:55:55.538256 dv-cinder-797333-5-smb devstack@keystone.service[80212]: Jul 04 05:55:55.539503 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135ab9b-9c52-4d09-b454-344a365d58c3 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:55.582328 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d274bbe7-8ceb-4000-b82b-a973a97b87e2 None None] MFA Rules not processed for user `6f638cc70c994a529a48cb2c92b70384`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:55:55.584130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d274bbe7-8ceb-4000-b82b-a973a97b87e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:55:55.597274 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 810/1620] 10.222.0.16 () {58 vars in 1058 bytes} [Mon Jul 4 05:55:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:55:55.608362 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274bbe7-8ceb-4000-b82b-a973a97b87e2 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:55.627441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274bbe7-8ceb-4000-b82b-a973a97b87e2 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:55.635645 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 811/1621] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:55:55 2022] POST /identity/v3/projects => generated 369 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:55:55.637198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135ab9b-9c52-4d09-b454-344a365d58c3 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:55.637486 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30413f-75fb-44a5-8f73-812f7e945f3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:55.638275 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30413f-75fb-44a5-8f73-812f7e945f3e service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:55.638659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30413f-75fb-44a5-8f73-812f7e945f3e service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:55.639340 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30413f-75fb-44a5-8f73-812f7e945f3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:55.709509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:55:55.731874 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30413f-75fb-44a5-8f73-812f7e945f3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:55.736422 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30413f-75fb-44a5-8f73-812f7e945f3e service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:55.756839 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 811/1622] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:55:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:55:55.820039 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135ab9b-9c52-4d09-b454-344a365d58c3 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:55.825222 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7039d-d69a-4893-8bdb-2e92fbc7c7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:55.825991 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7039d-d69a-4893-8bdb-2e92fbc7c7a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:55.826338 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7039d-d69a-4893-8bdb-2e92fbc7c7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:55.826899 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7039d-d69a-4893-8bdb-2e92fbc7c7a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:55.827544 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7039d-d69a-4893-8bdb-2e92fbc7c7a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:55.829602 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7039d-d69a-4893-8bdb-2e92fbc7c7a3 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:55.854472 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2db8ee-26a2-41a7-8725-955683166b74 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:55.854758 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2db8ee-26a2-41a7-8725-955683166b74 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:55.855032 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2db8ee-26a2-41a7-8725-955683166b74 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:55.857004 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 812/1623] 10.222.0.16 () {54 vars in 912 bytes} [Mon Jul 4 05:55:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:55:55.859894 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 812/1624] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:55:55 2022] POST /identity/v3/users => generated 291 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 05:55:55.864134 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2db8ee-26a2-41a7-8725-955683166b74 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:55.867898 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90b2f4-1d37-43bf-8047-698ddaca7dd4 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:55.868457 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90b2f4-1d37-43bf-8047-698ddaca7dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:55.869145 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90b2f4-1d37-43bf-8047-698ddaca7dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:55.887018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2db8ee-26a2-41a7-8725-955683166b74 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:55.899564 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65768a-e9fd-45fd-b883-d5f9ee7195d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:55.900270 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65768a-e9fd-45fd-b883-d5f9ee7195d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:55.900544 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65768a-e9fd-45fd-b883-d5f9ee7195d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:55.903796 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65768a-e9fd-45fd-b883-d5f9ee7195d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:55.904610 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65768a-e9fd-45fd-b883-d5f9ee7195d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:55.906341 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65768a-e9fd-45fd-b883-d5f9ee7195d5 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:55.912009 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-1d90b2f4-1d37-43bf-8047-698ddaca7dd4 None None] MFA Rules not processed for user `6f638cc70c994a529a48cb2c92b70384`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:55:55.913687 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-1d90b2f4-1d37-43bf-8047-698ddaca7dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:55:55.936653 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 813/1625] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:55:55.937604 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65768a-e9fd-45fd-b883-d5f9ee7195d5 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:55.961023 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65768a-e9fd-45fd-b883-d5f9ee7195d5 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:55.970329 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912880e-9965-4691-825a-de68e3fc832e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:55.971409 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912880e-9965-4691-825a-de68e3fc832e admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:55.971696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912880e-9965-4691-825a-de68e3fc832e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:55.971975 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912880e-9965-4691-825a-de68e3fc832e admin admin] PATH_INFO: `/v3/projects/1a041f1204af4dd2b210b34e790aa115/users/5387b46d032849e6ad9e85930dced5d7/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:56.010295 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912880e-9965-4691-825a-de68e3fc832e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a041f1204af4dd2b210b34e790aa115, user_id=5387b46d032849e6ad9e85930dced5d7, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:56.016857 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912880e-9965-4691-825a-de68e3fc832e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:56.021930 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 813/1626] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jul 4 05:55:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:55:56.042921 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90b2f4-1d37-43bf-8047-698ddaca7dd4 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:56.066505 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 814/1627] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:55:55 2022] PUT /identity/v3/projects/1a041f1204af4dd2b210b34e790aa115/users/5387b46d032849e6ad9e85930dced5d7/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:55:56.070749 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912880e-9965-4691-825a-de68e3fc832e admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:56.119399 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:55:56.210036 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90b2f4-1d37-43bf-8047-698ddaca7dd4 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:56.249057 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912880e-9965-4691-825a-de68e3fc832e admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:56.257042 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6aeda3-4b76-4ac5-9e36-66387d89b641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:56.258254 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6aeda3-4b76-4ac5-9e36-66387d89b641 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:56.258594 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6aeda3-4b76-4ac5-9e36-66387d89b641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:56.258910 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6aeda3-4b76-4ac5-9e36-66387d89b641 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:56.260689 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6aeda3-4b76-4ac5-9e36-66387d89b641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:56.262390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6aeda3-4b76-4ac5-9e36-66387d89b641 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:56.281254 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 815/1628] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:55:56.284912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6aeda3-4b76-4ac5-9e36-66387d89b641 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:56.314108 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4103c61-4eb0-4c86-bd39-426cafafa6f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:56.314777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4103c61-4eb0-4c86-bd39-426cafafa6f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:56.315065 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4103c61-4eb0-4c86-bd39-426cafafa6f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:56.315441 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4103c61-4eb0-4c86-bd39-426cafafa6f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:56.428298 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6aeda3-4b76-4ac5-9e36-66387d89b641 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:56.441064 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcc7ac-678b-40ca-98ea-82bd52e8d4b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:56.445000 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcc7ac-678b-40ca-98ea-82bd52e8d4b9 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:56.445345 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcc7ac-678b-40ca-98ea-82bd52e8d4b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:56.445632 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcc7ac-678b-40ca-98ea-82bd52e8d4b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:56.485236 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4103c61-4eb0-4c86-bd39-426cafafa6f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:56.487906 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4103c61-4eb0-4c86-bd39-426cafafa6f9 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:56.526360 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 814/1629] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:55:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:55:56.526602 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4103c61-4eb0-4c86-bd39-426cafafa6f9 service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:56.559577 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4103c61-4eb0-4c86-bd39-426cafafa6f9 service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:56.563858 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:55:56.575492 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf6ce2-7fb2-4756-9cbf-21be080751bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:56.576693 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf6ce2-7fb2-4756-9cbf-21be080751bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:56.576693 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf6ce2-7fb2-4756-9cbf-21be080751bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:56.577893 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf6ce2-7fb2-4756-9cbf-21be080751bb admin admin] PATH_INFO: `/v3/projects/1a041f1204af4dd2b210b34e790aa115/users/5387b46d032849e6ad9e85930dced5d7/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:56.582085 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf6ce2-7fb2-4756-9cbf-21be080751bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a041f1204af4dd2b210b34e790aa115, user_id=5387b46d032849e6ad9e85930dced5d7, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:56.585815 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf6ce2-7fb2-4756-9cbf-21be080751bb admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:56.599651 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adcc7ac-678b-40ca-98ea-82bd52e8d4b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:56.605277 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adcc7ac-678b-40ca-98ea-82bd52e8d4b9 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:56.619705 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 815/1630] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:55:56 2022] PUT /identity/v3/projects/1a041f1204af4dd2b210b34e790aa115/users/5387b46d032849e6ad9e85930dced5d7/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:55:56.630988 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618356c4-9692-4d99-bdc9-2c68eea7fb82 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:56.631318 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618356c4-9692-4d99-bdc9-2c68eea7fb82 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:56.631576 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618356c4-9692-4d99-bdc9-2c68eea7fb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:56.640027 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 816/1631] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:55:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:55:56.693300 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-618356c4-9692-4d99-bdc9-2c68eea7fb82 None None] MFA Rules not processed for user `5387b46d032849e6ad9e85930dced5d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:55:56.693755 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192a03e-746d-4dd2-be20-878abbb1e501 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:56.694184 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192a03e-746d-4dd2-be20-878abbb1e501 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:56.694507 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-618356c4-9692-4d99-bdc9-2c68eea7fb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:55:56.694627 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192a03e-746d-4dd2-be20-878abbb1e501 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:56.696427 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 817/1632] 10.222.0.16 () {54 vars in 912 bytes} [Mon Jul 4 05:55:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:55:56.713134 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61627c5-297f-4c44-8822-a1d83ff91bfc None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:56.713421 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61627c5-297f-4c44-8822-a1d83ff91bfc None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:56.713700 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61627c5-297f-4c44-8822-a1d83ff91bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:56.749011 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-c61627c5-297f-4c44-8822-a1d83ff91bfc None None] MFA Rules not processed for user `6f638cc70c994a529a48cb2c92b70384`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:55:56.753046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c61627c5-297f-4c44-8822-a1d83ff91bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:55:56.791383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:55:56.812590 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 816/1633] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:55:56 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:55:56.825845 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618356c4-9692-4d99-bdc9-2c68eea7fb82 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:56.909423 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 818/1634] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jul 4 05:55:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:55:56.933256 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618356c4-9692-4d99-bdc9-2c68eea7fb82 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:56.937520 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9254cb-85b4-4ada-a8d9-505276dab745 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:56.938465 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9254cb-85b4-4ada-a8d9-505276dab745 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:56.938852 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9254cb-85b4-4ada-a8d9-505276dab745 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:56.939211 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9254cb-85b4-4ada-a8d9-505276dab745 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:56.956501 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9254cb-85b4-4ada-a8d9-505276dab745 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:56.960692 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9254cb-85b4-4ada-a8d9-505276dab745 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:56.985810 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 817/1635] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:55:56 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 05:55:57.101536 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61627c5-297f-4c44-8822-a1d83ff91bfc None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:57.114542 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61627c5-297f-4c44-8822-a1d83ff91bfc None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:57.121988 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91828161-cccf-4d3a-ba56-ee8656f99cb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:57.123009 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91828161-cccf-4d3a-ba56-ee8656f99cb0 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:57.123522 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91828161-cccf-4d3a-ba56-ee8656f99cb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:57.124235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91828161-cccf-4d3a-ba56-ee8656f99cb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:57.137814 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91828161-cccf-4d3a-ba56-ee8656f99cb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:57.139637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91828161-cccf-4d3a-ba56-ee8656f99cb0 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:57.165228 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 819/1636] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:55:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:55:57.457507 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9254cb-85b4-4ada-a8d9-505276dab745 service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:57.470849 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9254cb-85b4-4ada-a8d9-505276dab745 service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:57.480332 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec899c-aaa8-4b2a-82e7-85b8431c21c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:57.481018 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec899c-aaa8-4b2a-82e7-85b8431c21c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:57.481305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec899c-aaa8-4b2a-82e7-85b8431c21c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:57.482859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec899c-aaa8-4b2a-82e7-85b8431c21c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:57.642222 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec899c-aaa8-4b2a-82e7-85b8431c21c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:57.643890 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec899c-aaa8-4b2a-82e7-85b8431c21c9 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:57.669977 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 818/1637] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:55:57 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:55:58.625497 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91828161-cccf-4d3a-ba56-ee8656f99cb0 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:58.743241 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91828161-cccf-4d3a-ba56-ee8656f99cb0 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:58.748556 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba315ea-447e-4bd6-a3cc-5e9f7d995c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:58.749463 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba315ea-447e-4bd6-a3cc-5e9f7d995c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:58.750320 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba315ea-447e-4bd6-a3cc-5e9f7d995c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:58.750320 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba315ea-447e-4bd6-a3cc-5e9f7d995c72 admin admin] PATH_INFO: `/v3/users/b7a58ffc15f44429b59df4b273748483` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:58.751349 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba315ea-447e-4bd6-a3cc-5e9f7d995c72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7a58ffc15f44429b59df4b273748483)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:58.753849 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba315ea-447e-4bd6-a3cc-5e9f7d995c72 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:58.888496 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0ba315ea-447e-4bd6-a3cc-5e9f7d995c72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7a58ffc15f44429b59df4b273748483'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:55:58.920794 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0ba315ea-447e-4bd6-a3cc-5e9f7d995c72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7a58ffc15f44429b59df4b273748483'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:55:59.010069 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0ba315ea-447e-4bd6-a3cc-5e9f7d995c72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7a58ffc15f44429b59df4b273748483'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:55:59.010069 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0ba315ea-447e-4bd6-a3cc-5e9f7d995c72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7a58ffc15f44429b59df4b273748483'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:55:59.010069 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:55:59.018408 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0ba315ea-447e-4bd6-a3cc-5e9f7d995c72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7a58ffc15f44429b59df4b273748483'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:55:59.056776 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 820/1638] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:55:58 2022] DELETE /identity/v3/users/b7a58ffc15f44429b59df4b273748483 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:55:59.058647 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fbaee-485e-4a63-92e6-db87e66a319c None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:59.059159 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fbaee-485e-4a63-92e6-db87e66a319c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:59.059269 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fbaee-485e-4a63-92e6-db87e66a319c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:59.093037 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-a60fbaee-485e-4a63-92e6-db87e66a319c None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:55:59.105075 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-a60fbaee-485e-4a63-92e6-db87e66a319c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:55:59.243988 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 819/1639] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:55:59.340346 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba315ea-447e-4bd6-a3cc-5e9f7d995c72 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:55:59.341937 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0ba315ea-447e-4bd6-a3cc-5e9f7d995c72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:55:59.510840 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba315ea-447e-4bd6-a3cc-5e9f7d995c72 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:55:59.519832 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e0d05-4ec2-4e82-8b1c-3d5c0b2f3195 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:55:59.519832 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e0d05-4ec2-4e82-8b1c-3d5c0b2f3195 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:55:59.519832 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e0d05-4ec2-4e82-8b1c-3d5c0b2f3195 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:55:59.519832 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e0d05-4ec2-4e82-8b1c-3d5c0b2f3195 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:55:59.546262 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e0d05-4ec2-4e82-8b1c-3d5c0b2f3195 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:55:59.546762 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e0d05-4ec2-4e82-8b1c-3d5c0b2f3195 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:55:59.583703 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 821/1640] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:55:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:01.014819 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fbaee-485e-4a63-92e6-db87e66a319c None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:01.017542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-a60fbaee-485e-4a63-92e6-db87e66a319c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:01.035989 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fbaee-485e-4a63-92e6-db87e66a319c None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:01.060136 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fff19d-7727-4c19-a5be-52a9d7e7563b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:01.061536 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fff19d-7727-4c19-a5be-52a9d7e7563b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:01.061979 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fff19d-7727-4c19-a5be-52a9d7e7563b admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:01.062416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fff19d-7727-4c19-a5be-52a9d7e7563b admin admin] PATH_INFO: `/v3/users/d0cbe353ba294cbf8df37ed3a1b37a44` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:01.064095 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fff19d-7727-4c19-a5be-52a9d7e7563b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0cbe353ba294cbf8df37ed3a1b37a44)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:01.065372 dv-cinder-797333-5-smb devstack@keystone.service[80212]: WARNING py.warnings [None req-84fff19d-7727-4c19-a5be-52a9d7e7563b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 05:56:01.065372 dv-cinder-797333-5-smb devstack@keystone.service[80212]: warnings.warn(msg) Jul 04 05:56:01.065372 dv-cinder-797333-5-smb devstack@keystone.service[80212]: Jul 04 05:56:01.067087 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fff19d-7727-4c19-a5be-52a9d7e7563b admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:01.122250 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:01.156586 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-84fff19d-7727-4c19-a5be-52a9d7e7563b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0cbe353ba294cbf8df37ed3a1b37a44'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:01.157507 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-84fff19d-7727-4c19-a5be-52a9d7e7563b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0cbe353ba294cbf8df37ed3a1b37a44'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:01.194356 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-84fff19d-7727-4c19-a5be-52a9d7e7563b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0cbe353ba294cbf8df37ed3a1b37a44'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:01.195143 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-84fff19d-7727-4c19-a5be-52a9d7e7563b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0cbe353ba294cbf8df37ed3a1b37a44'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:01.241737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-84fff19d-7727-4c19-a5be-52a9d7e7563b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0cbe353ba294cbf8df37ed3a1b37a44'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:01.262372 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 820/1641] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:56:01 2022] DELETE /identity/v3/users/d0cbe353ba294cbf8df37ed3a1b37a44 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:01.270253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e53d8e-a448-4c08-ad6d-bbaffab80d82 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:01.271136 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e53d8e-a448-4c08-ad6d-bbaffab80d82 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:01.271573 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e53d8e-a448-4c08-ad6d-bbaffab80d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:01.317670 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fff19d-7727-4c19-a5be-52a9d7e7563b admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:01.320095 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-84fff19d-7727-4c19-a5be-52a9d7e7563b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:01.329238 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-18e53d8e-a448-4c08-ad6d-bbaffab80d82 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:01.330889 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-18e53d8e-a448-4c08-ad6d-bbaffab80d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:01.425817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fff19d-7727-4c19-a5be-52a9d7e7563b admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:01.439703 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8355e-8eb2-4777-acf0-1494f0c8bdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:01.441269 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8355e-8eb2-4777-acf0-1494f0c8bdd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:01.441557 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8355e-8eb2-4777-acf0-1494f0c8bdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:01.441835 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8355e-8eb2-4777-acf0-1494f0c8bdd3 admin admin] PATH_INFO: `/v3/projects/4e6e18ce17b44e9cb6479ca7c6d539df` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:01.443122 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8355e-8eb2-4777-acf0-1494f0c8bdd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e6e18ce17b44e9cb6479ca7c6d539df)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:01.445372 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8355e-8eb2-4777-acf0-1494f0c8bdd3 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:01.486312 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 822/1642] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:01.511300 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e53d8e-a448-4c08-ad6d-bbaffab80d82 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:01.513481 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-18e53d8e-a448-4c08-ad6d-bbaffab80d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:01.551199 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-35f8355e-8eb2-4777-acf0-1494f0c8bdd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e6e18ce17b44e9cb6479ca7c6d539df', 'request_id': 'req-35f8355e-8eb2-4777-acf0-1494f0c8bdd3'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:01.577320 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-35f8355e-8eb2-4777-acf0-1494f0c8bdd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e6e18ce17b44e9cb6479ca7c6d539df', 'request_id': 'req-35f8355e-8eb2-4777-acf0-1494f0c8bdd3'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:01.595847 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-35f8355e-8eb2-4777-acf0-1494f0c8bdd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e6e18ce17b44e9cb6479ca7c6d539df', 'request_id': 'req-35f8355e-8eb2-4777-acf0-1494f0c8bdd3'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:01.639697 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-35f8355e-8eb2-4777-acf0-1494f0c8bdd3 admin admin] The token cache is being invalidate because project 4e6e18ce17b44e9cb6479ca7c6d539df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:56:01.640179 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-35f8355e-8eb2-4777-acf0-1494f0c8bdd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:01.641166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-35f8355e-8eb2-4777-acf0-1494f0c8bdd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:01.651588 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 821/1643] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:56:01 2022] DELETE /identity/v3/projects/4e6e18ce17b44e9cb6479ca7c6d539df => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:01.656496 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cc307-97d4-4f57-9aab-e8d29523aa9a None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:01.656776 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cc307-97d4-4f57-9aab-e8d29523aa9a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:01.657048 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cc307-97d4-4f57-9aab-e8d29523aa9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:01.691599 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e53d8e-a448-4c08-ad6d-bbaffab80d82 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:01.701382 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-a53cc307-97d4-4f57-9aab-e8d29523aa9a None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:01.703784 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-a53cc307-97d4-4f57-9aab-e8d29523aa9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:01.776242 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:01.808664 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:01.830137 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181a158-a4d1-4dc9-a3fa-588ddb3fe4a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:01.830917 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181a158-a4d1-4dc9-a3fa-588ddb3fe4a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:01.832124 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181a158-a4d1-4dc9-a3fa-588ddb3fe4a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:01.832505 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181a158-a4d1-4dc9-a3fa-588ddb3fe4a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:01.838650 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8181a158-a4d1-4dc9-a3fa-588ddb3fe4a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:01.899273 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 822/1644] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:56:01.907549 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fbbbf-7d94-46ef-a386-bd4df36c99c4 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:01.907840 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fbbbf-7d94-46ef-a386-bd4df36c99c4 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:01.908120 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fbbbf-7d94-46ef-a386-bd4df36c99c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:02.009903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-ba6fbbbf-7d94-46ef-a386-bd4df36c99c4 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:02.016671 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ba6fbbbf-7d94-46ef-a386-bd4df36c99c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:02.029805 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181a158-a4d1-4dc9-a3fa-588ddb3fe4a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:02.031324 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181a158-a4d1-4dc9-a3fa-588ddb3fe4a4 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:02.064507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 823/1645] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 05:56:02.078722 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 823/1646] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:02.080281 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181a158-a4d1-4dc9-a3fa-588ddb3fe4a4 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:02.091779 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6fbbbf-7d94-46ef-a386-bd4df36c99c4 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:02.096636 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ba6fbbbf-7d94-46ef-a386-bd4df36c99c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:02.115480 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6fbbbf-7d94-46ef-a386-bd4df36c99c4 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:02.116559 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181a158-a4d1-4dc9-a3fa-588ddb3fe4a4 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:02.121376 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb56d1-c0d5-4e87-9f67-99933aa06d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:02.123202 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb56d1-c0d5-4e87-9f67-99933aa06d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:02.123624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb56d1-c0d5-4e87-9f67-99933aa06d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:02.124034 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb56d1-c0d5-4e87-9f67-99933aa06d65 admin admin] PATH_INFO: `/v3/users/80530ec93cb14d3d81032537d21a82f2` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:02.125780 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb56d1-c0d5-4e87-9f67-99933aa06d65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80530ec93cb14d3d81032537d21a82f2)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:02.128771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb56d1-c0d5-4e87-9f67-99933aa06d65 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:02.131374 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d901543-7920-4c2c-8868-746745e0fe7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:02.136612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d901543-7920-4c2c-8868-746745e0fe7c admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:02.136612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d901543-7920-4c2c-8868-746745e0fe7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:02.136612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d901543-7920-4c2c-8868-746745e0fe7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:02.137374 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d901543-7920-4c2c-8868-746745e0fe7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:56:02.137683 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d901543-7920-4c2c-8868-746745e0fe7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:02.142231 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d901543-7920-4c2c-8868-746745e0fe7c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:02.176344 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 824/1647] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:56:02.177391 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d901543-7920-4c2c-8868-746745e0fe7c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:02.194604 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d901543-7920-4c2c-8868-746745e0fe7c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:02.203176 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad4761-29b4-4d71-8734-c97b391192f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:02.203935 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad4761-29b4-4d71-8734-c97b391192f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:02.204221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad4761-29b4-4d71-8734-c97b391192f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:02.204495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad4761-29b4-4d71-8734-c97b391192f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:02.205243 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad4761-29b4-4d71-8734-c97b391192f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:02.208546 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad4761-29b4-4d71-8734-c97b391192f5 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:02.244955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-83fb56d1-c0d5-4e87-9f67-99933aa06d65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80530ec93cb14d3d81032537d21a82f2'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:02.246706 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-83fb56d1-c0d5-4e87-9f67-99933aa06d65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80530ec93cb14d3d81032537d21a82f2'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:02.269518 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-83fb56d1-c0d5-4e87-9f67-99933aa06d65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80530ec93cb14d3d81032537d21a82f2'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:02.270813 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-83fb56d1-c0d5-4e87-9f67-99933aa06d65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80530ec93cb14d3d81032537d21a82f2'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:02.284182 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 825/1648] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:02 2022] POST /identity/v3/projects => generated 405 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:02.291422 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad4761-29b4-4d71-8734-c97b391192f5 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:02.298219 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-21ad4761-29b4-4d71-8734-c97b391192f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:02.310468 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-83fb56d1-c0d5-4e87-9f67-99933aa06d65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80530ec93cb14d3d81032537d21a82f2'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:02.369662 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 824/1649] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:56:02 2022] DELETE /identity/v3/users/80530ec93cb14d3d81032537d21a82f2 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:02.374538 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac90589-404a-432a-be70-3b149e613b1d None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:02.378606 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac90589-404a-432a-be70-3b149e613b1d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:02.379927 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac90589-404a-432a-be70-3b149e613b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:02.490030 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-2ac90589-404a-432a-be70-3b149e613b1d None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:02.491428 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-2ac90589-404a-432a-be70-3b149e613b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:02.633164 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad4761-29b4-4d71-8734-c97b391192f5 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:02.759864 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 825/1650] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:02.799902 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac90589-404a-432a-be70-3b149e613b1d None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:02.801636 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-2ac90589-404a-432a-be70-3b149e613b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:02.845613 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6787f3-20a9-4987-aff2-6accaf817e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:02.848566 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6787f3-20a9-4987-aff2-6accaf817e18 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:02.849079 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6787f3-20a9-4987-aff2-6accaf817e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:02.850153 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6787f3-20a9-4987-aff2-6accaf817e18 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:02.857746 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6787f3-20a9-4987-aff2-6accaf817e18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:02.861128 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6787f3-20a9-4987-aff2-6accaf817e18 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:02.895033 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:02.929548 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 826/1651] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:02 2022] POST /identity/v3/users => generated 303 bytes in 636 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:02.930901 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6787f3-20a9-4987-aff2-6accaf817e18 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:02.977655 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:02.984430 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6787f3-20a9-4987-aff2-6accaf817e18 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:02.996092 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abfc8de-da56-489d-b4ab-7456129ecf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:02.997246 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfc8de-da56-489d-b4ab-7456129ecf8b admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:02.997710 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfc8de-da56-489d-b4ab-7456129ecf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:02.998077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfc8de-da56-489d-b4ab-7456129ecf8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:02.999865 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abfc8de-da56-489d-b4ab-7456129ecf8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:03.001711 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abfc8de-da56-489d-b4ab-7456129ecf8b admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:03.019444 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac90589-404a-432a-be70-3b149e613b1d None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:03.027389 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 827/1652] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:03.032412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abfc8de-da56-489d-b4ab-7456129ecf8b admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:03.041732 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71244d-8a5d-4680-ab34-081485111ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:03.042529 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71244d-8a5d-4680-ab34-081485111ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:03.042700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71244d-8a5d-4680-ab34-081485111ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:03.042958 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71244d-8a5d-4680-ab34-081485111ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:03.051423 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abfc8de-da56-489d-b4ab-7456129ecf8b admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:03.094824 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed71244d-8a5d-4680-ab34-081485111ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:03.106288 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed71244d-8a5d-4680-ab34-081485111ee8 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:03.112457 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea1c63-9203-4831-a458-89a6d2af3772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:03.115887 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea1c63-9203-4831-a458-89a6d2af3772 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:03.116263 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea1c63-9203-4831-a458-89a6d2af3772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:03.116611 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea1c63-9203-4831-a458-89a6d2af3772 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:03.117429 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea1c63-9203-4831-a458-89a6d2af3772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:03.119146 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea1c63-9203-4831-a458-89a6d2af3772 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:03.120839 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 826/1653] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:03.121957 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71244d-8a5d-4680-ab34-081485111ee8 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:03.125756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ed71244d-8a5d-4680-ab34-081485111ee8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:03.139942 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 828/1654] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:03.147507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea1c63-9203-4831-a458-89a6d2af3772 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:03.151826 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71244d-8a5d-4680-ab34-081485111ee8 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:03.168910 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44fbf0-7086-4a8c-8d23-09b64139eacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:03.188814 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea1c63-9203-4831-a458-89a6d2af3772 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:03.196841 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44fbf0-7086-4a8c-8d23-09b64139eacd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:03.197505 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44fbf0-7086-4a8c-8d23-09b64139eacd admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:03.197927 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44fbf0-7086-4a8c-8d23-09b64139eacd admin admin] PATH_INFO: `/v3/users/2aab05ec4a0a4265be43a6a33b916bdc` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:03.199747 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44fbf0-7086-4a8c-8d23-09b64139eacd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aab05ec4a0a4265be43a6a33b916bdc)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:03.204368 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f042a1-9a4d-4f25-82da-84e806ab1498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:03.205044 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44fbf0-7086-4a8c-8d23-09b64139eacd admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:03.205527 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f042a1-9a4d-4f25-82da-84e806ab1498 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:03.205902 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f042a1-9a4d-4f25-82da-84e806ab1498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:03.206286 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f042a1-9a4d-4f25-82da-84e806ab1498 admin admin] PATH_INFO: `/v3/projects/d975fc0adf754464b4c237b5499982db/users/b9b1e7407f484592a45922687538e543/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:03.267989 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f042a1-9a4d-4f25-82da-84e806ab1498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d975fc0adf754464b4c237b5499982db, user_id=b9b1e7407f484592a45922687538e543, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:03.281126 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f042a1-9a4d-4f25-82da-84e806ab1498 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:03.310054 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 829/1655] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:03 2022] PUT /identity/v3/projects/d975fc0adf754464b4c237b5499982db/users/b9b1e7407f484592a45922687538e543/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:03.320139 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50569295-53dd-4f24-beec-10b4e74c6644 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:03.320739 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50569295-53dd-4f24-beec-10b4e74c6644 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:03.321209 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50569295-53dd-4f24-beec-10b4e74c6644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:03.340467 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-9e44fbf0-7086-4a8c-8d23-09b64139eacd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aab05ec4a0a4265be43a6a33b916bdc'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:03.343502 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-9e44fbf0-7086-4a8c-8d23-09b64139eacd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aab05ec4a0a4265be43a6a33b916bdc'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:03.363512 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-50569295-53dd-4f24-beec-10b4e74c6644 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:03.364429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-9e44fbf0-7086-4a8c-8d23-09b64139eacd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aab05ec4a0a4265be43a6a33b916bdc'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:03.366378 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-9e44fbf0-7086-4a8c-8d23-09b64139eacd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aab05ec4a0a4265be43a6a33b916bdc'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:03.376905 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-50569295-53dd-4f24-beec-10b4e74c6644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:03.432968 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-9e44fbf0-7086-4a8c-8d23-09b64139eacd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aab05ec4a0a4265be43a6a33b916bdc'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:03.475360 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 827/1656] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:56:03 2022] DELETE /identity/v3/users/2aab05ec4a0a4265be43a6a33b916bdc => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:03.480161 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 830/1657] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:03.485056 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1572a-3558-4cf4-b0b6-46a5a873af92 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:03.487522 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1572a-3558-4cf4-b0b6-46a5a873af92 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:03.487943 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1572a-3558-4cf4-b0b6-46a5a873af92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:03.521584 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-1da1572a-3558-4cf4-b0b6-46a5a873af92 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:03.523111 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-1da1572a-3558-4cf4-b0b6-46a5a873af92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:03.582641 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50569295-53dd-4f24-beec-10b4e74c6644 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:03.584527 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-50569295-53dd-4f24-beec-10b4e74c6644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:03.650970 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 828/1658] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:03.720841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50569295-53dd-4f24-beec-10b4e74c6644 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:03.834855 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1572a-3558-4cf4-b0b6-46a5a873af92 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:03.864178 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65fa6f-cf6b-4aea-be31-54a026007010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:03.865357 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65fa6f-cf6b-4aea-be31-54a026007010 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:03.865357 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65fa6f-cf6b-4aea-be31-54a026007010 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:03.865518 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65fa6f-cf6b-4aea-be31-54a026007010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:03.895026 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65fa6f-cf6b-4aea-be31-54a026007010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:03.899394 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65fa6f-cf6b-4aea-be31-54a026007010 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:03.948840 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 831/1659] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:03.984226 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1572a-3558-4cf4-b0b6-46a5a873af92 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:03.997422 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa750fd-35c1-440e-9f54-9ca6f4a599de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:03.998125 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa750fd-35c1-440e-9f54-9ca6f4a599de service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:03.998286 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa750fd-35c1-440e-9f54-9ca6f4a599de service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:03.998947 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa750fd-35c1-440e-9f54-9ca6f4a599de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:04.021351 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa750fd-35c1-440e-9f54-9ca6f4a599de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:04.032482 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa750fd-35c1-440e-9f54-9ca6f4a599de service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:04.038585 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:04.049252 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 829/1660] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 05:56:05.348862 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65fa6f-cf6b-4aea-be31-54a026007010 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:05.350570 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5e65fa6f-cf6b-4aea-be31-54a026007010 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:05.374071 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65fa6f-cf6b-4aea-be31-54a026007010 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:05.391990 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb9ceb-b956-4bd9-a03c-ecd2ca20d1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:05.397343 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb9ceb-b956-4bd9-a03c-ecd2ca20d1dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:05.397637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb9ceb-b956-4bd9-a03c-ecd2ca20d1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:05.397925 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb9ceb-b956-4bd9-a03c-ecd2ca20d1dd admin admin] PATH_INFO: `/v3/projects/76105b4e55f64060abfdcf7f3ce4e9a6` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:05.403269 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb9ceb-b956-4bd9-a03c-ecd2ca20d1dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=76105b4e55f64060abfdcf7f3ce4e9a6)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:05.404472 dv-cinder-797333-5-smb devstack@keystone.service[80213]: WARNING py.warnings [None req-e5eb9ceb-b956-4bd9-a03c-ecd2ca20d1dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 05:56:05.404472 dv-cinder-797333-5-smb devstack@keystone.service[80213]: warnings.warn(msg) Jul 04 05:56:05.404472 dv-cinder-797333-5-smb devstack@keystone.service[80213]: Jul 04 05:56:05.406887 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb9ceb-b956-4bd9-a03c-ecd2ca20d1dd admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:05.413670 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:05.578427 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e5eb9ceb-b956-4bd9-a03c-ecd2ca20d1dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76105b4e55f64060abfdcf7f3ce4e9a6', 'request_id': 'req-e5eb9ceb-b956-4bd9-a03c-ecd2ca20d1dd'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:05.619992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e5eb9ceb-b956-4bd9-a03c-ecd2ca20d1dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76105b4e55f64060abfdcf7f3ce4e9a6', 'request_id': 'req-e5eb9ceb-b956-4bd9-a03c-ecd2ca20d1dd'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:05.642798 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e5eb9ceb-b956-4bd9-a03c-ecd2ca20d1dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76105b4e55f64060abfdcf7f3ce4e9a6', 'request_id': 'req-e5eb9ceb-b956-4bd9-a03c-ecd2ca20d1dd'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:05.661274 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e5eb9ceb-b956-4bd9-a03c-ecd2ca20d1dd admin admin] The token cache is being invalidate because project 76105b4e55f64060abfdcf7f3ce4e9a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:56:05.661513 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e5eb9ceb-b956-4bd9-a03c-ecd2ca20d1dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:05.664575 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e5eb9ceb-b956-4bd9-a03c-ecd2ca20d1dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:05.668302 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 832/1661] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:56:05 2022] DELETE /identity/v3/projects/76105b4e55f64060abfdcf7f3ce4e9a6 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:05.673551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b049b2-f6c2-4fec-8706-140923f78633 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:05.674118 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b049b2-f6c2-4fec-8706-140923f78633 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:05.674282 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b049b2-f6c2-4fec-8706-140923f78633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:05.696433 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-76b049b2-f6c2-4fec-8706-140923f78633 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:05.698385 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-76b049b2-f6c2-4fec-8706-140923f78633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:05.772529 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 830/1662] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:05.780365 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f10b6-67c0-4ac2-845a-ef1bba51b343 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:05.781112 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f10b6-67c0-4ac2-845a-ef1bba51b343 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:05.781582 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f10b6-67c0-4ac2-845a-ef1bba51b343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:05.808897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-c43f10b6-67c0-4ac2-845a-ef1bba51b343 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:05.810445 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c43f10b6-67c0-4ac2-845a-ef1bba51b343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:05.825502 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 833/1663] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:05.827073 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b049b2-f6c2-4fec-8706-140923f78633 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:05.841219 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b049b2-f6c2-4fec-8706-140923f78633 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:05.859159 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635d477-419a-4d3f-a905-dd88cfc5ee8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:05.859910 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635d477-419a-4d3f-a905-dd88cfc5ee8b admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:05.860178 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635d477-419a-4d3f-a905-dd88cfc5ee8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:05.860599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635d477-419a-4d3f-a905-dd88cfc5ee8b admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:05.861354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635d477-419a-4d3f-a905-dd88cfc5ee8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:56:05.861660 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635d477-419a-4d3f-a905-dd88cfc5ee8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:05.864436 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635d477-419a-4d3f-a905-dd88cfc5ee8b admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:05.901336 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f10b6-67c0-4ac2-845a-ef1bba51b343 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:05.904074 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c43f10b6-67c0-4ac2-845a-ef1bba51b343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:05.928290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 831/1664] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:56:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:56:05.928477 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f10b6-67c0-4ac2-845a-ef1bba51b343 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:05.931378 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635d477-419a-4d3f-a905-dd88cfc5ee8b admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:05.933554 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5b675-04fa-477f-8c13-173ba5f28bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:05.934453 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5b675-04fa-477f-8c13-173ba5f28bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:05.934734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5b675-04fa-477f-8c13-173ba5f28bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:05.935008 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5b675-04fa-477f-8c13-173ba5f28bb2 admin admin] PATH_INFO: `/v3/projects/b9f1159d6e564565b40744c4d9604b8d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:05.936313 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5b675-04fa-477f-8c13-173ba5f28bb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9f1159d6e564565b40744c4d9604b8d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:05.938359 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5b675-04fa-477f-8c13-173ba5f28bb2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:05.950922 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635d477-419a-4d3f-a905-dd88cfc5ee8b admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:05.965463 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25676c-5551-4957-9c1a-d6af86f8adba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:05.966162 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25676c-5551-4957-9c1a-d6af86f8adba admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:05.966448 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25676c-5551-4957-9c1a-d6af86f8adba admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:05.966728 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25676c-5551-4957-9c1a-d6af86f8adba admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:05.967467 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25676c-5551-4957-9c1a-d6af86f8adba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:05.969443 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25676c-5551-4957-9c1a-d6af86f8adba admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:06.039957 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 832/1665] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:05 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 05:56:06.042167 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25676c-5551-4957-9c1a-d6af86f8adba admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:06.058257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-07b5b675-04fa-477f-8c13-173ba5f28bb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9f1159d6e564565b40744c4d9604b8d', 'request_id': 'req-07b5b675-04fa-477f-8c13-173ba5f28bb2'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:06.071712 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-07b5b675-04fa-477f-8c13-173ba5f28bb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9f1159d6e564565b40744c4d9604b8d', 'request_id': 'req-07b5b675-04fa-477f-8c13-173ba5f28bb2'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:06.099277 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-07b5b675-04fa-477f-8c13-173ba5f28bb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9f1159d6e564565b40744c4d9604b8d', 'request_id': 'req-07b5b675-04fa-477f-8c13-173ba5f28bb2'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:06.131281 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-07b5b675-04fa-477f-8c13-173ba5f28bb2 admin admin] The token cache is being invalidate because project b9f1159d6e564565b40744c4d9604b8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:56:06.131456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-07b5b675-04fa-477f-8c13-173ba5f28bb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:06.133822 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-07b5b675-04fa-477f-8c13-173ba5f28bb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:06.143046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 834/1666] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:56:05 2022] DELETE /identity/v3/projects/b9f1159d6e564565b40744c4d9604b8d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:06.145697 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917421c4-1448-43d4-b024-81c7b6146dad None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:06.145980 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917421c4-1448-43d4-b024-81c7b6146dad None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:06.146259 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917421c4-1448-43d4-b024-81c7b6146dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:06.218021 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25676c-5551-4957-9c1a-d6af86f8adba admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:06.229551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916489c-5e3e-4309-b27c-1339d6231d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:06.230270 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916489c-5e3e-4309-b27c-1339d6231d36 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:06.230461 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-917421c4-1448-43d4-b024-81c7b6146dad None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:06.230557 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916489c-5e3e-4309-b27c-1339d6231d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:06.230817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916489c-5e3e-4309-b27c-1339d6231d36 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:06.231554 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916489c-5e3e-4309-b27c-1339d6231d36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:06.232946 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-917421c4-1448-43d4-b024-81c7b6146dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:06.233535 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916489c-5e3e-4309-b27c-1339d6231d36 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:06.252596 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 835/1667] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:06.254583 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e2862-4be4-4c50-9a64-e85c538b3e55 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:06.255069 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e2862-4be4-4c50-9a64-e85c538b3e55 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:06.255584 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e2862-4be4-4c50-9a64-e85c538b3e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:06.289922 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-fd8e2862-4be4-4c50-9a64-e85c538b3e55 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:06.292459 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fd8e2862-4be4-4c50-9a64-e85c538b3e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:06.299972 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 833/1668] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:06 2022] POST /identity/v3/users => generated 294 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 05:56:06.304081 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916489c-5e3e-4309-b27c-1339d6231d36 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:06.313619 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 836/1669] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:06.315168 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-1916489c-5e3e-4309-b27c-1339d6231d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:06.325761 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e2862-4be4-4c50-9a64-e85c538b3e55 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:06.341131 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e2862-4be4-4c50-9a64-e85c538b3e55 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:06.341326 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916489c-5e3e-4309-b27c-1339d6231d36 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:06.347441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b2a07-7fbf-47e3-bc0d-4e0eb7cd320f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:06.348396 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b2a07-7fbf-47e3-bc0d-4e0eb7cd320f admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:06.348768 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b2a07-7fbf-47e3-bc0d-4e0eb7cd320f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:06.349203 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b2a07-7fbf-47e3-bc0d-4e0eb7cd320f admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:06.350034 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b2a07-7fbf-47e3-bc0d-4e0eb7cd320f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:56:06.350635 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b2a07-7fbf-47e3-bc0d-4e0eb7cd320f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:06.354105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b2a07-7fbf-47e3-bc0d-4e0eb7cd320f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:06.356500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e840f4-379f-4910-b5ba-8ab314b40f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:06.357323 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e840f4-379f-4910-b5ba-8ab314b40f74 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:06.357611 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e840f4-379f-4910-b5ba-8ab314b40f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:06.357892 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e840f4-379f-4910-b5ba-8ab314b40f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:06.358647 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e840f4-379f-4910-b5ba-8ab314b40f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:06.360385 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e840f4-379f-4910-b5ba-8ab314b40f74 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:06.376948 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 837/1670] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:56:06.382877 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b2a07-7fbf-47e3-bc0d-4e0eb7cd320f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:06.390632 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 834/1671] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:06.401441 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e840f4-379f-4910-b5ba-8ab314b40f74 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:06.409656 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b2a07-7fbf-47e3-bc0d-4e0eb7cd320f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:06.422545 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfab22d-dbe0-41eb-a921-9c2ef2a65264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:06.424736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfab22d-dbe0-41eb-a921-9c2ef2a65264 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:06.425304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfab22d-dbe0-41eb-a921-9c2ef2a65264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:06.425910 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfab22d-dbe0-41eb-a921-9c2ef2a65264 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:06.427901 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfab22d-dbe0-41eb-a921-9c2ef2a65264 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:06.431732 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfab22d-dbe0-41eb-a921-9c2ef2a65264 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:06.436717 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e840f4-379f-4910-b5ba-8ab314b40f74 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:06.459568 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2bca1d-3646-4cbd-ae33-f5d8b610b25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:06.460449 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bca1d-3646-4cbd-ae33-f5d8b610b25d admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:06.460734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bca1d-3646-4cbd-ae33-f5d8b610b25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:06.461053 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bca1d-3646-4cbd-ae33-f5d8b610b25d admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:06.464830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2bca1d-3646-4cbd-ae33-f5d8b610b25d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:06.466685 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2bca1d-3646-4cbd-ae33-f5d8b610b25d admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:06.471281 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 838/1672] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:06 2022] POST /identity/v3/projects => generated 363 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:06.473396 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfab22d-dbe0-41eb-a921-9c2ef2a65264 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:06.491630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 835/1673] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:06.495929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2bca1d-3646-4cbd-ae33-f5d8b610b25d admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:06.514259 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:06.520748 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2bca1d-3646-4cbd-ae33-f5d8b610b25d admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:06.589004 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:06.610132 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfab22d-dbe0-41eb-a921-9c2ef2a65264 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:06.616881 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f84ed-262a-4db2-b3be-03b8a0032d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:06.617831 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f84ed-262a-4db2-b3be-03b8a0032d51 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:06.618287 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f84ed-262a-4db2-b3be-03b8a0032d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:06.618693 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f84ed-262a-4db2-b3be-03b8a0032d51 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:06.619602 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f84ed-262a-4db2-b3be-03b8a0032d51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:06.621829 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f84ed-262a-4db2-b3be-03b8a0032d51 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:06.648510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf5e4f-ba3c-418c-8c26-c73761aaa995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:06.650680 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf5e4f-ba3c-418c-8c26-c73761aaa995 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:06.651348 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf5e4f-ba3c-418c-8c26-c73761aaa995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:06.652306 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf5e4f-ba3c-418c-8c26-c73761aaa995 admin admin] PATH_INFO: `/v3/projects/f67e920c9a534b40a22be150ff3a6da1/users/14bf1ca0bba34f67883556956abf9f55/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:06.659797 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 839/1674] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:06 2022] POST /identity/v3/users => generated 282 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 05:56:06.660686 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f84ed-262a-4db2-b3be-03b8a0032d51 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:06.662689 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4d9f84ed-262a-4db2-b3be-03b8a0032d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:06.680731 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f84ed-262a-4db2-b3be-03b8a0032d51 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:06.685984 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351027a8-55df-47db-adda-7f6979e40b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:06.687399 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351027a8-55df-47db-adda-7f6979e40b54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:06.687725 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351027a8-55df-47db-adda-7f6979e40b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:06.687932 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351027a8-55df-47db-adda-7f6979e40b54 admin admin] PATH_INFO: `/v3/projects/a5c6463ebae941cd8603813bf9ea482d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:06.690128 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351027a8-55df-47db-adda-7f6979e40b54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5c6463ebae941cd8603813bf9ea482d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:06.692410 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351027a8-55df-47db-adda-7f6979e40b54 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:06.714616 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf5e4f-ba3c-418c-8c26-c73761aaa995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f67e920c9a534b40a22be150ff3a6da1, user_id=14bf1ca0bba34f67883556956abf9f55, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:06.726725 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf5e4f-ba3c-418c-8c26-c73761aaa995 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:06.762194 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 836/1675] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:06 2022] PUT /identity/v3/projects/f67e920c9a534b40a22be150ff3a6da1/users/14bf1ca0bba34f67883556956abf9f55/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:06.763113 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf5e4f-ba3c-418c-8c26-c73761aaa995 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:06.818456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-351027a8-55df-47db-adda-7f6979e40b54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5c6463ebae941cd8603813bf9ea482d', 'request_id': 'req-351027a8-55df-47db-adda-7f6979e40b54'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:06.838430 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-351027a8-55df-47db-adda-7f6979e40b54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5c6463ebae941cd8603813bf9ea482d', 'request_id': 'req-351027a8-55df-47db-adda-7f6979e40b54'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:06.859443 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-351027a8-55df-47db-adda-7f6979e40b54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5c6463ebae941cd8603813bf9ea482d', 'request_id': 'req-351027a8-55df-47db-adda-7f6979e40b54'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:06.900859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf5e4f-ba3c-418c-8c26-c73761aaa995 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:06.902433 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-351027a8-55df-47db-adda-7f6979e40b54 admin admin] The token cache is being invalidate because project a5c6463ebae941cd8603813bf9ea482d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:56:06.902879 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-351027a8-55df-47db-adda-7f6979e40b54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:06.903748 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-351027a8-55df-47db-adda-7f6979e40b54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:06.906500 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 840/1676] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:56:06 2022] DELETE /identity/v3/projects/a5c6463ebae941cd8603813bf9ea482d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:06.910701 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9d75c-f2d1-45e4-ae5a-ce82ec5f0453 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:06.920395 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9d75c-f2d1-45e4-ae5a-ce82ec5f0453 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:06.923694 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9d75c-f2d1-45e4-ae5a-ce82ec5f0453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:07.008784 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-99e9d75c-f2d1-45e4-ae5a-ce82ec5f0453 None None] MFA Rules not processed for user `14bf1ca0bba34f67883556956abf9f55`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:07.010077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-99e9d75c-f2d1-45e4-ae5a-ce82ec5f0453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:07.069395 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4768d-e5a2-414e-8621-9eabee569579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:07.070272 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4768d-e5a2-414e-8621-9eabee569579 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:07.070721 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4768d-e5a2-414e-8621-9eabee569579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:07.071172 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4768d-e5a2-414e-8621-9eabee569579 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:07.073646 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4768d-e5a2-414e-8621-9eabee569579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:07.080006 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4768d-e5a2-414e-8621-9eabee569579 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:07.104919 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 837/1677] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:07.107233 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4768d-e5a2-414e-8621-9eabee569579 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:07.115491 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-a7e4768d-e5a2-414e-8621-9eabee569579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:07.151047 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4768d-e5a2-414e-8621-9eabee569579 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:07.168483 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec62107-60c0-4d7b-9e13-b824179ce72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:07.169190 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec62107-60c0-4d7b-9e13-b824179ce72e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:07.169476 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec62107-60c0-4d7b-9e13-b824179ce72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:07.169747 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec62107-60c0-4d7b-9e13-b824179ce72e admin admin] PATH_INFO: `/v3/users/5387b46d032849e6ad9e85930dced5d7` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:07.172712 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec62107-60c0-4d7b-9e13-b824179ce72e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5387b46d032849e6ad9e85930dced5d7)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:07.176356 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec62107-60c0-4d7b-9e13-b824179ce72e admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:07.201934 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 841/1678] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:07.203246 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9d75c-f2d1-45e4-ae5a-ce82ec5f0453 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:07.207158 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-99e9d75c-f2d1-45e4-ae5a-ce82ec5f0453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:07.246730 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9d75c-f2d1-45e4-ae5a-ce82ec5f0453 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:07.273566 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0c2b7-c4c4-472f-97ab-a1cd6f479d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:07.276572 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0c2b7-c4c4-472f-97ab-a1cd6f479d38 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:07.278214 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0c2b7-c4c4-472f-97ab-a1cd6f479d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:07.278500 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0c2b7-c4c4-472f-97ab-a1cd6f479d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:07.279322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c0c2b7-c4c4-472f-97ab-a1cd6f479d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:07.281007 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c0c2b7-c4c4-472f-97ab-a1cd6f479d38 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:07.308291 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4ec62107-60c0-4d7b-9e13-b824179ce72e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5387b46d032849e6ad9e85930dced5d7'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:07.310669 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4ec62107-60c0-4d7b-9e13-b824179ce72e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5387b46d032849e6ad9e85930dced5d7'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:07.313523 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 842/1679] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:07.322130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0c2b7-c4c4-472f-97ab-a1cd6f479d38 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:07.328438 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b8c0c2b7-c4c4-472f-97ab-a1cd6f479d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:07.358775 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0c2b7-c4c4-472f-97ab-a1cd6f479d38 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:07.360771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4ec62107-60c0-4d7b-9e13-b824179ce72e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5387b46d032849e6ad9e85930dced5d7'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:07.361598 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4ec62107-60c0-4d7b-9e13-b824179ce72e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5387b46d032849e6ad9e85930dced5d7'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:07.363784 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:07.374735 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f3796-59b2-435c-a8e5-5b7466d2ef91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:07.376420 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f3796-59b2-435c-a8e5-5b7466d2ef91 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:07.379248 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f3796-59b2-435c-a8e5-5b7466d2ef91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:07.380044 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f3796-59b2-435c-a8e5-5b7466d2ef91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:07.380808 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f3796-59b2-435c-a8e5-5b7466d2ef91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:07.387922 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f3796-59b2-435c-a8e5-5b7466d2ef91 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:07.389489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4ec62107-60c0-4d7b-9e13-b824179ce72e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5387b46d032849e6ad9e85930dced5d7'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:07.412167 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:07.437181 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 838/1680] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:56:07 2022] DELETE /identity/v3/users/5387b46d032849e6ad9e85930dced5d7 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:07.437181 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec62107-60c0-4d7b-9e13-b824179ce72e admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:07.440121 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-4ec62107-60c0-4d7b-9e13-b824179ce72e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:07.449611 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 843/1681] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:07 2022] POST /identity/v3/projects => generated 387 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:07.453328 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f3796-59b2-435c-a8e5-5b7466d2ef91 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:07.594883 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f3796-59b2-435c-a8e5-5b7466d2ef91 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:07.609816 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9287d-3e66-443f-b077-59f5cbaaa285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:07.610154 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9287d-3e66-443f-b077-59f5cbaaa285 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:07.610441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9287d-3e66-443f-b077-59f5cbaaa285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:07.610712 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9287d-3e66-443f-b077-59f5cbaaa285 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:07.611542 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd9287d-3e66-443f-b077-59f5cbaaa285 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:07.614172 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd9287d-3e66-443f-b077-59f5cbaaa285 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:07.648996 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec62107-60c0-4d7b-9e13-b824179ce72e admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:07.664040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 844/1682] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:07 2022] POST /identity/v3/users => generated 300 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 05:56:07.664199 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceaf1dc-dd5b-4cbe-b8b3-6e50290981c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:07.664199 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceaf1dc-dd5b-4cbe-b8b3-6e50290981c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:07.665936 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9287d-3e66-443f-b077-59f5cbaaa285 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:07.670896 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceaf1dc-dd5b-4cbe-b8b3-6e50290981c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:07.671632 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceaf1dc-dd5b-4cbe-b8b3-6e50290981c6 admin admin] PATH_INFO: `/v3/projects/d518b0d94dd0444ea168c4a909399cd1/users/1a02cb7c0c50483c9e43162854284cd7/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:07.685885 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9287d-3e66-443f-b077-59f5cbaaa285 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:07.698162 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a50e7-a5f1-447f-8033-0040c83a6a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:07.700409 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a50e7-a5f1-447f-8033-0040c83a6a7e admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:07.702779 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a50e7-a5f1-447f-8033-0040c83a6a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:07.703114 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a50e7-a5f1-447f-8033-0040c83a6a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:07.707121 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a50e7-a5f1-447f-8033-0040c83a6a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:07.710787 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a50e7-a5f1-447f-8033-0040c83a6a7e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:07.718914 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceaf1dc-dd5b-4cbe-b8b3-6e50290981c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d518b0d94dd0444ea168c4a909399cd1, user_id=1a02cb7c0c50483c9e43162854284cd7, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:07.725832 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceaf1dc-dd5b-4cbe-b8b3-6e50290981c6 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:07.740359 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 845/1683] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 05:56:07.740359 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a50e7-a5f1-447f-8033-0040c83a6a7e admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:07.766900 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a50e7-a5f1-447f-8033-0040c83a6a7e admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:07.770533 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 839/1684] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:07 2022] PUT /identity/v3/projects/d518b0d94dd0444ea168c4a909399cd1/users/1a02cb7c0c50483c9e43162854284cd7/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:07.772051 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e4ba1-bc00-426b-8b10-cfe229d45420 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:07.772394 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e4ba1-bc00-426b-8b10-cfe229d45420 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:07.772612 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e4ba1-bc00-426b-8b10-cfe229d45420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:07.841125 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-5d8e4ba1-bc00-426b-8b10-cfe229d45420 None None] MFA Rules not processed for user `1a02cb7c0c50483c9e43162854284cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:07.842513 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-5d8e4ba1-bc00-426b-8b10-cfe229d45420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:07.948243 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564eb70-5878-4a5e-b235-961704b63e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:07.949573 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564eb70-5878-4a5e-b235-961704b63e82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:07.949905 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564eb70-5878-4a5e-b235-961704b63e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:07.950772 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564eb70-5878-4a5e-b235-961704b63e82 admin admin] PATH_INFO: `/v3/projects/4a28eba15eee4ff68eb3762a3dcf164e/users/d6ea6e627f89473080ce7e77bac57d25/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:07.997758 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564eb70-5878-4a5e-b235-961704b63e82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a28eba15eee4ff68eb3762a3dcf164e, user_id=d6ea6e627f89473080ce7e77bac57d25, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:08.001903 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564eb70-5878-4a5e-b235-961704b63e82 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:08.027985 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 840/1685] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:07 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:08.039824 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 846/1686] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:07 2022] PUT /identity/v3/projects/4a28eba15eee4ff68eb3762a3dcf164e/users/d6ea6e627f89473080ce7e77bac57d25/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:08.044174 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564eb70-5878-4a5e-b235-961704b63e82 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:08.045302 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e4ba1-bc00-426b-8b10-cfe229d45420 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:08.074934 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e4ba1-bc00-426b-8b10-cfe229d45420 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:08.157071 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:08.177647 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:08.180456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564eb70-5878-4a5e-b235-961704b63e82 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:08.196550 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9292700-f43e-4354-a946-520ffef48092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:08.197254 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9292700-f43e-4354-a946-520ffef48092 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:08.197534 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9292700-f43e-4354-a946-520ffef48092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:08.197818 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9292700-f43e-4354-a946-520ffef48092 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:08.198548 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9292700-f43e-4354-a946-520ffef48092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:08.200181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9292700-f43e-4354-a946-520ffef48092 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:08.216273 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e322e0-41f0-410f-87b3-b20172acc74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:08.217072 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e322e0-41f0-410f-87b3-b20172acc74b admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:08.217543 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e322e0-41f0-410f-87b3-b20172acc74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:08.218029 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e322e0-41f0-410f-87b3-b20172acc74b admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:08.218956 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e322e0-41f0-410f-87b3-b20172acc74b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:08.220949 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e322e0-41f0-410f-87b3-b20172acc74b admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:08.226415 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 847/1687] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:08.230566 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9292700-f43e-4354-a946-520ffef48092 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:08.257888 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9292700-f43e-4354-a946-520ffef48092 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:08.268009 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8958b-fb26-4215-ab09-5fab667602db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:08.272540 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8958b-fb26-4215-ab09-5fab667602db admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:08.273848 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8958b-fb26-4215-ab09-5fab667602db admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:08.274147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8958b-fb26-4215-ab09-5fab667602db admin admin] PATH_INFO: `/v3/projects/4a28eba15eee4ff68eb3762a3dcf164e/users/d6ea6e627f89473080ce7e77bac57d25/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:08.281167 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8958b-fb26-4215-ab09-5fab667602db admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a28eba15eee4ff68eb3762a3dcf164e, user_id=d6ea6e627f89473080ce7e77bac57d25, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:08.286883 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 841/1688] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:08 2022] POST /identity/v3/projects => generated 365 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:08.287034 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8958b-fb26-4215-ab09-5fab667602db admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:08.287963 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e322e0-41f0-410f-87b3-b20172acc74b admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:08.309913 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 848/1689] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:08 2022] PUT /identity/v3/projects/4a28eba15eee4ff68eb3762a3dcf164e/users/d6ea6e627f89473080ce7e77bac57d25/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:08.322271 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888065c4-dc32-4a24-88e1-133ce060665c None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:08.322639 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888065c4-dc32-4a24-88e1-133ce060665c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:08.322979 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888065c4-dc32-4a24-88e1-133ce060665c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:08.377736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-888065c4-dc32-4a24-88e1-133ce060665c None None] MFA Rules not processed for user `d6ea6e627f89473080ce7e77bac57d25`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:08.380364 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-888065c4-dc32-4a24-88e1-133ce060665c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:08.419861 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e322e0-41f0-410f-87b3-b20172acc74b admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:08.521167 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 849/1690] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:08 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:08.542019 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888065c4-dc32-4a24-88e1-133ce060665c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:08.545265 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-888065c4-dc32-4a24-88e1-133ce060665c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:08.561247 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442f828-ed81-4e7c-9f20-6b85bd6b7769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:08.561945 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442f828-ed81-4e7c-9f20-6b85bd6b7769 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:08.562229 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442f828-ed81-4e7c-9f20-6b85bd6b7769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:08.562560 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442f828-ed81-4e7c-9f20-6b85bd6b7769 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:08.563366 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442f828-ed81-4e7c-9f20-6b85bd6b7769 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:08.569963 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442f828-ed81-4e7c-9f20-6b85bd6b7769 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:08.615600 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 842/1691] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:08 2022] POST /identity/v3/users => generated 289 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:08.622213 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442f828-ed81-4e7c-9f20-6b85bd6b7769 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:08.653833 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442f828-ed81-4e7c-9f20-6b85bd6b7769 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:08.668839 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a09c3-aefd-4cfa-9c9e-4ceee9592a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:08.670125 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a09c3-aefd-4cfa-9c9e-4ceee9592a7f admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:08.670899 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a09c3-aefd-4cfa-9c9e-4ceee9592a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:08.671802 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a09c3-aefd-4cfa-9c9e-4ceee9592a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:08.672960 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a09c3-aefd-4cfa-9c9e-4ceee9592a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:08.674879 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a09c3-aefd-4cfa-9c9e-4ceee9592a7f admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:08.698062 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 843/1692] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:08.699275 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a09c3-aefd-4cfa-9c9e-4ceee9592a7f admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:08.710585 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888065c4-dc32-4a24-88e1-133ce060665c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:08.715674 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a09c3-aefd-4cfa-9c9e-4ceee9592a7f admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:08.721247 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40a0a2-084b-4efe-a19a-e92b89995180 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:08.724709 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40a0a2-084b-4efe-a19a-e92b89995180 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:08.725684 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40a0a2-084b-4efe-a19a-e92b89995180 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:08.736007 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40a0a2-084b-4efe-a19a-e92b89995180 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:08.739391 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025b1b5-511d-4826-8b40-078414be8f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:08.741357 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025b1b5-511d-4826-8b40-078414be8f4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:08.742514 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025b1b5-511d-4826-8b40-078414be8f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:08.742950 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025b1b5-511d-4826-8b40-078414be8f4c admin admin] PATH_INFO: `/v3/projects/e8b50a7068b041f2ac20e1f9ab6415a2/users/9fd678b3673f449da023a5e41b8885d3/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:08.761088 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a40a0a2-084b-4efe-a19a-e92b89995180 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:08.767767 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025b1b5-511d-4826-8b40-078414be8f4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8b50a7068b041f2ac20e1f9ab6415a2, user_id=9fd678b3673f449da023a5e41b8885d3, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:08.771492 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025b1b5-511d-4826-8b40-078414be8f4c admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:08.772637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a40a0a2-084b-4efe-a19a-e92b89995180 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:08.803638 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 850/1693] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:08.811171 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40a0a2-084b-4efe-a19a-e92b89995180 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:08.812265 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 844/1694] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:08 2022] PUT /identity/v3/projects/e8b50a7068b041f2ac20e1f9ab6415a2/users/9fd678b3673f449da023a5e41b8885d3/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:08.826946 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40a0a2-084b-4efe-a19a-e92b89995180 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:08.896421 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff730c-2ef6-4031-b146-47c4d3f15386 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:08.897526 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff730c-2ef6-4031-b146-47c4d3f15386 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:08.897949 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff730c-2ef6-4031-b146-47c4d3f15386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:09.026745 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f087c-0f42-4c84-b325-62aa8b6cf44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:09.027394 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f087c-0f42-4c84-b325-62aa8b6cf44b admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:09.027676 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f087c-0f42-4c84-b325-62aa8b6cf44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:09.027956 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f087c-0f42-4c84-b325-62aa8b6cf44b admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:09.028692 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f087c-0f42-4c84-b325-62aa8b6cf44b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:09.031904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f087c-0f42-4c84-b325-62aa8b6cf44b admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:09.039378 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:09.074181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 851/1695] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:09.075447 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f087c-0f42-4c84-b325-62aa8b6cf44b admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:09.086989 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-1dff730c-2ef6-4031-b146-47c4d3f15386 None None] MFA Rules not processed for user `aab0dd125b4d481fa6a950b1d0269b38`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:09.092981 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-1dff730c-2ef6-4031-b146-47c4d3f15386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:09.106042 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f087c-0f42-4c84-b325-62aa8b6cf44b admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:09.130378 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b4452-9450-47e1-a2f1-58fee3ef9f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:09.131471 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b4452-9450-47e1-a2f1-58fee3ef9f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:09.144731 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b4452-9450-47e1-a2f1-58fee3ef9f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:09.146970 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b4452-9450-47e1-a2f1-58fee3ef9f57 admin admin] PATH_INFO: `/v3/users/14bf1ca0bba34f67883556956abf9f55` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:09.150614 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b4452-9450-47e1-a2f1-58fee3ef9f57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14bf1ca0bba34f67883556956abf9f55)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:09.156070 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b4452-9450-47e1-a2f1-58fee3ef9f57 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:09.170649 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:09.299663 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c90b4452-9450-47e1-a2f1-58fee3ef9f57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14bf1ca0bba34f67883556956abf9f55'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:09.307020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 845/1696] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:56:09.308608 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff730c-2ef6-4031-b146-47c4d3f15386 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:09.323899 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c90b4452-9450-47e1-a2f1-58fee3ef9f57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14bf1ca0bba34f67883556956abf9f55'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:09.331789 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff730c-2ef6-4031-b146-47c4d3f15386 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:09.341923 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0dc8b-be4e-4873-ba1c-b5beeb010cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:09.343739 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0dc8b-be4e-4873-ba1c-b5beeb010cc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:09.345954 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0dc8b-be4e-4873-ba1c-b5beeb010cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:09.346467 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0dc8b-be4e-4873-ba1c-b5beeb010cc5 admin admin] PATH_INFO: `/v3/projects/e8b50a7068b041f2ac20e1f9ab6415a2/users/9fd678b3673f449da023a5e41b8885d3/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:09.347651 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c90b4452-9450-47e1-a2f1-58fee3ef9f57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14bf1ca0bba34f67883556956abf9f55'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:09.349858 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c90b4452-9450-47e1-a2f1-58fee3ef9f57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14bf1ca0bba34f67883556956abf9f55'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:09.350292 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0dc8b-be4e-4873-ba1c-b5beeb010cc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8b50a7068b041f2ac20e1f9ab6415a2, user_id=9fd678b3673f449da023a5e41b8885d3, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:09.354471 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0dc8b-be4e-4873-ba1c-b5beeb010cc5 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:09.382126 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c90b4452-9450-47e1-a2f1-58fee3ef9f57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14bf1ca0bba34f67883556956abf9f55'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:09.391820 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 846/1697] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:09 2022] PUT /identity/v3/projects/e8b50a7068b041f2ac20e1f9ab6415a2/users/9fd678b3673f449da023a5e41b8885d3/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:09.399237 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 852/1698] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:56:09 2022] DELETE /identity/v3/users/14bf1ca0bba34f67883556956abf9f55 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:09.400336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec6821-b6f1-4815-a035-ad2d8db6c006 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:09.401028 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec6821-b6f1-4815-a035-ad2d8db6c006 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:09.402387 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec6821-b6f1-4815-a035-ad2d8db6c006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:09.402612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b84b3-4835-4d33-847b-155a8affa438 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:09.403086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b84b3-4835-4d33-847b-155a8affa438 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:09.405414 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b84b3-4835-4d33-847b-155a8affa438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:09.447063 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-674b84b3-4835-4d33-847b-155a8affa438 None None] MFA Rules not processed for user `aab0dd125b4d481fa6a950b1d0269b38`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:09.448451 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-674b84b3-4835-4d33-847b-155a8affa438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:09.486454 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-3dec6821-b6f1-4815-a035-ad2d8db6c006 None None] MFA Rules not processed for user `b9b1e7407f484592a45922687538e543`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:09.490035 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-3dec6821-b6f1-4815-a035-ad2d8db6c006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:09.552837 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 853/1699] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:09.557434 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab24cc-dff1-407c-b1ef-a8779372be1f None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:09.557434 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab24cc-dff1-407c-b1ef-a8779372be1f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:09.557434 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab24cc-dff1-407c-b1ef-a8779372be1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:09.638467 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a2ab24cc-dff1-407c-b1ef-a8779372be1f None None] MFA Rules not processed for user `9fd678b3673f449da023a5e41b8885d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:09.640257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a2ab24cc-dff1-407c-b1ef-a8779372be1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:09.702549 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 847/1700] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:09 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:09.705086 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a544e6-e3e4-47dc-8cd7-dc1e100841be None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:09.706284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a544e6-e3e4-47dc-8cd7-dc1e100841be None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:09.706739 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a544e6-e3e4-47dc-8cd7-dc1e100841be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:09.792766 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-64a544e6-e3e4-47dc-8cd7-dc1e100841be None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:09.796111 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-64a544e6-e3e4-47dc-8cd7-dc1e100841be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:09.879749 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:09.889879 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 854/1701] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:09 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:09.897442 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab24cc-dff1-407c-b1ef-a8779372be1f None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:09.900444 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a2ab24cc-dff1-407c-b1ef-a8779372be1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:10.020103 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 848/1702] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:10.021131 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a544e6-e3e4-47dc-8cd7-dc1e100841be None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:10.025836 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-64a544e6-e3e4-47dc-8cd7-dc1e100841be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:10.057277 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a544e6-e3e4-47dc-8cd7-dc1e100841be None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:10.067660 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f4cdb-7509-4263-993b-1f13a9ffb671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:10.068353 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f4cdb-7509-4263-993b-1f13a9ffb671 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:10.068633 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f4cdb-7509-4263-993b-1f13a9ffb671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:10.069489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f4cdb-7509-4263-993b-1f13a9ffb671 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:10.069723 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f4cdb-7509-4263-993b-1f13a9ffb671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:10.071872 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f4cdb-7509-4263-993b-1f13a9ffb671 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:10.122674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab24cc-dff1-407c-b1ef-a8779372be1f None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:10.142617 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fad657-4e2a-407e-ac71-fceb1fe51e37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:10.143338 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fad657-4e2a-407e-ac71-fceb1fe51e37 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:10.143623 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fad657-4e2a-407e-ac71-fceb1fe51e37 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:10.144026 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fad657-4e2a-407e-ac71-fceb1fe51e37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:10.150131 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 849/1703] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:10 2022] POST /identity/v3/projects => generated 403 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:10.155393 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f4cdb-7509-4263-993b-1f13a9ffb671 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:10.156906 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e8fad657-4e2a-407e-ac71-fceb1fe51e37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:10.172144 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-961f4cdb-7509-4263-993b-1f13a9ffb671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:10.198014 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fad657-4e2a-407e-ac71-fceb1fe51e37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:10.199990 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fad657-4e2a-407e-ac71-fceb1fe51e37 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:10.243928 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:10.245554 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 855/1704] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:10.246649 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fad657-4e2a-407e-ac71-fceb1fe51e37 service nova] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:10.254752 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e8fad657-4e2a-407e-ac71-fceb1fe51e37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:10.305139 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fad657-4e2a-407e-ac71-fceb1fe51e37 service nova] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:10.416779 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f4cdb-7509-4263-993b-1f13a9ffb671 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:10.433349 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbab568-868c-43e3-8779-e2dbaded3699 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:10.434081 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbab568-868c-43e3-8779-e2dbaded3699 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:10.434362 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbab568-868c-43e3-8779-e2dbaded3699 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:10.434636 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbab568-868c-43e3-8779-e2dbaded3699 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:10.544489 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b600b-72d3-4152-9d82-185c8d36b444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:10.545431 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b600b-72d3-4152-9d82-185c8d36b444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:10.546212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b600b-72d3-4152-9d82-185c8d36b444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:10.546659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b600b-72d3-4152-9d82-185c8d36b444 admin admin] PATH_INFO: `/v3/projects/1a041f1204af4dd2b210b34e790aa115` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:10.558311 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b600b-72d3-4152-9d82-185c8d36b444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a041f1204af4dd2b210b34e790aa115)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:10.564139 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b600b-72d3-4152-9d82-185c8d36b444 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:10.612149 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbab568-868c-43e3-8779-e2dbaded3699 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:10.613808 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbab568-868c-43e3-8779-e2dbaded3699 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:10.658052 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 850/1705] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:10 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:10.658703 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbab568-868c-43e3-8779-e2dbaded3699 service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:10.660166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ddbab568-868c-43e3-8779-e2dbaded3699 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:10.681724 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-414b600b-72d3-4152-9d82-185c8d36b444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a041f1204af4dd2b210b34e790aa115', 'request_id': 'req-414b600b-72d3-4152-9d82-185c8d36b444'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:10.700194 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-414b600b-72d3-4152-9d82-185c8d36b444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a041f1204af4dd2b210b34e790aa115', 'request_id': 'req-414b600b-72d3-4152-9d82-185c8d36b444'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:10.725406 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-414b600b-72d3-4152-9d82-185c8d36b444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a041f1204af4dd2b210b34e790aa115', 'request_id': 'req-414b600b-72d3-4152-9d82-185c8d36b444'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:10.770427 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-414b600b-72d3-4152-9d82-185c8d36b444 admin admin] The token cache is being invalidate because project 1a041f1204af4dd2b210b34e790aa115 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:56:10.770734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-414b600b-72d3-4152-9d82-185c8d36b444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:10.777632 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-414b600b-72d3-4152-9d82-185c8d36b444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:10.780526 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 856/1706] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:56:10 2022] DELETE /identity/v3/projects/1a041f1204af4dd2b210b34e790aa115 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:10.784010 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b600b-72d3-4152-9d82-185c8d36b444 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:10.792014 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-414b600b-72d3-4152-9d82-185c8d36b444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:10.801458 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbab568-868c-43e3-8779-e2dbaded3699 service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:10.866049 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:10.994108 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88155499-53b0-4d62-bbd4-a6a8d2db5a66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:10.995989 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88155499-53b0-4d62-bbd4-a6a8d2db5a66 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:10.997225 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88155499-53b0-4d62-bbd4-a6a8d2db5a66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:10.997581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88155499-53b0-4d62-bbd4-a6a8d2db5a66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:11.005251 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-88155499-53b0-4d62-bbd4-a6a8d2db5a66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:11.017431 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b600b-72d3-4152-9d82-185c8d36b444 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:11.034251 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5df65-e827-4183-891a-cff183e4b828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:11.035426 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5df65-e827-4183-891a-cff183e4b828 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:11.035842 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5df65-e827-4183-891a-cff183e4b828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:11.035969 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88155499-53b0-4d62-bbd4-a6a8d2db5a66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:11.036363 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5df65-e827-4183-891a-cff183e4b828 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:11.037186 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a5df65-e827-4183-891a-cff183e4b828 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:11.040134 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88155499-53b0-4d62-bbd4-a6a8d2db5a66 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:11.042905 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a5df65-e827-4183-891a-cff183e4b828 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:11.068129 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 851/1707] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:11.072528 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd9ff2-1084-4542-b096-f433497cb7c6 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:11.073059 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd9ff2-1084-4542-b096-f433497cb7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:11.073500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd9ff2-1084-4542-b096-f433497cb7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:11.110772 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 857/1708] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:10 2022] POST /identity/v3/users => generated 308 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:11.115915 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3039991-4d0f-4eef-9b7e-4fc53267e709 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:11.116199 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3039991-4d0f-4eef-9b7e-4fc53267e709 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:11.116475 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3039991-4d0f-4eef-9b7e-4fc53267e709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:11.153034 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-52bd9ff2-1084-4542-b096-f433497cb7c6 None None] MFA Rules not processed for user `bd06f1f3ff124acbaede2c9fb1f116a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:11.158144 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-52bd9ff2-1084-4542-b096-f433497cb7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:11.188203 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-f3039991-4d0f-4eef-9b7e-4fc53267e709 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:11.189450 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f3039991-4d0f-4eef-9b7e-4fc53267e709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:11.192483 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:11.220647 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 858/1709] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:11.222119 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fed7ad-ac57-49a0-b40f-0633c4776418 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:11.222401 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fed7ad-ac57-49a0-b40f-0633c4776418 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:11.226912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fed7ad-ac57-49a0-b40f-0633c4776418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:11.321450 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-19fed7ad-ac57-49a0-b40f-0633c4776418 None None] MFA Rules not processed for user `1c4799b3a1a046aba74e9a6117d4d532`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:11.332332 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-19fed7ad-ac57-49a0-b40f-0633c4776418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:11.351890 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 852/1710] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:11.361582 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd9ff2-1084-4542-b096-f433497cb7c6 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:11.392491 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd9ff2-1084-4542-b096-f433497cb7c6 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:11.397939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7edfae-a275-4841-88ed-0c9e02ade0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:11.398412 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7edfae-a275-4841-88ed-0c9e02ade0c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:11.398694 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7edfae-a275-4841-88ed-0c9e02ade0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:11.398970 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7edfae-a275-4841-88ed-0c9e02ade0c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:11.399733 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7edfae-a275-4841-88ed-0c9e02ade0c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:11.401369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7edfae-a275-4841-88ed-0c9e02ade0c7 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:11.441377 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 853/1711] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:11.445878 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42331cb4-2b3f-416a-a6e7-ff9539c96ce5 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:11.446170 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42331cb4-2b3f-416a-a6e7-ff9539c96ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:11.446447 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42331cb4-2b3f-416a-a6e7-ff9539c96ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:11.475311 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 859/1712] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:11.476833 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f026f06-25f8-4ad4-9557-3c10759586aa None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:11.477225 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f026f06-25f8-4ad4-9557-3c10759586aa None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:11.477620 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f026f06-25f8-4ad4-9557-3c10759586aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:11.518476 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-2f026f06-25f8-4ad4-9557-3c10759586aa None None] MFA Rules not processed for user `bd06f1f3ff124acbaede2c9fb1f116a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:11.523041 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-42331cb4-2b3f-416a-a6e7-ff9539c96ce5 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:11.524321 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-42331cb4-2b3f-416a-a6e7-ff9539c96ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:11.546297 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2f026f06-25f8-4ad4-9557-3c10759586aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:11.548741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 854/1713] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:11.550285 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25c54a-d5db-4dfa-b806-2d0f9bd23d3d None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:11.550573 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25c54a-d5db-4dfa-b806-2d0f9bd23d3d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:11.550854 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25c54a-d5db-4dfa-b806-2d0f9bd23d3d None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:11.562241 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 860/1714] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:11.563334 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f026f06-25f8-4ad4-9557-3c10759586aa None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:11.577250 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 855/1715] 10.222.0.16 () {54 vars in 912 bytes} [Mon Jul 4 05:56:11 2022] GET /identity => generated 270 bytes in 28 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:56:11.578174 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25c54a-d5db-4dfa-b806-2d0f9bd23d3d None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:11.582827 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f026f06-25f8-4ad4-9557-3c10759586aa None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:11.584393 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-1d25c54a-d5db-4dfa-b806-2d0f9bd23d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:11.590625 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af874e-03ce-4e72-a184-43938a32cf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:11.599403 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af874e-03ce-4e72-a184-43938a32cf01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:11.599863 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af874e-03ce-4e72-a184-43938a32cf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:11.601282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af874e-03ce-4e72-a184-43938a32cf01 admin admin] PATH_INFO: `/v3/projects/fde6c89a834f4c96a817983e066c0478/users/c90671c44ec2411790441a070c4b6e05/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:11.638590 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af874e-03ce-4e72-a184-43938a32cf01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fde6c89a834f4c96a817983e066c0478, user_id=c90671c44ec2411790441a070c4b6e05, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:11.645928 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af874e-03ce-4e72-a184-43938a32cf01 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:11.687490 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 861/1716] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:11 2022] PUT /identity/v3/projects/fde6c89a834f4c96a817983e066c0478/users/c90671c44ec2411790441a070c4b6e05/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:11.688550 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af874e-03ce-4e72-a184-43938a32cf01 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:11.846954 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25c54a-d5db-4dfa-b806-2d0f9bd23d3d None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:11.861326 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:11.873089 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af874e-03ce-4e72-a184-43938a32cf01 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:11.893754 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109c5d0-f18a-4fa3-a1b0-43d9b16bd2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:11.893968 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109c5d0-f18a-4fa3-a1b0-43d9b16bd2a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:11.894224 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109c5d0-f18a-4fa3-a1b0-43d9b16bd2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:11.894432 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109c5d0-f18a-4fa3-a1b0-43d9b16bd2a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:11.895331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7109c5d0-f18a-4fa3-a1b0-43d9b16bd2a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:56:11.895643 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7109c5d0-f18a-4fa3-a1b0-43d9b16bd2a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:11.898215 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7109c5d0-f18a-4fa3-a1b0-43d9b16bd2a8 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:11.928766 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3b54b-0369-4be7-9d08-fefbb25731f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:11.929455 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3b54b-0369-4be7-9d08-fefbb25731f9 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:11.929748 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3b54b-0369-4be7-9d08-fefbb25731f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:11.930326 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3b54b-0369-4be7-9d08-fefbb25731f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:11.934796 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 862/1717] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:56:11.936318 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8487aef-dcd0-4762-bd9d-a97a8f8eb951 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:11.937041 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8487aef-dcd0-4762-bd9d-a97a8f8eb951 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:11.937041 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8487aef-dcd0-4762-bd9d-a97a8f8eb951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:11.994511 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:12.027755 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-f8487aef-dcd0-4762-bd9d-a97a8f8eb951 None None] MFA Rules not processed for user `5e5be3de52e945d3af1b2cad1c84c755`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:12.029183 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f8487aef-dcd0-4762-bd9d-a97a8f8eb951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:12.037292 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3b54b-0369-4be7-9d08-fefbb25731f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:12.038928 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3b54b-0369-4be7-9d08-fefbb25731f9 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:12.050825 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 856/1718] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:12.051744 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3b54b-0369-4be7-9d08-fefbb25731f9 service nova] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:12.063257 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3b54b-0369-4be7-9d08-fefbb25731f9 service nova] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:12.068867 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c960b16-58b9-4861-b460-96bc56e45de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:12.069563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c960b16-58b9-4861-b460-96bc56e45de4 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:12.069846 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c960b16-58b9-4861-b460-96bc56e45de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:12.070123 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c960b16-58b9-4861-b460-96bc56e45de4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:12.070858 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c960b16-58b9-4861-b460-96bc56e45de4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:12.072639 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c960b16-58b9-4861-b460-96bc56e45de4 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:12.090422 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 857/1719] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:12.091429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c960b16-58b9-4861-b460-96bc56e45de4 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:12.094216 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-4c960b16-58b9-4861-b460-96bc56e45de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:12.109535 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c960b16-58b9-4861-b460-96bc56e45de4 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:12.116237 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d7a57-0c38-4132-887f-b4a53fa630c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:12.117358 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d7a57-0c38-4132-887f-b4a53fa630c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:12.118147 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d7a57-0c38-4132-887f-b4a53fa630c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:12.118565 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d7a57-0c38-4132-887f-b4a53fa630c5 admin admin] PATH_INFO: `/v3/users/1a02cb7c0c50483c9e43162854284cd7` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:12.121521 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 863/1720] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jul 4 05:56:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:12.121521 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8487aef-dcd0-4762-bd9d-a97a8f8eb951 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:12.122898 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d7a57-0c38-4132-887f-b4a53fa630c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a02cb7c0c50483c9e43162854284cd7)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:12.125334 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d7a57-0c38-4132-887f-b4a53fa630c5 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:12.139517 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8487aef-dcd0-4762-bd9d-a97a8f8eb951 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:12.154135 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553bd2c-eae2-4590-80c1-edc6a8fbfc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:12.154832 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553bd2c-eae2-4590-80c1-edc6a8fbfc51 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:12.155110 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553bd2c-eae2-4590-80c1-edc6a8fbfc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:12.155409 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553bd2c-eae2-4590-80c1-edc6a8fbfc51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:12.156123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553bd2c-eae2-4590-80c1-edc6a8fbfc51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:12.158044 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553bd2c-eae2-4590-80c1-edc6a8fbfc51 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:12.232793 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 864/1721] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:12 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:12.234229 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553bd2c-eae2-4590-80c1-edc6a8fbfc51 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:12.269379 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-5e4d7a57-0c38-4132-887f-b4a53fa630c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a02cb7c0c50483c9e43162854284cd7'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:12.270652 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-5e4d7a57-0c38-4132-887f-b4a53fa630c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a02cb7c0c50483c9e43162854284cd7'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:12.289437 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-5e4d7a57-0c38-4132-887f-b4a53fa630c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a02cb7c0c50483c9e43162854284cd7'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:12.295084 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-5e4d7a57-0c38-4132-887f-b4a53fa630c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a02cb7c0c50483c9e43162854284cd7'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:12.336562 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-5e4d7a57-0c38-4132-887f-b4a53fa630c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a02cb7c0c50483c9e43162854284cd7'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:12.384958 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 858/1722] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:56:12 2022] DELETE /identity/v3/users/1a02cb7c0c50483c9e43162854284cd7 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:12.385875 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d7a57-0c38-4132-887f-b4a53fa630c5 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:12.387383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-5e4d7a57-0c38-4132-887f-b4a53fa630c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:12.458171 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553bd2c-eae2-4590-80c1-edc6a8fbfc51 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:12.597077 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d7a57-0c38-4132-887f-b4a53fa630c5 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:12.612806 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92386a09-8ee9-4c3e-b0f5-c2bd1da00616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:12.613729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92386a09-8ee9-4c3e-b0f5-c2bd1da00616 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:12.614134 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92386a09-8ee9-4c3e-b0f5-c2bd1da00616 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:12.614519 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92386a09-8ee9-4c3e-b0f5-c2bd1da00616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:12.626503 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c525a-9df2-454d-b80f-7703bdc2ab60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:12.630654 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c525a-9df2-454d-b80f-7703bdc2ab60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:12.631329 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c525a-9df2-454d-b80f-7703bdc2ab60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:12.631686 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c525a-9df2-454d-b80f-7703bdc2ab60 admin admin] PATH_INFO: `/v3/projects/fde6c89a834f4c96a817983e066c0478/users/c90671c44ec2411790441a070c4b6e05/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:12.631790 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-92386a09-8ee9-4c3e-b0f5-c2bd1da00616 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:12.634145 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c525a-9df2-454d-b80f-7703bdc2ab60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fde6c89a834f4c96a817983e066c0478, user_id=c90671c44ec2411790441a070c4b6e05, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:12.637428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c525a-9df2-454d-b80f-7703bdc2ab60 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:12.656331 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92386a09-8ee9-4c3e-b0f5-c2bd1da00616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:12.657857 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92386a09-8ee9-4c3e-b0f5-c2bd1da00616 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:12.659380 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 865/1723] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:12 2022] PUT /identity/v3/projects/fde6c89a834f4c96a817983e066c0478/users/c90671c44ec2411790441a070c4b6e05/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:12.660445 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c525a-9df2-454d-b80f-7703bdc2ab60 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:12.667888 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ed2c525a-9df2-454d-b80f-7703bdc2ab60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:12.677751 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 859/1724] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:12.680841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:12.681034 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92386a09-8ee9-4c3e-b0f5-c2bd1da00616 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:12.685369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-92386a09-8ee9-4c3e-b0f5-c2bd1da00616 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:12.795445 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:12.802280 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c525a-9df2-454d-b80f-7703bdc2ab60 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:12.811510 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed4083-3e39-447a-bf62-38be1ed70419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:12.812383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed4083-3e39-447a-bf62-38be1ed70419 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:12.812671 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed4083-3e39-447a-bf62-38be1ed70419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:12.812949 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed4083-3e39-447a-bf62-38be1ed70419 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:12.813999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed4083-3e39-447a-bf62-38be1ed70419 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:12.816608 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed4083-3e39-447a-bf62-38be1ed70419 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:12.849665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 866/1725] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:12 2022] POST /identity/v3/users => generated 290 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:12.854562 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5f6bd-f0f3-429d-b94c-839f58060715 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:12.854879 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5f6bd-f0f3-429d-b94c-839f58060715 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:12.855161 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5f6bd-f0f3-429d-b94c-839f58060715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:12.874763 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92386a09-8ee9-4c3e-b0f5-c2bd1da00616 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:12.949550 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-22f5f6bd-f0f3-429d-b94c-839f58060715 None None] MFA Rules not processed for user `75f4eab7b971447bbe964e79fa6bf3c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:12.955741 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-22f5f6bd-f0f3-429d-b94c-839f58060715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:13.028864 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e416d2-afc2-48ae-9d17-54e5298d59e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:13.029496 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e416d2-afc2-48ae-9d17-54e5298d59e9 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:13.029783 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e416d2-afc2-48ae-9d17-54e5298d59e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:13.030052 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e416d2-afc2-48ae-9d17-54e5298d59e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:13.031974 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-24e416d2-afc2-48ae-9d17-54e5298d59e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:13.143445 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 867/1726] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:13.143445 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09f94a-674d-432b-9e49-2b8f1ab87782 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:13.143445 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09f94a-674d-432b-9e49-2b8f1ab87782 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:13.143445 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09f94a-674d-432b-9e49-2b8f1ab87782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:13.166767 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e416d2-afc2-48ae-9d17-54e5298d59e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:13.170156 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e416d2-afc2-48ae-9d17-54e5298d59e9 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:13.185351 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-1a09f94a-674d-432b-9e49-2b8f1ab87782 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:13.188845 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1a09f94a-674d-432b-9e49-2b8f1ab87782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:13.197162 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 860/1727] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:13.198046 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e416d2-afc2-48ae-9d17-54e5298d59e9 service nova] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:13.200283 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-24e416d2-afc2-48ae-9d17-54e5298d59e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:13.210848 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 868/1728] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:13.212765 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09f94a-674d-432b-9e49-2b8f1ab87782 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:13.246366 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e416d2-afc2-48ae-9d17-54e5298d59e9 service nova] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:13.256737 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09f94a-674d-432b-9e49-2b8f1ab87782 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:13.261432 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bedb6-7dec-405c-8419-f1663cfe15f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:13.262349 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bedb6-7dec-405c-8419-f1663cfe15f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:13.262631 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bedb6-7dec-405c-8419-f1663cfe15f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:13.262904 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bedb6-7dec-405c-8419-f1663cfe15f8 admin admin] PATH_INFO: `/v3/projects/f67e920c9a534b40a22be150ff3a6da1` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:13.274302 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bedb6-7dec-405c-8419-f1663cfe15f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f67e920c9a534b40a22be150ff3a6da1)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:13.274650 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9dd54-57ae-4864-b0f4-39761c033cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:13.275305 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9dd54-57ae-4864-b0f4-39761c033cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:13.275591 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9dd54-57ae-4864-b0f4-39761c033cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:13.275865 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9dd54-57ae-4864-b0f4-39761c033cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:13.280419 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9dd54-57ae-4864-b0f4-39761c033cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:13.281655 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bedb6-7dec-405c-8419-f1663cfe15f8 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:13.289410 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9dd54-57ae-4864-b0f4-39761c033cb9 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:13.332419 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 869/1729] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:13.337806 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9dd54-57ae-4864-b0f4-39761c033cb9 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:13.343905 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6fe9dd54-57ae-4864-b0f4-39761c033cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:13.502020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-201bedb6-7dec-405c-8419-f1663cfe15f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f67e920c9a534b40a22be150ff3a6da1', 'request_id': 'req-201bedb6-7dec-405c-8419-f1663cfe15f8'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:13.531974 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-201bedb6-7dec-405c-8419-f1663cfe15f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f67e920c9a534b40a22be150ff3a6da1', 'request_id': 'req-201bedb6-7dec-405c-8419-f1663cfe15f8'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:13.545248 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-201bedb6-7dec-405c-8419-f1663cfe15f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f67e920c9a534b40a22be150ff3a6da1', 'request_id': 'req-201bedb6-7dec-405c-8419-f1663cfe15f8'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:13.565892 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:13.567344 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9dd54-57ae-4864-b0f4-39761c033cb9 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:13.599288 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-201bedb6-7dec-405c-8419-f1663cfe15f8 admin admin] The token cache is being invalidate because project f67e920c9a534b40a22be150ff3a6da1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:56:13.599591 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-201bedb6-7dec-405c-8419-f1663cfe15f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:13.603081 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-201bedb6-7dec-405c-8419-f1663cfe15f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:13.605318 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 861/1730] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:56:13 2022] DELETE /identity/v3/projects/f67e920c9a534b40a22be150ff3a6da1 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:13.618189 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bedb6-7dec-405c-8419-f1663cfe15f8 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:13.619978 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-201bedb6-7dec-405c-8419-f1663cfe15f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:13.621518 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:13.690659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4473b-1ab9-46cf-aa1b-0f3c230c9364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:13.692370 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4473b-1ab9-46cf-aa1b-0f3c230c9364 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:13.692874 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4473b-1ab9-46cf-aa1b-0f3c230c9364 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:13.693316 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4473b-1ab9-46cf-aa1b-0f3c230c9364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:13.695648 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-daa4473b-1ab9-46cf-aa1b-0f3c230c9364 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:13.774232 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bedb6-7dec-405c-8419-f1663cfe15f8 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:13.794226 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa281e1-6f10-44a5-85e3-a4609bd4278b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:13.795024 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa281e1-6f10-44a5-85e3-a4609bd4278b admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:13.795339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa281e1-6f10-44a5-85e3-a4609bd4278b admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:13.795623 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa281e1-6f10-44a5-85e3-a4609bd4278b admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:13.797016 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa281e1-6f10-44a5-85e3-a4609bd4278b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:13.798848 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa281e1-6f10-44a5-85e3-a4609bd4278b admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:13.821146 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 862/1731] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:13.821146 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa281e1-6f10-44a5-85e3-a4609bd4278b admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:13.830416 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4473b-1ab9-46cf-aa1b-0f3c230c9364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:13.832675 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4473b-1ab9-46cf-aa1b-0f3c230c9364 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:13.837237 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9fa281e1-6f10-44a5-85e3-a4609bd4278b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:13.850147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 870/1732] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:13.852071 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4473b-1ab9-46cf-aa1b-0f3c230c9364 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:13.856116 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-daa4473b-1ab9-46cf-aa1b-0f3c230c9364 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:13.881433 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4473b-1ab9-46cf-aa1b-0f3c230c9364 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:13.895817 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bf445-b062-4bb0-ab85-ba5b02fc5070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:13.896732 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bf445-b062-4bb0-ab85-ba5b02fc5070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:13.897227 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bf445-b062-4bb0-ab85-ba5b02fc5070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:13.897329 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bf445-b062-4bb0-ab85-ba5b02fc5070 admin admin] PATH_INFO: `/v3/users/d6ea6e627f89473080ce7e77bac57d25` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:13.898710 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455bf445-b062-4bb0-ab85-ba5b02fc5070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6ea6e627f89473080ce7e77bac57d25)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:13.900815 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455bf445-b062-4bb0-ab85-ba5b02fc5070 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:14.010614 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-455bf445-b062-4bb0-ab85-ba5b02fc5070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6ea6e627f89473080ce7e77bac57d25'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:14.013493 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa281e1-6f10-44a5-85e3-a4609bd4278b admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:14.026551 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-455bf445-b062-4bb0-ab85-ba5b02fc5070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6ea6e627f89473080ce7e77bac57d25'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:14.029841 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76489b1-04c5-453c-8c46-e097e11e15e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:14.030948 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76489b1-04c5-453c-8c46-e097e11e15e0 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:14.031505 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76489b1-04c5-453c-8c46-e097e11e15e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:14.031885 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76489b1-04c5-453c-8c46-e097e11e15e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:14.035926 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f76489b1-04c5-453c-8c46-e097e11e15e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:14.046998 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-455bf445-b062-4bb0-ab85-ba5b02fc5070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6ea6e627f89473080ce7e77bac57d25'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:14.047832 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-455bf445-b062-4bb0-ab85-ba5b02fc5070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6ea6e627f89473080ce7e77bac57d25'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:14.070940 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-455bf445-b062-4bb0-ab85-ba5b02fc5070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6ea6e627f89473080ce7e77bac57d25'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:14.084957 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 871/1733] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:56:13 2022] DELETE /identity/v3/users/d6ea6e627f89473080ce7e77bac57d25 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:14.086493 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8177d-8156-4907-87b1-ac9150a33f1f None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:14.086778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8177d-8156-4907-87b1-ac9150a33f1f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:14.087055 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8177d-8156-4907-87b1-ac9150a33f1f None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:14.096478 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 872/1734] 10.222.0.16 () {54 vars in 960 bytes} [Mon Jul 4 05:56:14 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:56:14.097481 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8177d-8156-4907-87b1-ac9150a33f1f None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:14.101411 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d5a8177d-8156-4907-87b1-ac9150a33f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:14.177519 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76489b1-04c5-453c-8c46-e097e11e15e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:14.179170 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76489b1-04c5-453c-8c46-e097e11e15e0 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:14.202560 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 863/1735] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:14.204029 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fae52-a937-4c9a-b6c4-07ed86f91213 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:14.204312 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fae52-a937-4c9a-b6c4-07ed86f91213 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:14.204796 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fae52-a937-4c9a-b6c4-07ed86f91213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:14.216479 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:14.250622 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-020fae52-a937-4c9a-b6c4-07ed86f91213 None None] MFA Rules not processed for user `260f58535f4e46a197d00276d37fd515`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:14.252420 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-020fae52-a937-4c9a-b6c4-07ed86f91213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:14.277700 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8177d-8156-4907-87b1-ac9150a33f1f None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:14.283919 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e99e4e-1ce3-476d-a4e8-cc37ce0d58e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:14.285528 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e99e4e-1ce3-476d-a4e8-cc37ce0d58e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:14.285809 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e99e4e-1ce3-476d-a4e8-cc37ce0d58e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:14.286181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e99e4e-1ce3-476d-a4e8-cc37ce0d58e5 admin admin] PATH_INFO: `/v3/projects/efaded9775be46b7b0aaaea24b88ad48/users/9d5045ae1042497baaf54a37fbaea084/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:14.301334 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:14.326336 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e99e4e-1ce3-476d-a4e8-cc37ce0d58e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efaded9775be46b7b0aaaea24b88ad48, user_id=9d5045ae1042497baaf54a37fbaea084, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:14.334748 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e99e4e-1ce3-476d-a4e8-cc37ce0d58e5 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:14.389820 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 873/1736] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:14 2022] PUT /identity/v3/projects/efaded9775be46b7b0aaaea24b88ad48/users/9d5045ae1042497baaf54a37fbaea084/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:14.404980 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b237b-be72-4eff-8928-49ef5f56549e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:14.405534 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b237b-be72-4eff-8928-49ef5f56549e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:14.406146 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b237b-be72-4eff-8928-49ef5f56549e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:14.432502 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 864/1737] 10.222.0.16 () {58 vars in 1057 bytes} [Mon Jul 4 05:56:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:14.441525 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fae52-a937-4c9a-b6c4-07ed86f91213 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:14.484313 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fae52-a937-4c9a-b6c4-07ed86f91213 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:14.484519 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-de6b237b-be72-4eff-8928-49ef5f56549e None None] MFA Rules not processed for user `9d5045ae1042497baaf54a37fbaea084`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:14.489383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-de6b237b-be72-4eff-8928-49ef5f56549e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:14.618721 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 874/1738] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:56:14.629433 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b237b-be72-4eff-8928-49ef5f56549e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:14.726452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d1afc-1423-454a-973c-620d9983d679 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260f58535f4e46a197d00276d37fd515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:14.727144 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d1afc-1423-454a-973c-620d9983d679 service placement] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:14.727488 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d1afc-1423-454a-973c-620d9983d679 service placement] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:14.727764 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d1afc-1423-454a-973c-620d9983d679 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:14.738044 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f84d1afc-1423-454a-973c-620d9983d679 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:14.744688 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b237b-be72-4eff-8928-49ef5f56549e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:14.757510 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f225d15-7053-4035-9a0d-130ce7118eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:14.758563 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f225d15-7053-4035-9a0d-130ce7118eec admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:14.760902 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f225d15-7053-4035-9a0d-130ce7118eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:14.761290 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f225d15-7053-4035-9a0d-130ce7118eec admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:14.762264 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f225d15-7053-4035-9a0d-130ce7118eec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:14.765482 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d1afc-1423-454a-973c-620d9983d679 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:14.766864 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d1afc-1423-454a-973c-620d9983d679 service placement] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:14.767609 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f225d15-7053-4035-9a0d-130ce7118eec admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:14.806966 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 865/1739] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:14.852665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 875/1740] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:14 2022] POST /identity/v3/projects => generated 377 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:14.856843 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d1afc-1423-454a-973c-620d9983d679 service placement] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:14.879616 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d1afc-1423-454a-973c-620d9983d679 service placement] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:14.977347 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995b348-16fa-43ab-9553-1795bfb4d1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:14.978417 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995b348-16fa-43ab-9553-1795bfb4d1ef admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:14.978843 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995b348-16fa-43ab-9553-1795bfb4d1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:14.979301 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995b348-16fa-43ab-9553-1795bfb4d1ef admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:14.980461 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995b348-16fa-43ab-9553-1795bfb4d1ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:14.983710 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995b348-16fa-43ab-9553-1795bfb4d1ef admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:15.058532 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f225d15-7053-4035-9a0d-130ce7118eec admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:15.064686 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 866/1741] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:14 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:15.073859 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f225d15-7053-4035-9a0d-130ce7118eec admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:15.084331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11bc9a-9ec0-4fb6-96ce-6f15530480c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:15.085035 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11bc9a-9ec0-4fb6-96ce-6f15530480c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:15.085317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11bc9a-9ec0-4fb6-96ce-6f15530480c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:15.085594 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11bc9a-9ec0-4fb6-96ce-6f15530480c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:15.086334 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11bc9a-9ec0-4fb6-96ce-6f15530480c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:15.088139 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11bc9a-9ec0-4fb6-96ce-6f15530480c0 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:15.106106 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 876/1742] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:15.109985 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995b348-16fa-43ab-9553-1795bfb4d1ef admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:15.125435 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995b348-16fa-43ab-9553-1795bfb4d1ef admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:15.147045 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133ebc3-173f-4cec-93a4-928002ed0ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:15.148519 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133ebc3-173f-4cec-93a4-928002ed0ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:15.148519 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133ebc3-173f-4cec-93a4-928002ed0ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:15.148519 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133ebc3-173f-4cec-93a4-928002ed0ad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:15.150158 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133ebc3-173f-4cec-93a4-928002ed0ad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:15.151290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133ebc3-173f-4cec-93a4-928002ed0ad2 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:15.186794 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 867/1743] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:15.189071 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11bc9a-9ec0-4fb6-96ce-6f15530480c0 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:15.205274 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11bc9a-9ec0-4fb6-96ce-6f15530480c0 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:15.219971 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea3384-8daa-400d-a201-0256864cdb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:15.221100 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea3384-8daa-400d-a201-0256864cdb4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:15.221526 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea3384-8daa-400d-a201-0256864cdb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:15.222096 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea3384-8daa-400d-a201-0256864cdb4f admin admin] PATH_INFO: `/v3/projects/37202c8f23334be18f2e516079afa849/users/f7dc031d24a442af92f2436fc3b3bd87/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:15.269943 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea3384-8daa-400d-a201-0256864cdb4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=37202c8f23334be18f2e516079afa849, user_id=f7dc031d24a442af92f2436fc3b3bd87, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:15.273057 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea3384-8daa-400d-a201-0256864cdb4f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:15.311467 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 877/1744] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:15 2022] PUT /identity/v3/projects/37202c8f23334be18f2e516079afa849/users/f7dc031d24a442af92f2436fc3b3bd87/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:15.314034 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb436ce5-d59d-455e-a9ec-5b19479f797e None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:15.314506 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb436ce5-d59d-455e-a9ec-5b19479f797e None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:15.314896 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb436ce5-d59d-455e-a9ec-5b19479f797e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:15.333754 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ecd5d-7f3d-4837-92d5-55525e5e363c None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:15.334214 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ecd5d-7f3d-4837-92d5-55525e5e363c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:15.334594 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ecd5d-7f3d-4837-92d5-55525e5e363c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:15.370331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:15.391701 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-bb436ce5-d59d-455e-a9ec-5b19479f797e None None] MFA Rules not processed for user `f7dc031d24a442af92f2436fc3b3bd87`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:15.392930 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-df1ecd5d-7f3d-4837-92d5-55525e5e363c None None] MFA Rules not processed for user `c90671c44ec2411790441a070c4b6e05`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:15.394397 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-df1ecd5d-7f3d-4837-92d5-55525e5e363c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:15.395326 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-bb436ce5-d59d-455e-a9ec-5b19479f797e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:15.454215 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:15.587506 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 868/1745] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:56:15.594028 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb436ce5-d59d-455e-a9ec-5b19479f797e None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:15.609666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 878/1746] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:15 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:56:15.617717 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001aa59-20ce-4f94-9d69-0b02081c9b5a None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:15.619081 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001aa59-20ce-4f94-9d69-0b02081c9b5a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:15.619081 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001aa59-20ce-4f94-9d69-0b02081c9b5a None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:15.621333 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 879/1747] 10.222.0.16 () {54 vars in 912 bytes} [Mon Jul 4 05:56:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 05:56:15.627069 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ae6f1-374b-4b86-b3e2-9faeb0151aa0 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:15.627581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ae6f1-374b-4b86-b3e2-9faeb0151aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:15.628094 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ae6f1-374b-4b86-b3e2-9faeb0151aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:15.674065 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-0d9ae6f1-374b-4b86-b3e2-9faeb0151aa0 None None] MFA Rules not processed for user `5e5be3de52e945d3af1b2cad1c84c755`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:15.678480 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0d9ae6f1-374b-4b86-b3e2-9faeb0151aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:15.767270 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb436ce5-d59d-455e-a9ec-5b19479f797e None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:15.773470 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8086296-78fd-4543-9993-ed5e5782d0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:15.774085 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8086296-78fd-4543-9993-ed5e5782d0e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:15.774474 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8086296-78fd-4543-9993-ed5e5782d0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:15.775121 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8086296-78fd-4543-9993-ed5e5782d0e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:15.776281 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8086296-78fd-4543-9993-ed5e5782d0e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:15.781117 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8086296-78fd-4543-9993-ed5e5782d0e9 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:15.829227 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 880/1748] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jul 4 05:56:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:15.831720 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ae6f1-374b-4b86-b3e2-9faeb0151aa0 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:15.835005 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0d9ae6f1-374b-4b86-b3e2-9faeb0151aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:15.842893 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 869/1749] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:15 2022] POST /identity/v3/projects => generated 379 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:15.846941 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8086296-78fd-4543-9993-ed5e5782d0e9 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:15.892498 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ae6f1-374b-4b86-b3e2-9faeb0151aa0 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:15.964028 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8086296-78fd-4543-9993-ed5e5782d0e9 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:15.971869 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17ac08-5c90-44dc-adcf-9cd9bf903188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:15.972698 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17ac08-5c90-44dc-adcf-9cd9bf903188 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:15.973044 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17ac08-5c90-44dc-adcf-9cd9bf903188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:15.973506 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17ac08-5c90-44dc-adcf-9cd9bf903188 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:15.974296 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd17ac08-5c90-44dc-adcf-9cd9bf903188 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:15.977070 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd17ac08-5c90-44dc-adcf-9cd9bf903188 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:16.007462 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 870/1750] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:15 2022] POST /identity/v3/users => generated 296 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:16.009175 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17ac08-5c90-44dc-adcf-9cd9bf903188 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:16.010658 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-dd17ac08-5c90-44dc-adcf-9cd9bf903188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:16.038553 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d3fdb-29a5-4e0b-81be-bcfe75f2ff3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:16.041044 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d3fdb-29a5-4e0b-81be-bcfe75f2ff3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:16.041044 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d3fdb-29a5-4e0b-81be-bcfe75f2ff3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:16.041044 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d3fdb-29a5-4e0b-81be-bcfe75f2ff3f admin admin] PATH_INFO: `/v3/projects/4a28eba15eee4ff68eb3762a3dcf164e` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:16.044418 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d3fdb-29a5-4e0b-81be-bcfe75f2ff3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a28eba15eee4ff68eb3762a3dcf164e)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:16.046615 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d3fdb-29a5-4e0b-81be-bcfe75f2ff3f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:16.096237 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:16.136272 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17ac08-5c90-44dc-adcf-9cd9bf903188 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:16.152148 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e5a4a-30c2-40ec-a4a5-e5cfecb2e9d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:16.152860 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e5a4a-30c2-40ec-a4a5-e5cfecb2e9d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:16.153146 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e5a4a-30c2-40ec-a4a5-e5cfecb2e9d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:16.153427 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e5a4a-30c2-40ec-a4a5-e5cfecb2e9d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:16.167789 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e5a4a-30c2-40ec-a4a5-e5cfecb2e9d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:16.169307 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e5a4a-30c2-40ec-a4a5-e5cfecb2e9d2 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:16.188178 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 871/1751] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:16.189074 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e5a4a-30c2-40ec-a4a5-e5cfecb2e9d2 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:16.228889 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e5a4a-30c2-40ec-a4a5-e5cfecb2e9d2 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:16.246989 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1109284-fff4-43bb-8c30-0cdcf36082f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:16.248709 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1109284-fff4-43bb-8c30-0cdcf36082f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:16.249138 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1109284-fff4-43bb-8c30-0cdcf36082f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:16.249553 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1109284-fff4-43bb-8c30-0cdcf36082f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:16.250466 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1109284-fff4-43bb-8c30-0cdcf36082f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:16.252732 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1109284-fff4-43bb-8c30-0cdcf36082f6 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:16.281691 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 872/1752] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:16.288824 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1109284-fff4-43bb-8c30-0cdcf36082f6 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:16.315159 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1109284-fff4-43bb-8c30-0cdcf36082f6 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:16.326669 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f26266-30a0-46f4-a3d3-7ba55f19072f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:16.327628 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f26266-30a0-46f4-a3d3-7ba55f19072f admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:16.328092 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f26266-30a0-46f4-a3d3-7ba55f19072f admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:16.337069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f26266-30a0-46f4-a3d3-7ba55f19072f admin admin] PATH_INFO: `/v3/projects/ebfadec412c84fd2991e82825d621f96/users/191706d8c4134961b5e9cd2cedef7e4c/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:16.403081 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f26266-30a0-46f4-a3d3-7ba55f19072f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebfadec412c84fd2991e82825d621f96, user_id=191706d8c4134961b5e9cd2cedef7e4c, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:16.412761 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f26266-30a0-46f4-a3d3-7ba55f19072f admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:16.436537 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:16.448084 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fc1d3fdb-29a5-4e0b-81be-bcfe75f2ff3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a28eba15eee4ff68eb3762a3dcf164e', 'request_id': 'req-fc1d3fdb-29a5-4e0b-81be-bcfe75f2ff3f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:16.451342 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 873/1753] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:16 2022] PUT /identity/v3/projects/ebfadec412c84fd2991e82825d621f96/users/191706d8c4134961b5e9cd2cedef7e4c/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:16.457253 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f26266-30a0-46f4-a3d3-7ba55f19072f admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:16.465833 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fc1d3fdb-29a5-4e0b-81be-bcfe75f2ff3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a28eba15eee4ff68eb3762a3dcf164e', 'request_id': 'req-fc1d3fdb-29a5-4e0b-81be-bcfe75f2ff3f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:16.485230 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fc1d3fdb-29a5-4e0b-81be-bcfe75f2ff3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a28eba15eee4ff68eb3762a3dcf164e', 'request_id': 'req-fc1d3fdb-29a5-4e0b-81be-bcfe75f2ff3f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:16.505525 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fc1d3fdb-29a5-4e0b-81be-bcfe75f2ff3f admin admin] The token cache is being invalidate because project 4a28eba15eee4ff68eb3762a3dcf164e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:56:16.505916 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fc1d3fdb-29a5-4e0b-81be-bcfe75f2ff3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:16.506881 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fc1d3fdb-29a5-4e0b-81be-bcfe75f2ff3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:16.509284 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 881/1754] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:56:15 2022] DELETE /identity/v3/projects/4a28eba15eee4ff68eb3762a3dcf164e => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:16.516063 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c8366-265d-4139-b033-2590a9d72ebe None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:16.519706 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c8366-265d-4139-b033-2590a9d72ebe None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:16.519706 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c8366-265d-4139-b033-2590a9d72ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:16.571993 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-553c8366-265d-4139-b033-2590a9d72ebe None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:16.577450 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-553c8366-265d-4139-b033-2590a9d72ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:16.637951 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f26266-30a0-46f4-a3d3-7ba55f19072f admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:16.652415 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28047f4-2156-4453-b4fa-4abdd0eada10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:16.653116 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28047f4-2156-4453-b4fa-4abdd0eada10 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:16.653396 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28047f4-2156-4453-b4fa-4abdd0eada10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:16.653672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28047f4-2156-4453-b4fa-4abdd0eada10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:16.654404 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28047f4-2156-4453-b4fa-4abdd0eada10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:16.656251 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28047f4-2156-4453-b4fa-4abdd0eada10 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:16.697000 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 874/1755] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:16.697985 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28047f4-2156-4453-b4fa-4abdd0eada10 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:16.704128 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e28047f4-2156-4453-b4fa-4abdd0eada10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:16.729920 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28047f4-2156-4453-b4fa-4abdd0eada10 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:16.743277 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7d339-4319-4e7e-a6ce-fc5cd7a116f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:16.744214 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7d339-4319-4e7e-a6ce-fc5cd7a116f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:16.744493 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7d339-4319-4e7e-a6ce-fc5cd7a116f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:16.744768 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7d339-4319-4e7e-a6ce-fc5cd7a116f9 admin admin] PATH_INFO: `/v3/projects/ebfadec412c84fd2991e82825d621f96/users/191706d8c4134961b5e9cd2cedef7e4c/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:16.755666 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7d339-4319-4e7e-a6ce-fc5cd7a116f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebfadec412c84fd2991e82825d621f96, user_id=191706d8c4134961b5e9cd2cedef7e4c, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:16.759942 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7d339-4319-4e7e-a6ce-fc5cd7a116f9 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:16.767844 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 882/1756] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:16.769460 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571308c5-1813-4943-b1b7-f2d2dd5edca8 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:16.769751 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571308c5-1813-4943-b1b7-f2d2dd5edca8 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:16.770035 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571308c5-1813-4943-b1b7-f2d2dd5edca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:16.806062 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 875/1757] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:16 2022] PUT /identity/v3/projects/ebfadec412c84fd2991e82825d621f96/users/191706d8c4134961b5e9cd2cedef7e4c/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:16.819727 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb735e-18ef-4cc6-afef-d105cb30afb9 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:16.822807 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb735e-18ef-4cc6-afef-d105cb30afb9 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:16.823260 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb735e-18ef-4cc6-afef-d105cb30afb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:16.845752 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-571308c5-1813-4943-b1b7-f2d2dd5edca8 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:16.851380 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-571308c5-1813-4943-b1b7-f2d2dd5edca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:16.860873 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-feeb735e-18ef-4cc6-afef-d105cb30afb9 None None] MFA Rules not processed for user `191706d8c4134961b5e9cd2cedef7e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:16.863787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-feeb735e-18ef-4cc6-afef-d105cb30afb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:16.970606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 883/1758] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:16.972190 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571308c5-1813-4943-b1b7-f2d2dd5edca8 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:16.974096 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-571308c5-1813-4943-b1b7-f2d2dd5edca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:17.000196 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571308c5-1813-4943-b1b7-f2d2dd5edca8 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:17.013869 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54cf8c-2cd9-44ed-bc70-08c70aa4a6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:17.015327 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54cf8c-2cd9-44ed-bc70-08c70aa4a6a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:17.015787 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54cf8c-2cd9-44ed-bc70-08c70aa4a6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:17.016237 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54cf8c-2cd9-44ed-bc70-08c70aa4a6a9 admin admin] PATH_INFO: `/v3/projects/d518b0d94dd0444ea168c4a909399cd1` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:17.019033 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f54cf8c-2cd9-44ed-bc70-08c70aa4a6a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d518b0d94dd0444ea168c4a909399cd1)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:17.024743 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f54cf8c-2cd9-44ed-bc70-08c70aa4a6a9 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:17.077217 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 876/1759] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:17.078497 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb735e-18ef-4cc6-afef-d105cb30afb9 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:17.099484 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb735e-18ef-4cc6-afef-d105cb30afb9 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:17.115735 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8849b-f60b-4844-9f8e-954edc514e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:17.117585 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8849b-f60b-4844-9f8e-954edc514e33 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:17.118167 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8849b-f60b-4844-9f8e-954edc514e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:17.126464 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8849b-f60b-4844-9f8e-954edc514e33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:17.127747 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8849b-f60b-4844-9f8e-954edc514e33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:56:17.128805 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8849b-f60b-4844-9f8e-954edc514e33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:17.130892 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8849b-f60b-4844-9f8e-954edc514e33 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:17.134157 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9f54cf8c-2cd9-44ed-bc70-08c70aa4a6a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd518b0d94dd0444ea168c4a909399cd1', 'request_id': 'req-9f54cf8c-2cd9-44ed-bc70-08c70aa4a6a9'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:17.139437 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:17.146716 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 877/1760] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:56:17.151159 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8849b-f60b-4844-9f8e-954edc514e33 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:17.151399 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9f54cf8c-2cd9-44ed-bc70-08c70aa4a6a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd518b0d94dd0444ea168c4a909399cd1', 'request_id': 'req-9f54cf8c-2cd9-44ed-bc70-08c70aa4a6a9'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:17.154796 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f3e8849b-f60b-4844-9f8e-954edc514e33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:17.177107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9f54cf8c-2cd9-44ed-bc70-08c70aa4a6a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd518b0d94dd0444ea168c4a909399cd1', 'request_id': 'req-9f54cf8c-2cd9-44ed-bc70-08c70aa4a6a9'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:17.186441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:17.194874 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9f54cf8c-2cd9-44ed-bc70-08c70aa4a6a9 admin admin] The token cache is being invalidate because project d518b0d94dd0444ea168c4a909399cd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:56:17.196891 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9f54cf8c-2cd9-44ed-bc70-08c70aa4a6a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:17.198093 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9f54cf8c-2cd9-44ed-bc70-08c70aa4a6a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:17.203049 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 884/1761] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:56:16 2022] DELETE /identity/v3/projects/d518b0d94dd0444ea168c4a909399cd1 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:17.203049 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54cf8c-2cd9-44ed-bc70-08c70aa4a6a9 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:17.209363 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9f54cf8c-2cd9-44ed-bc70-08c70aa4a6a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:17.328366 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8849b-f60b-4844-9f8e-954edc514e33 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:17.373481 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54cf8c-2cd9-44ed-bc70-08c70aa4a6a9 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:17.381600 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3dcb1a-04c4-4fe1-b9f4-ee7b9a523a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:17.382005 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3dcb1a-04c4-4fe1-b9f4-ee7b9a523a1c admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:17.382237 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3dcb1a-04c4-4fe1-b9f4-ee7b9a523a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:17.382521 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3dcb1a-04c4-4fe1-b9f4-ee7b9a523a1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:17.390093 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3dcb1a-04c4-4fe1-b9f4-ee7b9a523a1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:17.392444 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3dcb1a-04c4-4fe1-b9f4-ee7b9a523a1c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:17.444519 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb62b64-b834-44f9-82e7-32e97a7ffac4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:17.445528 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb62b64-b834-44f9-82e7-32e97a7ffac4 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:17.446599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb62b64-b834-44f9-82e7-32e97a7ffac4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:17.447642 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb62b64-b834-44f9-82e7-32e97a7ffac4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:17.450981 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 885/1762] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:17 2022] POST /identity/v3/projects => generated 387 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:17.450981 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3dcb1a-04c4-4fe1-b9f4-ee7b9a523a1c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:17.455390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9a3dcb1a-04c4-4fe1-b9f4-ee7b9a523a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:17.457077 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-0bb62b64-b834-44f9-82e7-32e97a7ffac4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:17.625114 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb62b64-b834-44f9-82e7-32e97a7ffac4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:17.627491 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb62b64-b834-44f9-82e7-32e97a7ffac4 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:17.653466 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 878/1763] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:17 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:17.656017 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb62b64-b834-44f9-82e7-32e97a7ffac4 service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:17.662985 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3dcb1a-04c4-4fe1-b9f4-ee7b9a523a1c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:17.671953 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c511f71-8363-43ee-ad70-d65ee8209f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:17.674436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c511f71-8363-43ee-ad70-d65ee8209f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:17.676534 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c511f71-8363-43ee-ad70-d65ee8209f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:17.678226 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c511f71-8363-43ee-ad70-d65ee8209f98 admin admin] PATH_INFO: `/v3/users/9fd678b3673f449da023a5e41b8885d3` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:17.681179 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb62b64-b834-44f9-82e7-32e97a7ffac4 service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:17.681551 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c511f71-8363-43ee-ad70-d65ee8209f98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fd678b3673f449da023a5e41b8885d3)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:17.684739 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c511f71-8363-43ee-ad70-d65ee8209f98 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:17.693286 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a271ed-b350-4fb2-ab3d-d10e1b25225d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:17.701564 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a271ed-b350-4fb2-ab3d-d10e1b25225d admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:17.703023 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a271ed-b350-4fb2-ab3d-d10e1b25225d admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:17.705364 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a271ed-b350-4fb2-ab3d-d10e1b25225d admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:17.707225 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a271ed-b350-4fb2-ab3d-d10e1b25225d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:17.726650 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a271ed-b350-4fb2-ab3d-d10e1b25225d admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:17.831018 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 879/1764] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:17 2022] POST /identity/v3/users => generated 294 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:17.832113 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a271ed-b350-4fb2-ab3d-d10e1b25225d admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:17.846846 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-44a271ed-b350-4fb2-ab3d-d10e1b25225d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:17.889612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1c511f71-8363-43ee-ad70-d65ee8209f98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fd678b3673f449da023a5e41b8885d3'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:17.910690 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1c511f71-8363-43ee-ad70-d65ee8209f98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fd678b3673f449da023a5e41b8885d3'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:17.929317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1c511f71-8363-43ee-ad70-d65ee8209f98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fd678b3673f449da023a5e41b8885d3'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:17.930183 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1c511f71-8363-43ee-ad70-d65ee8209f98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fd678b3673f449da023a5e41b8885d3'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:17.960669 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1c511f71-8363-43ee-ad70-d65ee8209f98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fd678b3673f449da023a5e41b8885d3'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:17.979635 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 886/1765] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:56:17 2022] DELETE /identity/v3/users/9fd678b3673f449da023a5e41b8885d3 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:17.980823 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c511f71-8363-43ee-ad70-d65ee8209f98 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:17.984866 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1c511f71-8363-43ee-ad70-d65ee8209f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:18.005336 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:18.056898 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:18.071711 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a271ed-b350-4fb2-ab3d-d10e1b25225d admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:18.168066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200418e4-dd6d-4ae9-a8c4-7cbeb21d6022 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:18.168956 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200418e4-dd6d-4ae9-a8c4-7cbeb21d6022 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:18.169247 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200418e4-dd6d-4ae9-a8c4-7cbeb21d6022 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:18.169524 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200418e4-dd6d-4ae9-a8c4-7cbeb21d6022 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:18.174871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-200418e4-dd6d-4ae9-a8c4-7cbeb21d6022 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:18.198872 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c511f71-8363-43ee-ad70-d65ee8209f98 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:18.212040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2304426-8cf2-4edd-9ada-4fcfc2a4bda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:18.213552 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2304426-8cf2-4edd-9ada-4fcfc2a4bda2 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:18.213840 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2304426-8cf2-4edd-9ada-4fcfc2a4bda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:18.214115 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2304426-8cf2-4edd-9ada-4fcfc2a4bda2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:18.215138 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2304426-8cf2-4edd-9ada-4fcfc2a4bda2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:18.220371 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2304426-8cf2-4edd-9ada-4fcfc2a4bda2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:18.242159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 887/1766] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:18.248892 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87f4a2-549f-4f4f-a669-d5f09fce0e41 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:18.249195 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87f4a2-549f-4f4f-a669-d5f09fce0e41 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:18.249453 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87f4a2-549f-4f4f-a669-d5f09fce0e41 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:18.254122 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 888/1767] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jul 4 05:56:18 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:56:18.254979 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87f4a2-549f-4f4f-a669-d5f09fce0e41 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:18.281739 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87f4a2-549f-4f4f-a669-d5f09fce0e41 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:18.295247 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bcbc01-65aa-4a32-b589-2cfe70023534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:18.296270 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcbc01-65aa-4a32-b589-2cfe70023534 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:18.296730 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcbc01-65aa-4a32-b589-2cfe70023534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:18.297174 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcbc01-65aa-4a32-b589-2cfe70023534 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:18.298100 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bcbc01-65aa-4a32-b589-2cfe70023534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:18.300424 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bcbc01-65aa-4a32-b589-2cfe70023534 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:18.338315 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 889/1768] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:18.341658 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407ae63-fe86-4d29-a2d5-f4e8a27faae4 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:18.341965 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407ae63-fe86-4d29-a2d5-f4e8a27faae4 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:18.342406 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200418e4-dd6d-4ae9-a8c4-7cbeb21d6022 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:18.342512 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407ae63-fe86-4d29-a2d5-f4e8a27faae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:18.346033 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200418e4-dd6d-4ae9-a8c4-7cbeb21d6022 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:18.370589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-b407ae63-fe86-4d29-a2d5-f4e8a27faae4 None None] MFA Rules not processed for user `3ed779ae7e0f4c90aaed6d1f9e86a4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:18.372007 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b407ae63-fe86-4d29-a2d5-f4e8a27faae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:18.385692 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 880/1769] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:18.389893 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200418e4-dd6d-4ae9-a8c4-7cbeb21d6022 service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:18.415798 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200418e4-dd6d-4ae9-a8c4-7cbeb21d6022 service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:18.424724 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5663005-1691-4ab8-a329-905931db0a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:18.425853 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5663005-1691-4ab8-a329-905931db0a5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:18.426143 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5663005-1691-4ab8-a329-905931db0a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:18.426421 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5663005-1691-4ab8-a329-905931db0a5c admin admin] PATH_INFO: `/v3/projects/ac027e1572e840a588e1d8a770d0fa6e/users/c08dc531c0454faaab88a0643b971c42/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:18.450988 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5663005-1691-4ab8-a329-905931db0a5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac027e1572e840a588e1d8a770d0fa6e, user_id=c08dc531c0454faaab88a0643b971c42, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:18.455225 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5663005-1691-4ab8-a329-905931db0a5c admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:18.483559 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 890/1770] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jul 4 05:56:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:18.492284 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf4baf-1f89-4dae-9ada-ae7072d7fa81 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:18.493499 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf4baf-1f89-4dae-9ada-ae7072d7fa81 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:18.493499 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf4baf-1f89-4dae-9ada-ae7072d7fa81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:18.504590 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 881/1771] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:18 2022] PUT /identity/v3/projects/ac027e1572e840a588e1d8a770d0fa6e/users/c08dc531c0454faaab88a0643b971c42/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:18.506378 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0083e1-4642-4a9f-8485-0d1b0f7d4059 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:18.506677 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0083e1-4642-4a9f-8485-0d1b0f7d4059 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:18.507056 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0083e1-4642-4a9f-8485-0d1b0f7d4059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:18.573762 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-3ebf4baf-1f89-4dae-9ada-ae7072d7fa81 None None] MFA Rules not processed for user `260f58535f4e46a197d00276d37fd515`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:18.575258 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3ebf4baf-1f89-4dae-9ada-ae7072d7fa81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:18.613940 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-dc0083e1-4642-4a9f-8485-0d1b0f7d4059 None None] MFA Rules not processed for user `c08dc531c0454faaab88a0643b971c42`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:18.615276 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-dc0083e1-4642-4a9f-8485-0d1b0f7d4059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:18.701101 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 891/1772] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jul 4 05:56:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:18.776993 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 882/1773] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:18.781103 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf4baf-1f89-4dae-9ada-ae7072d7fa81 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:18.789290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0083e1-4642-4a9f-8485-0d1b0f7d4059 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:18.800506 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-dc0083e1-4642-4a9f-8485-0d1b0f7d4059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:18.855874 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0083e1-4642-4a9f-8485-0d1b0f7d4059 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:18.873429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7a497-1a8a-4c2e-9a6c-58a59a4f94ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260f58535f4e46a197d00276d37fd515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:18.876061 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7a497-1a8a-4c2e-9a6c-58a59a4f94ce service placement] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:18.876802 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7a497-1a8a-4c2e-9a6c-58a59a4f94ce service placement] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:18.877005 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:18.877135 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7a497-1a8a-4c2e-9a6c-58a59a4f94ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:18.914737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa7a497-1a8a-4c2e-9a6c-58a59a4f94ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:18.918362 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa7a497-1a8a-4c2e-9a6c-58a59a4f94ce service placement] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:18.951065 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 883/1774] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:18.952181 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7a497-1a8a-4c2e-9a6c-58a59a4f94ce service placement] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:18.958454 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-aaa7a497-1a8a-4c2e-9a6c-58a59a4f94ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:18.974142 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf4baf-1f89-4dae-9ada-ae7072d7fa81 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:18.987442 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3f1ae-0198-4eb7-bf8b-953297c7a038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:18.988968 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3f1ae-0198-4eb7-bf8b-953297c7a038 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:18.990122 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3f1ae-0198-4eb7-bf8b-953297c7a038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:18.991031 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3f1ae-0198-4eb7-bf8b-953297c7a038 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:18.991470 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:18.994104 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3f1ae-0198-4eb7-bf8b-953297c7a038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:18.998692 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3f1ae-0198-4eb7-bf8b-953297c7a038 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:19.077438 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 892/1775] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:18 2022] POST /identity/v3/projects => generated 387 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:19.087141 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3f1ae-0198-4eb7-bf8b-953297c7a038 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:19.210994 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7a497-1a8a-4c2e-9a6c-58a59a4f94ce service placement] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:19.362576 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3f1ae-0198-4eb7-bf8b-953297c7a038 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:19.380207 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea923fb-c5b5-45e6-9762-f5802512528a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:19.381995 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea923fb-c5b5-45e6-9762-f5802512528a admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:19.382292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea923fb-c5b5-45e6-9762-f5802512528a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:19.384683 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea923fb-c5b5-45e6-9762-f5802512528a admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:19.385484 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea923fb-c5b5-45e6-9762-f5802512528a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:19.390055 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea923fb-c5b5-45e6-9762-f5802512528a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:19.446143 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 893/1776] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:19 2022] POST /identity/v3/users => generated 294 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:19.446335 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748746f-5772-4df9-a5c4-dbfe07ca30a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55a1c343c60428db2d9e5e6ed865e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:19.446335 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748746f-5772-4df9-a5c4-dbfe07ca30a6 service swift] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:19.446517 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748746f-5772-4df9-a5c4-dbfe07ca30a6 service swift] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:19.447851 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea923fb-c5b5-45e6-9762-f5802512528a admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:19.450030 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748746f-5772-4df9-a5c4-dbfe07ca30a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:19.469690 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea923fb-c5b5-45e6-9762-f5802512528a admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:19.481372 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951964a0-dc15-479f-8f22-7b3bbf1d7c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:19.482072 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951964a0-dc15-479f-8f22-7b3bbf1d7c15 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:19.482352 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951964a0-dc15-479f-8f22-7b3bbf1d7c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:19.482630 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951964a0-dc15-479f-8f22-7b3bbf1d7c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:19.488086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951964a0-dc15-479f-8f22-7b3bbf1d7c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:19.489323 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951964a0-dc15-479f-8f22-7b3bbf1d7c15 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:19.516169 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 894/1777] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:19.520666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951964a0-dc15-479f-8f22-7b3bbf1d7c15 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:19.555285 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951964a0-dc15-479f-8f22-7b3bbf1d7c15 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:19.569765 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b01d1d-d510-48c4-b805-11372d7a96d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:19.570061 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b01d1d-d510-48c4-b805-11372d7a96d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:19.570272 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b01d1d-d510-48c4-b805-11372d7a96d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:19.570547 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b01d1d-d510-48c4-b805-11372d7a96d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:19.571777 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b01d1d-d510-48c4-b805-11372d7a96d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:19.574765 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b01d1d-d510-48c4-b805-11372d7a96d9 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:19.596019 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 895/1778] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:19.610639 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b01d1d-d510-48c4-b805-11372d7a96d9 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:19.636876 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b01d1d-d510-48c4-b805-11372d7a96d9 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:19.648277 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0dc319-68e9-4a74-938c-113deb09e3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:19.649842 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0dc319-68e9-4a74-938c-113deb09e3a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:19.650154 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0dc319-68e9-4a74-938c-113deb09e3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:19.650478 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0dc319-68e9-4a74-938c-113deb09e3a2 admin admin] PATH_INFO: `/v3/projects/9f5abf62fd674f0b91a077428d509bf0/users/679139d7557d4b19bac0f30c82d769a3/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:19.690298 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748746f-5772-4df9-a5c4-dbfe07ca30a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:19.700544 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748746f-5772-4df9-a5c4-dbfe07ca30a6 service swift] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:19.714414 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0dc319-68e9-4a74-938c-113deb09e3a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f5abf62fd674f0b91a077428d509bf0, user_id=679139d7557d4b19bac0f30c82d769a3, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:19.725513 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0dc319-68e9-4a74-938c-113deb09e3a2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:19.750025 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 884/1779] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 4 05:56:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 798 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 05:56:19.751505 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05855f2-f970-4337-9f77-e8bc53660dff None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:19.764749 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05855f2-f970-4337-9f77-e8bc53660dff None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:19.764749 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05855f2-f970-4337-9f77-e8bc53660dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:19.765012 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 896/1780] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:19 2022] PUT /identity/v3/projects/9f5abf62fd674f0b91a077428d509bf0/users/679139d7557d4b19bac0f30c82d769a3/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:19.767843 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bf8f9-9b1a-4f15-93b9-bb8b04442c3f None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:19.768144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bf8f9-9b1a-4f15-93b9-bb8b04442c3f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:19.768617 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bf8f9-9b1a-4f15-93b9-bb8b04442c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:19.848351 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-e80bf8f9-9b1a-4f15-93b9-bb8b04442c3f None None] MFA Rules not processed for user `679139d7557d4b19bac0f30c82d769a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:19.850593 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e80bf8f9-9b1a-4f15-93b9-bb8b04442c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:19.854668 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-a05855f2-f970-4337-9f77-e8bc53660dff None None] MFA Rules not processed for user `bd06f1f3ff124acbaede2c9fb1f116a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:19.857723 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-a05855f2-f970-4337-9f77-e8bc53660dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:20.058442 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:20.136960 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:20.166211 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 885/1781] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:20.173465 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333ffa1-6b2d-4be9-8199-51e92f454534 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:20.176917 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333ffa1-6b2d-4be9-8199-51e92f454534 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:20.178063 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333ffa1-6b2d-4be9-8199-51e92f454534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:20.196845 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 897/1782] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:20.197866 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80bf8f9-9b1a-4f15-93b9-bb8b04442c3f None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:20.281127 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-c333ffa1-6b2d-4be9-8199-51e92f454534 None None] MFA Rules not processed for user `1c4799b3a1a046aba74e9a6117d4d532`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:20.288866 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c333ffa1-6b2d-4be9-8199-51e92f454534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:20.484666 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 886/1783] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:20.504329 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333ffa1-6b2d-4be9-8199-51e92f454534 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:20.512655 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c333ffa1-6b2d-4be9-8199-51e92f454534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:20.546979 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80bf8f9-9b1a-4f15-93b9-bb8b04442c3f None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:20.574059 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2e182-8085-4493-a398-cbbed02a8871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:20.575652 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2e182-8085-4493-a398-cbbed02a8871 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:20.575969 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2e182-8085-4493-a398-cbbed02a8871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:20.576430 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2e182-8085-4493-a398-cbbed02a8871 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:20.577365 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2e182-8085-4493-a398-cbbed02a8871 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:20.584422 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2e182-8085-4493-a398-cbbed02a8871 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:20.590110 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333ffa1-6b2d-4be9-8199-51e92f454534 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:20.643600 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e0966-2e43-4b7e-a9c9-ac00201d9c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:20.649387 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e0966-2e43-4b7e-a9c9-ac00201d9c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:20.651992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e0966-2e43-4b7e-a9c9-ac00201d9c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:20.652426 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e0966-2e43-4b7e-a9c9-ac00201d9c3b admin admin] PATH_INFO: `/v3/projects/e8b50a7068b041f2ac20e1f9ab6415a2` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:20.675783 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e0966-2e43-4b7e-a9c9-ac00201d9c3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8b50a7068b041f2ac20e1f9ab6415a2)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:20.683865 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e0966-2e43-4b7e-a9c9-ac00201d9c3b admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:20.764814 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 898/1784] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:20 2022] POST /identity/v3/projects => generated 383 bytes in 565 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:20.766326 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2e182-8085-4493-a398-cbbed02a8871 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:20.936022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e64e0966-2e43-4b7e-a9c9-ac00201d9c3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8b50a7068b041f2ac20e1f9ab6415a2', 'request_id': 'req-e64e0966-2e43-4b7e-a9c9-ac00201d9c3b'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:20.955050 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e64e0966-2e43-4b7e-a9c9-ac00201d9c3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8b50a7068b041f2ac20e1f9ab6415a2', 'request_id': 'req-e64e0966-2e43-4b7e-a9c9-ac00201d9c3b'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:20.973496 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e64e0966-2e43-4b7e-a9c9-ac00201d9c3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8b50a7068b041f2ac20e1f9ab6415a2', 'request_id': 'req-e64e0966-2e43-4b7e-a9c9-ac00201d9c3b'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:21.028125 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e64e0966-2e43-4b7e-a9c9-ac00201d9c3b admin admin] The token cache is being invalidate because project e8b50a7068b041f2ac20e1f9ab6415a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:56:21.028815 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e64e0966-2e43-4b7e-a9c9-ac00201d9c3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:21.029647 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e64e0966-2e43-4b7e-a9c9-ac00201d9c3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:21.035582 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 887/1785] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:56:20 2022] DELETE /identity/v3/projects/e8b50a7068b041f2ac20e1f9ab6415a2 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:21.051844 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97337b7-2917-40af-8d49-e2b80c50a7c1 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:21.052458 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97337b7-2917-40af-8d49-e2b80c50a7c1 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:21.052937 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97337b7-2917-40af-8d49-e2b80c50a7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:21.089249 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-e97337b7-2917-40af-8d49-e2b80c50a7c1 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:21.091126 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e97337b7-2917-40af-8d49-e2b80c50a7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:21.143145 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2e182-8085-4493-a398-cbbed02a8871 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:21.333459 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 888/1786] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:21.335952 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eadb6c-8671-4408-ba8d-baf319111c46 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:21.336250 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eadb6c-8671-4408-ba8d-baf319111c46 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:21.336652 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eadb6c-8671-4408-ba8d-baf319111c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:21.384104 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-65eadb6c-8671-4408-ba8d-baf319111c46 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:21.385395 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-65eadb6c-8671-4408-ba8d-baf319111c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:21.403370 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5132db-5092-493e-bbab-3cf57ac7393a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:21.405559 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5132db-5092-493e-bbab-3cf57ac7393a admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:21.412658 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5132db-5092-493e-bbab-3cf57ac7393a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:21.413462 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5132db-5092-493e-bbab-3cf57ac7393a admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:21.415062 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5132db-5092-493e-bbab-3cf57ac7393a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:21.418463 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5132db-5092-493e-bbab-3cf57ac7393a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:21.435535 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 889/1787] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:21.436966 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eadb6c-8671-4408-ba8d-baf319111c46 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:21.454937 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eadb6c-8671-4408-ba8d-baf319111c46 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:21.467758 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb21de5-941d-4be1-9e3a-df4467284a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:21.469843 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb21de5-941d-4be1-9e3a-df4467284a84 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:21.470898 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb21de5-941d-4be1-9e3a-df4467284a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:21.471638 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb21de5-941d-4be1-9e3a-df4467284a84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:21.474120 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb21de5-941d-4be1-9e3a-df4467284a84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:56:21.474763 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb21de5-941d-4be1-9e3a-df4467284a84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:21.482048 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb21de5-941d-4be1-9e3a-df4467284a84 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:21.493941 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 899/1788] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:20 2022] POST /identity/v3/users => generated 298 bytes in 725 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:21.497102 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5132db-5092-493e-bbab-3cf57ac7393a admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:21.503126 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fb5132db-5092-493e-bbab-3cf57ac7393a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:21.529955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 890/1789] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:56:21.538853 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb21de5-941d-4be1-9e3a-df4467284a84 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:21.550013 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5132db-5092-493e-bbab-3cf57ac7393a admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:21.559245 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb21de5-941d-4be1-9e3a-df4467284a84 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:21.570385 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48c0b4-decc-4980-9293-12e1a31f0d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:21.571676 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48c0b4-decc-4980-9293-12e1a31f0d72 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:21.572017 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48c0b4-decc-4980-9293-12e1a31f0d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:21.572308 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48c0b4-decc-4980-9293-12e1a31f0d72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:21.574186 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48c0b4-decc-4980-9293-12e1a31f0d72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:21.576047 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48c0b4-decc-4980-9293-12e1a31f0d72 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:21.578959 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:21.581069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ca17e-a31f-45a4-bd15-1c3fb2be7467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:21.582545 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ca17e-a31f-45a4-bd15-1c3fb2be7467 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:21.586765 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ca17e-a31f-45a4-bd15-1c3fb2be7467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:21.587278 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ca17e-a31f-45a4-bd15-1c3fb2be7467 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:21.593193 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ca17e-a31f-45a4-bd15-1c3fb2be7467 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:21.598645 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ca17e-a31f-45a4-bd15-1c3fb2be7467 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:21.605724 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 900/1790] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:21.608848 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:21.609681 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48c0b4-decc-4980-9293-12e1a31f0d72 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:21.639629 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48c0b4-decc-4980-9293-12e1a31f0d72 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:21.659162 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dba6b5-5de9-4140-92e3-6698d0d8eb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:21.660126 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dba6b5-5de9-4140-92e3-6698d0d8eb92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:21.660403 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dba6b5-5de9-4140-92e3-6698d0d8eb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:21.660678 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dba6b5-5de9-4140-92e3-6698d0d8eb92 admin admin] PATH_INFO: `/v3/projects/a0ab100267fc4878a257d5563034d247/users/9dbe68d821ce4ec298cde74aaef276ec/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:21.674021 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 891/1791] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:21 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:21.675227 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ca17e-a31f-45a4-bd15-1c3fb2be7467 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:21.708755 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dba6b5-5de9-4140-92e3-6698d0d8eb92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0ab100267fc4878a257d5563034d247, user_id=9dbe68d821ce4ec298cde74aaef276ec, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:21.716047 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dba6b5-5de9-4140-92e3-6698d0d8eb92 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:21.755827 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 901/1792] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:21 2022] PUT /identity/v3/projects/a0ab100267fc4878a257d5563034d247/users/9dbe68d821ce4ec298cde74aaef276ec/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 05:56:21.759998 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dba6b5-5de9-4140-92e3-6698d0d8eb92 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:21.807983 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ca17e-a31f-45a4-bd15-1c3fb2be7467 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:21.887514 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dba6b5-5de9-4140-92e3-6698d0d8eb92 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:21.896769 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b537ddc-b887-42a7-af3a-ab84e45109fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:21.897362 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b537ddc-b887-42a7-af3a-ab84e45109fa admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:21.898678 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b537ddc-b887-42a7-af3a-ab84e45109fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:21.901360 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b537ddc-b887-42a7-af3a-ab84e45109fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:21.902222 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b537ddc-b887-42a7-af3a-ab84e45109fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:21.906779 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b537ddc-b887-42a7-af3a-ab84e45109fa admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:21.937976 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 902/1793] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 05:56:21.942988 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b537ddc-b887-42a7-af3a-ab84e45109fa admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:21.954893 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83154a8-422c-4b79-b4f9-16c68d4e0931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:21.955886 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83154a8-422c-4b79-b4f9-16c68d4e0931 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:21.956196 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83154a8-422c-4b79-b4f9-16c68d4e0931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:21.956556 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83154a8-422c-4b79-b4f9-16c68d4e0931 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:21.957444 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83154a8-422c-4b79-b4f9-16c68d4e0931 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:21.959408 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83154a8-422c-4b79-b4f9-16c68d4e0931 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:21.964338 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b537ddc-b887-42a7-af3a-ab84e45109fa admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:21.979653 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc8699-90a5-4f9c-83ed-d856fb54d282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:21.980532 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc8699-90a5-4f9c-83ed-d856fb54d282 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:21.980817 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc8699-90a5-4f9c-83ed-d856fb54d282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:21.981101 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc8699-90a5-4f9c-83ed-d856fb54d282 admin admin] PATH_INFO: `/v3/projects/a0ab100267fc4878a257d5563034d247/users/9dbe68d821ce4ec298cde74aaef276ec/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:21.983634 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc8699-90a5-4f9c-83ed-d856fb54d282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0ab100267fc4878a257d5563034d247, user_id=9dbe68d821ce4ec298cde74aaef276ec, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:21.988094 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc8699-90a5-4f9c-83ed-d856fb54d282 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:22.008064 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 892/1794] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:21 2022] POST /identity/v3/users => generated 288 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:22.008973 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 903/1795] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:21 2022] PUT /identity/v3/projects/a0ab100267fc4878a257d5563034d247/users/9dbe68d821ce4ec298cde74aaef276ec/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:22.019340 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83154a8-422c-4b79-b4f9-16c68d4e0931 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:22.020140 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddb730-aec3-477d-a2aa-043f89e614f7 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:22.020678 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddb730-aec3-477d-a2aa-043f89e614f7 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:22.020898 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddb730-aec3-477d-a2aa-043f89e614f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:22.030927 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83154a8-422c-4b79-b4f9-16c68d4e0931 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:22.100463 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-bcddb730-aec3-477d-a2aa-043f89e614f7 None None] MFA Rules not processed for user `9dbe68d821ce4ec298cde74aaef276ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:22.107036 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-bcddb730-aec3-477d-a2aa-043f89e614f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:22.195588 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4333e88-b913-41cd-8b34-20eb52933621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:22.196401 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4333e88-b913-41cd-8b34-20eb52933621 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:22.196823 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4333e88-b913-41cd-8b34-20eb52933621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:22.197090 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4333e88-b913-41cd-8b34-20eb52933621 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:22.198001 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4333e88-b913-41cd-8b34-20eb52933621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:22.206116 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4333e88-b913-41cd-8b34-20eb52933621 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:22.233104 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 893/1796] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:22.234653 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4333e88-b913-41cd-8b34-20eb52933621 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:22.258279 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4333e88-b913-41cd-8b34-20eb52933621 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:22.267881 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee4716-e0ee-40fd-a194-b2a4cf1eff08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:22.269771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee4716-e0ee-40fd-a194-b2a4cf1eff08 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:22.271289 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee4716-e0ee-40fd-a194-b2a4cf1eff08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:22.271736 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee4716-e0ee-40fd-a194-b2a4cf1eff08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:22.273326 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee4716-e0ee-40fd-a194-b2a4cf1eff08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:22.277708 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee4716-e0ee-40fd-a194-b2a4cf1eff08 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:22.339489 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 904/1797] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:22.350277 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcddb730-aec3-477d-a2aa-043f89e614f7 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:22.352109 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-bcddb730-aec3-477d-a2aa-043f89e614f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:22.364888 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 894/1798] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:22.365532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee4716-e0ee-40fd-a194-b2a4cf1eff08 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:22.413399 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee4716-e0ee-40fd-a194-b2a4cf1eff08 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:22.452635 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10a1f6-392a-4271-8fda-a097f2067093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:22.453610 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10a1f6-392a-4271-8fda-a097f2067093 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:22.453886 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10a1f6-392a-4271-8fda-a097f2067093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:22.454654 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10a1f6-392a-4271-8fda-a097f2067093 admin admin] PATH_INFO: `/v3/projects/cc5239778fb149fb850adf91ce63839c/users/80814b29111547148e5820e94d13b4c2/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:22.464785 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:22.566832 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10a1f6-392a-4271-8fda-a097f2067093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc5239778fb149fb850adf91ce63839c, user_id=80814b29111547148e5820e94d13b4c2, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:22.574055 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10a1f6-392a-4271-8fda-a097f2067093 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:22.611912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:22.655117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcddb730-aec3-477d-a2aa-043f89e614f7 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:22.670302 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 895/1799] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:22 2022] PUT /identity/v3/projects/cc5239778fb149fb850adf91ce63839c/users/80814b29111547148e5820e94d13b4c2/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:22.671446 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10a1f6-392a-4271-8fda-a097f2067093 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:22.694055 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-fe10a1f6-392a-4271-8fda-a097f2067093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:22.888992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1179b-2019-4a64-acb9-018d61be4bb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:22.890694 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1179b-2019-4a64-acb9-018d61be4bb1 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:22.890982 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1179b-2019-4a64-acb9-018d61be4bb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:22.894853 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1179b-2019-4a64-acb9-018d61be4bb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:22.988113 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10a1f6-392a-4271-8fda-a097f2067093 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:23.006327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85029c91-16d8-4325-ab5a-213e6d99d0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:23.008418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85029c91-16d8-4325-ab5a-213e6d99d0f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:23.010115 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85029c91-16d8-4325-ab5a-213e6d99d0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:23.010409 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85029c91-16d8-4325-ab5a-213e6d99d0f8 admin admin] PATH_INFO: `/v3/users/b9b1e7407f484592a45922687538e543` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:23.015980 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85029c91-16d8-4325-ab5a-213e6d99d0f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9b1e7407f484592a45922687538e543)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:23.024663 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85029c91-16d8-4325-ab5a-213e6d99d0f8 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:23.100868 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb1179b-2019-4a64-acb9-018d61be4bb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:23.111891 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb1179b-2019-4a64-acb9-018d61be4bb1 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:23.150401 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 905/1800] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 801 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 05:56:23.152452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366e64a-aadc-4be6-a7c3-6741aa26e554 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:23.152743 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366e64a-aadc-4be6-a7c3-6741aa26e554 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:23.153043 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366e64a-aadc-4be6-a7c3-6741aa26e554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:23.155338 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-85029c91-16d8-4325-ab5a-213e6d99d0f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9b1e7407f484592a45922687538e543'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:23.156412 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-85029c91-16d8-4325-ab5a-213e6d99d0f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9b1e7407f484592a45922687538e543'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:23.173815 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-85029c91-16d8-4325-ab5a-213e6d99d0f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9b1e7407f484592a45922687538e543'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:23.176387 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-85029c91-16d8-4325-ab5a-213e6d99d0f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9b1e7407f484592a45922687538e543'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:23.210214 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-85029c91-16d8-4325-ab5a-213e6d99d0f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9b1e7407f484592a45922687538e543'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:23.230461 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-8366e64a-aadc-4be6-a7c3-6741aa26e554 None None] MFA Rules not processed for user `80814b29111547148e5820e94d13b4c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:23.233581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8366e64a-aadc-4be6-a7c3-6741aa26e554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:23.247802 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 896/1801] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:56:22 2022] DELETE /identity/v3/users/b9b1e7407f484592a45922687538e543 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:23.247802 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85029c91-16d8-4325-ab5a-213e6d99d0f8 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:23.247802 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-85029c91-16d8-4325-ab5a-213e6d99d0f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:23.424127 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85029c91-16d8-4325-ab5a-213e6d99d0f8 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:23.439041 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d749c-0b1c-46d2-bb52-9e797ae48b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:23.439984 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d749c-0b1c-46d2-bb52-9e797ae48b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:23.440391 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d749c-0b1c-46d2-bb52-9e797ae48b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:23.440679 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d749c-0b1c-46d2-bb52-9e797ae48b2b admin admin] PATH_INFO: `/v3/users/9d5045ae1042497baaf54a37fbaea084` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:23.442636 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d749c-0b1c-46d2-bb52-9e797ae48b2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d5045ae1042497baaf54a37fbaea084)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:23.452221 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d749c-0b1c-46d2-bb52-9e797ae48b2b admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:23.457446 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 906/1802] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:23.457446 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3652c64-acb4-4f08-af69-a2ad817cfbfd None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:23.458041 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3652c64-acb4-4f08-af69-a2ad817cfbfd None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:23.458041 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3652c64-acb4-4f08-af69-a2ad817cfbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:23.458569 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:23.543353 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-c3652c64-acb4-4f08-af69-a2ad817cfbfd None None] MFA Rules not processed for user `5e5be3de52e945d3af1b2cad1c84c755`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:23.544920 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c3652c64-acb4-4f08-af69-a2ad817cfbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:23.629635 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-b48d749c-0b1c-46d2-bb52-9e797ae48b2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d5045ae1042497baaf54a37fbaea084'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:23.632177 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-b48d749c-0b1c-46d2-bb52-9e797ae48b2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d5045ae1042497baaf54a37fbaea084'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:23.656253 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-b48d749c-0b1c-46d2-bb52-9e797ae48b2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d5045ae1042497baaf54a37fbaea084'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:23.657812 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-b48d749c-0b1c-46d2-bb52-9e797ae48b2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d5045ae1042497baaf54a37fbaea084'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:23.716879 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-b48d749c-0b1c-46d2-bb52-9e797ae48b2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d5045ae1042497baaf54a37fbaea084'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:23.720317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:23.763982 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 897/1803] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:56:23 2022] DELETE /identity/v3/users/9d5045ae1042497baaf54a37fbaea084 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:23.769418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d749c-0b1c-46d2-bb52-9e797ae48b2b admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:23.772889 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b48d749c-0b1c-46d2-bb52-9e797ae48b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:23.821899 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 907/1804] 10.222.0.70 () {58 vars in 1015 bytes} [Mon Jul 4 05:56:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:23.830312 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ce6f5-22a4-48bc-8def-49bc88dcf0e4 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:23.830615 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ce6f5-22a4-48bc-8def-49bc88dcf0e4 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:23.830920 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ce6f5-22a4-48bc-8def-49bc88dcf0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:23.923988 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-0b2ce6f5-22a4-48bc-8def-49bc88dcf0e4 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:23.931920 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0b2ce6f5-22a4-48bc-8def-49bc88dcf0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:24.126850 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d749c-0b1c-46d2-bb52-9e797ae48b2b admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:24.142685 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da23c7a-5c1a-4a84-b4bc-b9fec314d5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:24.148015 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da23c7a-5c1a-4a84-b4bc-b9fec314d5c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:24.149072 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da23c7a-5c1a-4a84-b4bc-b9fec314d5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:24.150147 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da23c7a-5c1a-4a84-b4bc-b9fec314d5c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:24.155251 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da23c7a-5c1a-4a84-b4bc-b9fec314d5c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:24.162789 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da23c7a-5c1a-4a84-b4bc-b9fec314d5c0 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:24.273618 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 898/1805] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:23 2022] POST /identity/v3/projects => generated 375 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:24.280216 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da23c7a-5c1a-4a84-b4bc-b9fec314d5c0 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:24.284259 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-3da23c7a-5c1a-4a84-b4bc-b9fec314d5c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:24.289746 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 908/1806] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:24.301998 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ce6f5-22a4-48bc-8def-49bc88dcf0e4 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:24.334401 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ce6f5-22a4-48bc-8def-49bc88dcf0e4 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:24.468154 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1865b-fc96-4213-9b4c-e1c02365d389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:24.468858 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1865b-fc96-4213-9b4c-e1c02365d389 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:24.475893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1865b-fc96-4213-9b4c-e1c02365d389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:24.475893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1865b-fc96-4213-9b4c-e1c02365d389 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:24.475893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1865b-fc96-4213-9b4c-e1c02365d389 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:24.475893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1865b-fc96-4213-9b4c-e1c02365d389 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:24.517599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da23c7a-5c1a-4a84-b4bc-b9fec314d5c0 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:24.534089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177b98a-b0d2-4995-bdad-30f19c0e2b61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:24.534788 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177b98a-b0d2-4995-bdad-30f19c0e2b61 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:24.545621 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177b98a-b0d2-4995-bdad-30f19c0e2b61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:24.545890 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177b98a-b0d2-4995-bdad-30f19c0e2b61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:24.575719 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 909/1807] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:24 2022] POST /identity/v3/users => generated 294 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:24.578035 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177b98a-b0d2-4995-bdad-30f19c0e2b61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:24.578558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1865b-fc96-4213-9b4c-e1c02365d389 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:24.584826 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177b98a-b0d2-4995-bdad-30f19c0e2b61 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:24.589577 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-cca1865b-fc96-4213-9b4c-e1c02365d389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:24.614714 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 899/1808] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:24.623740 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177b98a-b0d2-4995-bdad-30f19c0e2b61 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:24.627233 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1865b-fc96-4213-9b4c-e1c02365d389 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:24.653115 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177b98a-b0d2-4995-bdad-30f19c0e2b61 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:24.664681 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631d6db-7e4e-4743-9da8-3feb4379051c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:24.668313 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631d6db-7e4e-4743-9da8-3feb4379051c service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:24.668621 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631d6db-7e4e-4743-9da8-3feb4379051c service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:24.668900 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631d6db-7e4e-4743-9da8-3feb4379051c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:24.669505 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a7ca8-675a-4ac4-8eb4-e40499bb10e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:24.672603 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a7ca8-675a-4ac4-8eb4-e40499bb10e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:24.673107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a7ca8-675a-4ac4-8eb4-e40499bb10e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:24.673589 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a7ca8-675a-4ac4-8eb4-e40499bb10e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:24.681681 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a7ca8-675a-4ac4-8eb4-e40499bb10e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:24.689672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a7ca8-675a-4ac4-8eb4-e40499bb10e8 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:24.703162 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:24.737875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4631d6db-7e4e-4743-9da8-3feb4379051c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:24.738056 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 900/1809] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:24.739727 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a7ca8-675a-4ac4-8eb4-e40499bb10e8 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:24.743658 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4631d6db-7e4e-4743-9da8-3feb4379051c service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:24.750339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f00a7ca8-675a-4ac4-8eb4-e40499bb10e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:24.839080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 910/1810] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:24.840019 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631d6db-7e4e-4743-9da8-3feb4379051c service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:24.898784 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631d6db-7e4e-4743-9da8-3feb4379051c service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:24.937327 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c8924-dcf3-4c6c-8c1b-d41099f8e29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:24.941678 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c8924-dcf3-4c6c-8c1b-d41099f8e29d admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:24.943135 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c8924-dcf3-4c6c-8c1b-d41099f8e29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:24.946138 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c8924-dcf3-4c6c-8c1b-d41099f8e29d admin admin] PATH_INFO: `/v3/projects/2e60bd4a2caf4c1da184b0d216d379ba/users/c767378588bb4ee6a172f69b3101e073/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:24.993610 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a7ca8-675a-4ac4-8eb4-e40499bb10e8 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:25.004426 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfec53-fc35-4111-90fc-2776d61804af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:25.005123 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfec53-fc35-4111-90fc-2776d61804af service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:25.005938 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfec53-fc35-4111-90fc-2776d61804af service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:25.005938 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfec53-fc35-4111-90fc-2776d61804af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:25.013625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-90bfec53-fc35-4111-90fc-2776d61804af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:25.065673 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318c8924-dcf3-4c6c-8c1b-d41099f8e29d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e60bd4a2caf4c1da184b0d216d379ba, user_id=c767378588bb4ee6a172f69b3101e073, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:25.080123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318c8924-dcf3-4c6c-8c1b-d41099f8e29d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:25.134663 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 911/1811] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:24 2022] PUT /identity/v3/projects/2e60bd4a2caf4c1da184b0d216d379ba/users/c767378588bb4ee6a172f69b3101e073/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:25.140647 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce36d4-5ba2-44fb-80e7-c28538d3b23e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:25.140936 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce36d4-5ba2-44fb-80e7-c28538d3b23e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:25.141214 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce36d4-5ba2-44fb-80e7-c28538d3b23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:25.219722 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-40ce36d4-5ba2-44fb-80e7-c28538d3b23e None None] MFA Rules not processed for user `75f4eab7b971447bbe964e79fa6bf3c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:25.223426 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-40ce36d4-5ba2-44fb-80e7-c28538d3b23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:25.282756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bfec53-fc35-4111-90fc-2776d61804af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:25.285920 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bfec53-fc35-4111-90fc-2776d61804af service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:25.320954 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 901/1812] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:25.325991 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfec53-fc35-4111-90fc-2776d61804af service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:25.329213 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-90bfec53-fc35-4111-90fc-2776d61804af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:25.341801 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:25.395306 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfec53-fc35-4111-90fc-2776d61804af service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:25.407971 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 912/1813] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:25.417116 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce36d4-5ba2-44fb-80e7-c28538d3b23e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:25.587782 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e744c-d168-456f-87f3-d559b398baca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:25.588835 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e744c-d168-456f-87f3-d559b398baca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:25.589576 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e744c-d168-456f-87f3-d559b398baca admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:25.589576 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e744c-d168-456f-87f3-d559b398baca admin admin] PATH_INFO: `/v3/projects/d975fc0adf754464b4c237b5499982db` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:25.592360 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e744c-d168-456f-87f3-d559b398baca admin admin] RBAC: Authorizing `identity:delete_project(project_id=d975fc0adf754464b4c237b5499982db)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:25.596244 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e744c-d168-456f-87f3-d559b398baca admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:25.607936 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce36d4-5ba2-44fb-80e7-c28538d3b23e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:25.615089 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be28a6-f097-4bae-9bf1-5795f97f1ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:25.616235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be28a6-f097-4bae-9bf1-5795f97f1ffe admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:25.616738 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be28a6-f097-4bae-9bf1-5795f97f1ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:25.617205 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be28a6-f097-4bae-9bf1-5795f97f1ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:25.618217 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be28a6-f097-4bae-9bf1-5795f97f1ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:25.620206 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be28a6-f097-4bae-9bf1-5795f97f1ffe admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:25.635000 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 913/1814] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:25.638875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be28a6-f097-4bae-9bf1-5795f97f1ffe admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:25.658971 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be28a6-f097-4bae-9bf1-5795f97f1ffe admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:25.670745 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6b367-45de-46cb-b181-2d6050b5e4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:25.673935 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6b367-45de-46cb-b181-2d6050b5e4e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:25.674588 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6b367-45de-46cb-b181-2d6050b5e4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:25.675816 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6b367-45de-46cb-b181-2d6050b5e4e2 admin admin] PATH_INFO: `/v3/projects/2e60bd4a2caf4c1da184b0d216d379ba/users/c767378588bb4ee6a172f69b3101e073/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:25.680486 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6b367-45de-46cb-b181-2d6050b5e4e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e60bd4a2caf4c1da184b0d216d379ba, user_id=c767378588bb4ee6a172f69b3101e073, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:25.684077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6b367-45de-46cb-b181-2d6050b5e4e2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:25.704019 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 914/1815] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:25 2022] PUT /identity/v3/projects/2e60bd4a2caf4c1da184b0d216d379ba/users/c767378588bb4ee6a172f69b3101e073/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:25.715844 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e85ed-760b-4d91-a644-8aad31e35b48 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:25.716470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e85ed-760b-4d91-a644-8aad31e35b48 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:25.717165 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e85ed-760b-4d91-a644-8aad31e35b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:25.751329 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7a9e744c-d168-456f-87f3-d559b398baca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd975fc0adf754464b4c237b5499982db', 'request_id': 'req-7a9e744c-d168-456f-87f3-d559b398baca'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:25.764106 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:25.776411 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7a9e744c-d168-456f-87f3-d559b398baca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd975fc0adf754464b4c237b5499982db', 'request_id': 'req-7a9e744c-d168-456f-87f3-d559b398baca'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:25.786817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7a9e744c-d168-456f-87f3-d559b398baca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd975fc0adf754464b4c237b5499982db', 'request_id': 'req-7a9e744c-d168-456f-87f3-d559b398baca'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:25.805524 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7a9e744c-d168-456f-87f3-d559b398baca admin admin] The token cache is being invalidate because project d975fc0adf754464b4c237b5499982db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:56:25.806222 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7a9e744c-d168-456f-87f3-d559b398baca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:25.807173 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7a9e744c-d168-456f-87f3-d559b398baca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:25.809814 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 902/1816] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:56:25 2022] DELETE /identity/v3/projects/d975fc0adf754464b4c237b5499982db => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:25.813453 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e744c-d168-456f-87f3-d559b398baca admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:25.815564 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-7a9e744c-d168-456f-87f3-d559b398baca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:25.839905 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-b12e85ed-760b-4d91-a644-8aad31e35b48 None None] MFA Rules not processed for user `c767378588bb4ee6a172f69b3101e073`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:25.849713 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b12e85ed-760b-4d91-a644-8aad31e35b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:25.997094 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e744c-d168-456f-87f3-d559b398baca admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:26.003391 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65bf1a4-a663-4de7-9e7b-e685af4f67cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:26.004683 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bf1a4-a663-4de7-9e7b-e685af4f67cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:26.005364 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bf1a4-a663-4de7-9e7b-e685af4f67cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:26.006688 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bf1a4-a663-4de7-9e7b-e685af4f67cc admin admin] PATH_INFO: `/v3/users/c90671c44ec2411790441a070c4b6e05` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:26.041143 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65bf1a4-a663-4de7-9e7b-e685af4f67cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c90671c44ec2411790441a070c4b6e05)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:26.051030 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65bf1a4-a663-4de7-9e7b-e685af4f67cc admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:26.102274 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 915/1817] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:25 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:26.114438 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e85ed-760b-4d91-a644-8aad31e35b48 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:26.117414 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b12e85ed-760b-4d91-a644-8aad31e35b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:26.182076 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-b65bf1a4-a663-4de7-9e7b-e685af4f67cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c90671c44ec2411790441a070c4b6e05'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:26.183132 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-b65bf1a4-a663-4de7-9e7b-e685af4f67cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c90671c44ec2411790441a070c4b6e05'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:26.241146 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-b65bf1a4-a663-4de7-9e7b-e685af4f67cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c90671c44ec2411790441a070c4b6e05'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:26.246245 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-b65bf1a4-a663-4de7-9e7b-e685af4f67cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c90671c44ec2411790441a070c4b6e05'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:26.273206 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e85ed-760b-4d91-a644-8aad31e35b48 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:26.275734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-b65bf1a4-a663-4de7-9e7b-e685af4f67cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c90671c44ec2411790441a070c4b6e05'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:26.284809 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b3a02-bd22-42a3-ab9f-84c240ecf2a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:26.287243 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b3a02-bd22-42a3-ab9f-84c240ecf2a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:26.287784 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b3a02-bd22-42a3-ab9f-84c240ecf2a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:26.288201 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b3a02-bd22-42a3-ab9f-84c240ecf2a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:26.293115 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e32b3a02-bd22-42a3-ab9f-84c240ecf2a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:26.311321 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:26.319683 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 903/1818] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:56:25 2022] DELETE /identity/v3/users/c90671c44ec2411790441a070c4b6e05 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:26.534544 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b3a02-bd22-42a3-ab9f-84c240ecf2a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:26.542591 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b3a02-bd22-42a3-ab9f-84c240ecf2a5 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:26.573999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 916/1819] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 05:56:27.587891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65bf1a4-a663-4de7-9e7b-e685af4f67cc admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:27.589946 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b65bf1a4-a663-4de7-9e7b-e685af4f67cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:27.765262 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65bf1a4-a663-4de7-9e7b-e685af4f67cc admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:27.772988 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93521f1-95ff-44ff-87a6-0b9ad38d6c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:27.773891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93521f1-95ff-44ff-87a6-0b9ad38d6c55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:27.774685 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93521f1-95ff-44ff-87a6-0b9ad38d6c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:27.774685 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93521f1-95ff-44ff-87a6-0b9ad38d6c55 admin admin] PATH_INFO: `/v3/projects/efaded9775be46b7b0aaaea24b88ad48` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:27.775752 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93521f1-95ff-44ff-87a6-0b9ad38d6c55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efaded9775be46b7b0aaaea24b88ad48)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:27.777728 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93521f1-95ff-44ff-87a6-0b9ad38d6c55 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:27.801486 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:27.890402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c93521f1-95ff-44ff-87a6-0b9ad38d6c55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efaded9775be46b7b0aaaea24b88ad48', 'request_id': 'req-c93521f1-95ff-44ff-87a6-0b9ad38d6c55'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:27.907879 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c93521f1-95ff-44ff-87a6-0b9ad38d6c55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efaded9775be46b7b0aaaea24b88ad48', 'request_id': 'req-c93521f1-95ff-44ff-87a6-0b9ad38d6c55'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:27.915863 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c93521f1-95ff-44ff-87a6-0b9ad38d6c55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efaded9775be46b7b0aaaea24b88ad48', 'request_id': 'req-c93521f1-95ff-44ff-87a6-0b9ad38d6c55'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:27.937574 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c93521f1-95ff-44ff-87a6-0b9ad38d6c55 admin admin] The token cache is being invalidate because project efaded9775be46b7b0aaaea24b88ad48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:56:27.937574 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c93521f1-95ff-44ff-87a6-0b9ad38d6c55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:27.947713 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c93521f1-95ff-44ff-87a6-0b9ad38d6c55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:27.949683 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 904/1820] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:56:27 2022] DELETE /identity/v3/projects/efaded9775be46b7b0aaaea24b88ad48 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:27.953594 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b3a02-bd22-42a3-ab9f-84c240ecf2a5 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:27.985119 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b3a02-bd22-42a3-ab9f-84c240ecf2a5 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:28.288534 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398049db-2872-42f7-b186-378220f447c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:28.289296 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398049db-2872-42f7-b186-378220f447c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:28.289582 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398049db-2872-42f7-b186-378220f447c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:28.289858 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398049db-2872-42f7-b186-378220f447c8 admin admin] PATH_INFO: `/v3/users/f7dc031d24a442af92f2436fc3b3bd87` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:28.294916 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398049db-2872-42f7-b186-378220f447c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7dc031d24a442af92f2436fc3b3bd87)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:28.296963 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398049db-2872-42f7-b186-378220f447c8 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:28.420697 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-398049db-2872-42f7-b186-378220f447c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7dc031d24a442af92f2436fc3b3bd87'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:28.437724 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-398049db-2872-42f7-b186-378220f447c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7dc031d24a442af92f2436fc3b3bd87'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:28.470345 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-398049db-2872-42f7-b186-378220f447c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7dc031d24a442af92f2436fc3b3bd87'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:28.470978 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-398049db-2872-42f7-b186-378220f447c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7dc031d24a442af92f2436fc3b3bd87'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:28.510712 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-398049db-2872-42f7-b186-378220f447c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7dc031d24a442af92f2436fc3b3bd87'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:28.531336 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 917/1821] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:56:27 2022] DELETE /identity/v3/users/f7dc031d24a442af92f2436fc3b3bd87 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:29.202662 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93521f1-95ff-44ff-87a6-0b9ad38d6c55 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:29.204155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c93521f1-95ff-44ff-87a6-0b9ad38d6c55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:29.241317 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93521f1-95ff-44ff-87a6-0b9ad38d6c55 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:29.472565 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4acaa-7311-4b98-8279-58e41abbf9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:29.473696 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4acaa-7311-4b98-8279-58e41abbf9d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:29.474155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4acaa-7311-4b98-8279-58e41abbf9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:29.474779 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4acaa-7311-4b98-8279-58e41abbf9d0 admin admin] PATH_INFO: `/v3/projects/fde6c89a834f4c96a817983e066c0478` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:29.476699 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf4acaa-7311-4b98-8279-58e41abbf9d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fde6c89a834f4c96a817983e066c0478)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:29.478862 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf4acaa-7311-4b98-8279-58e41abbf9d0 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:29.629248 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fdf4acaa-7311-4b98-8279-58e41abbf9d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fde6c89a834f4c96a817983e066c0478', 'request_id': 'req-fdf4acaa-7311-4b98-8279-58e41abbf9d0'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:29.649720 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fdf4acaa-7311-4b98-8279-58e41abbf9d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fde6c89a834f4c96a817983e066c0478', 'request_id': 'req-fdf4acaa-7311-4b98-8279-58e41abbf9d0'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:29.658097 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fdf4acaa-7311-4b98-8279-58e41abbf9d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fde6c89a834f4c96a817983e066c0478', 'request_id': 'req-fdf4acaa-7311-4b98-8279-58e41abbf9d0'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:29.672440 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fdf4acaa-7311-4b98-8279-58e41abbf9d0 admin admin] The token cache is being invalidate because project fde6c89a834f4c96a817983e066c0478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:56:29.672984 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fdf4acaa-7311-4b98-8279-58e41abbf9d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:29.673828 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fdf4acaa-7311-4b98-8279-58e41abbf9d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:29.679410 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 905/1822] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:56:29 2022] DELETE /identity/v3/projects/fde6c89a834f4c96a817983e066c0478 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:29.681079 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637f23b-7791-4bbb-adff-f200d94ac3d1 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:29.682192 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637f23b-7791-4bbb-adff-f200d94ac3d1 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:29.682869 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637f23b-7791-4bbb-adff-f200d94ac3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:29.719224 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6637f23b-7791-4bbb-adff-f200d94ac3d1 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:29.721806 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6637f23b-7791-4bbb-adff-f200d94ac3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:29.780683 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:29.873236 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 918/1823] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:29.881231 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ba1ca-7a29-47c0-85a5-2b737938609d None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:29.881527 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ba1ca-7a29-47c0-85a5-2b737938609d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:29.881803 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ba1ca-7a29-47c0-85a5-2b737938609d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:29.935008 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-469ba1ca-7a29-47c0-85a5-2b737938609d None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:29.936737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-469ba1ca-7a29-47c0-85a5-2b737938609d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:29.949452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 906/1824] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:56:29.954353 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637f23b-7791-4bbb-adff-f200d94ac3d1 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:29.966636 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637f23b-7791-4bbb-adff-f200d94ac3d1 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:29.973621 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9532cea-b440-47f3-9b31-9d5a17bc52e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:29.974840 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9532cea-b440-47f3-9b31-9d5a17bc52e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:29.985848 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ba1ca-7a29-47c0-85a5-2b737938609d None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:29.987993 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-469ba1ca-7a29-47c0-85a5-2b737938609d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:29.994913 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9532cea-b440-47f3-9b31-9d5a17bc52e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:29.997483 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9532cea-b440-47f3-9b31-9d5a17bc52e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:30.000475 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9532cea-b440-47f3-9b31-9d5a17bc52e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:56:30.003330 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9532cea-b440-47f3-9b31-9d5a17bc52e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:30.007218 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9532cea-b440-47f3-9b31-9d5a17bc52e2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:30.034336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:30.048887 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 919/1825] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:56:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:56:30.053970 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9532cea-b440-47f3-9b31-9d5a17bc52e2 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:30.084732 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9532cea-b440-47f3-9b31-9d5a17bc52e2 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:30.109386 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2358949-2531-444d-95df-c746ef0fe8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:30.110215 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2358949-2531-444d-95df-c746ef0fe8c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:30.110499 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2358949-2531-444d-95df-c746ef0fe8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:30.110845 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2358949-2531-444d-95df-c746ef0fe8c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:30.112190 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2358949-2531-444d-95df-c746ef0fe8c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:30.114755 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2358949-2531-444d-95df-c746ef0fe8c9 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:30.137808 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ba1ca-7a29-47c0-85a5-2b737938609d None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:30.152717 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c643587-b6b3-494a-8146-db609fa2645f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:30.153936 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c643587-b6b3-494a-8146-db609fa2645f service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:30.154648 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c643587-b6b3-494a-8146-db609fa2645f service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:30.158864 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c643587-b6b3-494a-8146-db609fa2645f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:30.162813 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-7c643587-b6b3-494a-8146-db609fa2645f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:30.179441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 920/1826] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:30 2022] POST /identity/v3/projects => generated 365 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:30.181948 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2358949-2531-444d-95df-c746ef0fe8c9 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:30.342989 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c643587-b6b3-494a-8146-db609fa2645f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:30.347217 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c643587-b6b3-494a-8146-db609fa2645f service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:30.371707 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2358949-2531-444d-95df-c746ef0fe8c9 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:30.378441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4648e48-ecaf-4c9a-b374-2f347887e240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:30.380706 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4648e48-ecaf-4c9a-b374-2f347887e240 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:30.383789 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 907/1827] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:29 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 05:56:30.391533 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4648e48-ecaf-4c9a-b374-2f347887e240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:30.395707 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4648e48-ecaf-4c9a-b374-2f347887e240 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:30.396832 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4648e48-ecaf-4c9a-b374-2f347887e240 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:30.399037 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4648e48-ecaf-4c9a-b374-2f347887e240 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:30.441860 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 921/1828] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:30 2022] POST /identity/v3/users => generated 283 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:30.446056 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c643587-b6b3-494a-8146-db609fa2645f service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:30.464366 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c643587-b6b3-494a-8146-db609fa2645f service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:30.477066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb46971-6be5-41f3-9d83-44f22a9431f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:30.478897 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb46971-6be5-41f3-9d83-44f22a9431f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:30.479206 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb46971-6be5-41f3-9d83-44f22a9431f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:30.479512 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb46971-6be5-41f3-9d83-44f22a9431f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:30.480223 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb46971-6be5-41f3-9d83-44f22a9431f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:30.490083 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb46971-6be5-41f3-9d83-44f22a9431f5 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:30.529460 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 908/1829] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:30.532639 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4648e48-ecaf-4c9a-b374-2f347887e240 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:30.544074 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4648e48-ecaf-4c9a-b374-2f347887e240 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:30.561505 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf0f2b-0fe0-41e3-89b0-09682ad7c753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:30.562563 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf0f2b-0fe0-41e3-89b0-09682ad7c753 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:30.562985 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf0f2b-0fe0-41e3-89b0-09682ad7c753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:30.564528 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf0f2b-0fe0-41e3-89b0-09682ad7c753 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:30.566225 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf0f2b-0fe0-41e3-89b0-09682ad7c753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:30.572912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf0f2b-0fe0-41e3-89b0-09682ad7c753 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:30.603447 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 922/1830] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:30.604241 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb46971-6be5-41f3-9d83-44f22a9431f5 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:30.619066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb46971-6be5-41f3-9d83-44f22a9431f5 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:30.631224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c284848-aa61-42df-bc81-5492625b555b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:30.632784 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c284848-aa61-42df-bc81-5492625b555b admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:30.633790 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c284848-aa61-42df-bc81-5492625b555b admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:30.636319 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c284848-aa61-42df-bc81-5492625b555b admin admin] PATH_INFO: `/v3/projects/5188705e22434d9e97cc2a89e4645d8e/users/3b7d095220d5490abb2f2445dbab7970/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:30.689945 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c284848-aa61-42df-bc81-5492625b555b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5188705e22434d9e97cc2a89e4645d8e, user_id=3b7d095220d5490abb2f2445dbab7970, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:30.701541 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c284848-aa61-42df-bc81-5492625b555b admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:30.761041 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 909/1831] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:30 2022] PUT /identity/v3/projects/5188705e22434d9e97cc2a89e4645d8e/users/3b7d095220d5490abb2f2445dbab7970/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:30.775043 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec4e57-a808-48b7-9ffb-1176d9820df1 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:30.775580 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec4e57-a808-48b7-9ffb-1176d9820df1 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:30.775668 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec4e57-a808-48b7-9ffb-1176d9820df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:30.832166 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-54ec4e57-a808-48b7-9ffb-1176d9820df1 None None] MFA Rules not processed for user `3b7d095220d5490abb2f2445dbab7970`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:30.834884 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-54ec4e57-a808-48b7-9ffb-1176d9820df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:30.846807 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a12c25-a401-4d06-818d-172a9da4102a None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:30.847097 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a12c25-a401-4d06-818d-172a9da4102a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:30.847461 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a12c25-a401-4d06-818d-172a9da4102a None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:30.849142 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 910/1832] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jul 4 05:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:56:30.878434 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc5f4f-e67a-4555-a378-e86c9fe6d803 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:30.878725 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc5f4f-e67a-4555-a378-e86c9fe6d803 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:30.879008 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc5f4f-e67a-4555-a378-e86c9fe6d803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:30.936494 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-bbfc5f4f-e67a-4555-a378-e86c9fe6d803 None None] MFA Rules not processed for user `6f638cc70c994a529a48cb2c92b70384`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:30.937741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-bbfc5f4f-e67a-4555-a378-e86c9fe6d803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:30.992196 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:31.018182 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 923/1833] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:30 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:31.020510 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec4e57-a808-48b7-9ffb-1176d9820df1 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:31.155026 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec4e57-a808-48b7-9ffb-1176d9820df1 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:31.161385 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa298b-3c3d-46a7-a0b3-5ccf5c47a00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:31.162375 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa298b-3c3d-46a7-a0b3-5ccf5c47a00e admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:31.162806 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa298b-3c3d-46a7-a0b3-5ccf5c47a00e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:31.163338 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa298b-3c3d-46a7-a0b3-5ccf5c47a00e admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:31.164312 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa298b-3c3d-46a7-a0b3-5ccf5c47a00e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:31.167400 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa298b-3c3d-46a7-a0b3-5ccf5c47a00e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:31.220382 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 924/1834] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:31 2022] POST /identity/v3/projects => generated 365 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:31.222895 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa298b-3c3d-46a7-a0b3-5ccf5c47a00e admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:31.331604 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa298b-3c3d-46a7-a0b3-5ccf5c47a00e admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:31.332868 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 911/1835] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jul 4 05:56:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:56:31.337181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca153e-177f-42ec-a242-f30dd53d672c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:31.338185 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca153e-177f-42ec-a242-f30dd53d672c admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:31.338468 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca153e-177f-42ec-a242-f30dd53d672c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:31.338749 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca153e-177f-42ec-a242-f30dd53d672c admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:31.340024 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca153e-177f-42ec-a242-f30dd53d672c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:31.341997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca153e-177f-42ec-a242-f30dd53d672c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:31.380511 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc5f4f-e67a-4555-a378-e86c9fe6d803 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:31.381031 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 925/1836] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:31 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:31.437163 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca153e-177f-42ec-a242-f30dd53d672c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:31.438140 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc5f4f-e67a-4555-a378-e86c9fe6d803 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:31.438879 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b7ca153e-177f-42ec-a242-f30dd53d672c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:31.466135 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5785a-f85d-4c81-b76e-c5d0839e7ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:31.471406 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5785a-f85d-4c81-b76e-c5d0839e7ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:31.473086 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5785a-f85d-4c81-b76e-c5d0839e7ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:31.474062 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5785a-f85d-4c81-b76e-c5d0839e7ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:31.479948 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc5785a-f85d-4c81-b76e-c5d0839e7ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:31.483697 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc5785a-f85d-4c81-b76e-c5d0839e7ef1 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:31.517809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 912/1837] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 05:56:31.522705 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5785a-f85d-4c81-b76e-c5d0839e7ef1 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:31.571978 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5785a-f85d-4c81-b76e-c5d0839e7ef1 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:31.579463 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63796c39-f90e-40dc-8276-bfd54acfb4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:31.580413 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63796c39-f90e-40dc-8276-bfd54acfb4a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:31.580785 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63796c39-f90e-40dc-8276-bfd54acfb4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:31.581056 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63796c39-f90e-40dc-8276-bfd54acfb4a1 admin admin] PATH_INFO: `/v3/projects/e5d52463b0214aae9056115a4a562bec/users/ff672b0cbecd4f019657144e191f5e96/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:31.599940 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:31.603537 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca153e-177f-42ec-a242-f30dd53d672c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:31.616639 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63796c39-f90e-40dc-8276-bfd54acfb4a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5d52463b0214aae9056115a4a562bec, user_id=ff672b0cbecd4f019657144e191f5e96, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:31.617518 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86f805-0527-4e37-a053-ca894daeef87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:31.620000 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86f805-0527-4e37-a053-ca894daeef87 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:31.620439 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86f805-0527-4e37-a053-ca894daeef87 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:31.620744 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63796c39-f90e-40dc-8276-bfd54acfb4a1 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:31.621171 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86f805-0527-4e37-a053-ca894daeef87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:31.624759 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fc86f805-0527-4e37-a053-ca894daeef87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:31.709134 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:31.710274 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 913/1838] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:31 2022] PUT /identity/v3/projects/e5d52463b0214aae9056115a4a562bec/users/ff672b0cbecd4f019657144e191f5e96/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:31.715174 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63796c39-f90e-40dc-8276-bfd54acfb4a1 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:31.777429 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86f805-0527-4e37-a053-ca894daeef87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:31.778318 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86f805-0527-4e37-a053-ca894daeef87 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:31.799607 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 926/1839] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 05:56:31.941490 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63796c39-f90e-40dc-8276-bfd54acfb4a1 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:31.953242 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba9e53-2d1d-432b-beb5-2304115a9a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:31.955493 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba9e53-2d1d-432b-beb5-2304115a9a53 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:31.956352 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba9e53-2d1d-432b-beb5-2304115a9a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:31.957361 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba9e53-2d1d-432b-beb5-2304115a9a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:31.960461 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba9e53-2d1d-432b-beb5-2304115a9a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:31.965541 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba9e53-2d1d-432b-beb5-2304115a9a53 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:32.025865 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86f805-0527-4e37-a053-ca894daeef87 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:32.026173 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 914/1840] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:32.045485 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba9e53-2d1d-432b-beb5-2304115a9a53 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:32.049834 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-adba9e53-2d1d-432b-beb5-2304115a9a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:32.054247 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86f805-0527-4e37-a053-ca894daeef87 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:32.086095 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e09bb-cf61-486c-b8cc-33183ba9352f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:32.087093 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e09bb-cf61-486c-b8cc-33183ba9352f admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:32.087402 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e09bb-cf61-486c-b8cc-33183ba9352f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:32.087675 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e09bb-cf61-486c-b8cc-33183ba9352f admin admin] PATH_INFO: `/v3/projects/e5d52463b0214aae9056115a4a562bec/users/ff672b0cbecd4f019657144e191f5e96/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:32.091003 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e09bb-cf61-486c-b8cc-33183ba9352f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5d52463b0214aae9056115a4a562bec, user_id=ff672b0cbecd4f019657144e191f5e96, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:32.093708 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e09bb-cf61-486c-b8cc-33183ba9352f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:32.156352 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 927/1841] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:32 2022] PUT /identity/v3/projects/e5d52463b0214aae9056115a4a562bec/users/ff672b0cbecd4f019657144e191f5e96/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 05:56:32.157367 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e09bb-cf61-486c-b8cc-33183ba9352f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:32.172362 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7e7e09bb-cf61-486c-b8cc-33183ba9352f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:32.318838 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba9e53-2d1d-432b-beb5-2304115a9a53 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:32.381904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e09bb-cf61-486c-b8cc-33183ba9352f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:32.394857 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a502b-5f57-4241-9309-3c85a65917f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:32.394857 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a502b-5f57-4241-9309-3c85a65917f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:32.394857 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a502b-5f57-4241-9309-3c85a65917f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:32.395252 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a502b-5f57-4241-9309-3c85a65917f4 admin admin] PATH_INFO: `/v3/projects/37202c8f23334be18f2e516079afa849` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:32.399369 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a502b-5f57-4241-9309-3c85a65917f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37202c8f23334be18f2e516079afa849)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:32.401350 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a502b-5f57-4241-9309-3c85a65917f4 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:32.490318 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a8d1c-554f-45d5-8360-f7b20b17b5fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:32.491027 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a8d1c-554f-45d5-8360-f7b20b17b5fb service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:32.491806 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a8d1c-554f-45d5-8360-f7b20b17b5fb service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:32.492277 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a8d1c-554f-45d5-8360-f7b20b17b5fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:32.507532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a8d1c-554f-45d5-8360-f7b20b17b5fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:32.510329 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a8d1c-554f-45d5-8360-f7b20b17b5fb service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:32.555143 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 915/1842] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:32.562880 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c124f33-b32c-4f39-9f14-d7a072caaf1c None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:32.564608 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c124f33-b32c-4f39-9f14-d7a072caaf1c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:32.566001 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c124f33-b32c-4f39-9f14-d7a072caaf1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:32.591029 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a10a502b-5f57-4241-9309-3c85a65917f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37202c8f23334be18f2e516079afa849', 'request_id': 'req-a10a502b-5f57-4241-9309-3c85a65917f4'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:32.623430 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a10a502b-5f57-4241-9309-3c85a65917f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37202c8f23334be18f2e516079afa849', 'request_id': 'req-a10a502b-5f57-4241-9309-3c85a65917f4'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:32.630883 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:32.660581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a10a502b-5f57-4241-9309-3c85a65917f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37202c8f23334be18f2e516079afa849', 'request_id': 'req-a10a502b-5f57-4241-9309-3c85a65917f4'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:32.706641 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a10a502b-5f57-4241-9309-3c85a65917f4 admin admin] The token cache is being invalidate because project 37202c8f23334be18f2e516079afa849 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:56:32.707612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a10a502b-5f57-4241-9309-3c85a65917f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:32.709390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a10a502b-5f57-4241-9309-3c85a65917f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:32.710044 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-6c124f33-b32c-4f39-9f14-d7a072caaf1c None None] MFA Rules not processed for user `ff672b0cbecd4f019657144e191f5e96`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:32.711331 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-6c124f33-b32c-4f39-9f14-d7a072caaf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:32.712137 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 928/1843] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:56:32 2022] DELETE /identity/v3/projects/37202c8f23334be18f2e516079afa849 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:32.717990 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a502b-5f57-4241-9309-3c85a65917f4 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:32.722109 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a10a502b-5f57-4241-9309-3c85a65917f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:32.913153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 916/1844] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:32 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:32.924213 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:32.980428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a502b-5f57-4241-9309-3c85a65917f4 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:33.002515 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ec816-14e0-45de-8cf0-0f0c134b4d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:33.003747 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ec816-14e0-45de-8cf0-0f0c134b4d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:33.005124 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ec816-14e0-45de-8cf0-0f0c134b4d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:33.006045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ec816-14e0-45de-8cf0-0f0c134b4d62 admin admin] PATH_INFO: `/v3/users/191706d8c4134961b5e9cd2cedef7e4c` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:33.010206 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ec816-14e0-45de-8cf0-0f0c134b4d62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=191706d8c4134961b5e9cd2cedef7e4c)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:33.017556 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ec816-14e0-45de-8cf0-0f0c134b4d62 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:33.163606 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c124f33-b32c-4f39-9f14-d7a072caaf1c None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:33.166083 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-6c124f33-b32c-4f39-9f14-d7a072caaf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:33.199747 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c06ec816-14e0-45de-8cf0-0f0c134b4d62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '191706d8c4134961b5e9cd2cedef7e4c'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:33.224553 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c06ec816-14e0-45de-8cf0-0f0c134b4d62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '191706d8c4134961b5e9cd2cedef7e4c'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:33.257352 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c06ec816-14e0-45de-8cf0-0f0c134b4d62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '191706d8c4134961b5e9cd2cedef7e4c'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:33.263448 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c06ec816-14e0-45de-8cf0-0f0c134b4d62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '191706d8c4134961b5e9cd2cedef7e4c'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:33.316813 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c06ec816-14e0-45de-8cf0-0f0c134b4d62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '191706d8c4134961b5e9cd2cedef7e4c'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:33.343480 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c124f33-b32c-4f39-9f14-d7a072caaf1c None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:33.353069 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 929/1845] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:56:32 2022] DELETE /identity/v3/users/191706d8c4134961b5e9cd2cedef7e4c => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:33.490686 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6cdc3-b724-408c-b0e5-0e99341e2ba2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:33.494934 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6cdc3-b724-408c-b0e5-0e99341e2ba2 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:33.495551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6cdc3-b724-408c-b0e5-0e99341e2ba2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:33.498066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6cdc3-b724-408c-b0e5-0e99341e2ba2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:33.517844 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-75b6cdc3-b724-408c-b0e5-0e99341e2ba2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:33.911042 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b6cdc3-b724-408c-b0e5-0e99341e2ba2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:33.916258 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b6cdc3-b724-408c-b0e5-0e99341e2ba2 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:33.937382 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:33.971902 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 917/1846] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:33 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 809 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 05:56:34.108473 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ec816-14e0-45de-8cf0-0f0c134b4d62 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:34.110733 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c06ec816-14e0-45de-8cf0-0f0c134b4d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:34.133828 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ec816-14e0-45de-8cf0-0f0c134b4d62 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:34.137606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d70cb5-d689-418a-a9de-20e4932ae204 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:34.138353 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d70cb5-d689-418a-a9de-20e4932ae204 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:34.138638 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d70cb5-d689-418a-a9de-20e4932ae204 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:34.138912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d70cb5-d689-418a-a9de-20e4932ae204 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:34.147979 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c0d70cb5-d689-418a-a9de-20e4932ae204 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:34.302908 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d70cb5-d689-418a-a9de-20e4932ae204 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:34.312967 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d70cb5-d689-418a-a9de-20e4932ae204 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:34.336544 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 930/1847] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:34 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:34.749924 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0da727-1771-4d0c-9774-16647e630910 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:34.751034 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0da727-1771-4d0c-9774-16647e630910 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:34.751507 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0da727-1771-4d0c-9774-16647e630910 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:34.754181 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 918/1848] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jul 4 05:56:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:56:34.772256 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934eb79a-f462-42a6-b04c-ef41a345c3f9 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:34.772343 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934eb79a-f462-42a6-b04c-ef41a345c3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:34.772657 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934eb79a-f462-42a6-b04c-ef41a345c3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:34.823670 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-934eb79a-f462-42a6-b04c-ef41a345c3f9 None None] MFA Rules not processed for user `6f638cc70c994a529a48cb2c92b70384`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:34.825162 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-934eb79a-f462-42a6-b04c-ef41a345c3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:35.004712 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:35.033616 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 931/1849] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jul 4 05:56:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:35.175855 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0da727-1771-4d0c-9774-16647e630910 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:35.179142 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-0f0da727-1771-4d0c-9774-16647e630910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:35.392610 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934eb79a-f462-42a6-b04c-ef41a345c3f9 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:35.394496 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-934eb79a-f462-42a6-b04c-ef41a345c3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:35.406665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0da727-1771-4d0c-9774-16647e630910 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:35.418808 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e5935-e16c-466a-8447-0f94eee7a08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:35.420467 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934eb79a-f462-42a6-b04c-ef41a345c3f9 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:35.422410 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e5935-e16c-466a-8447-0f94eee7a08e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:35.422989 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e5935-e16c-466a-8447-0f94eee7a08e admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:35.424467 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e5935-e16c-466a-8447-0f94eee7a08e admin admin] PATH_INFO: `/v3/users/c08dc531c0454faaab88a0643b971c42` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:35.426996 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e5935-e16c-466a-8447-0f94eee7a08e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c08dc531c0454faaab88a0643b971c42)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:35.432789 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e5935-e16c-466a-8447-0f94eee7a08e admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:35.436931 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b89c2b-61f5-4203-8ed6-0383e39ed400 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:35.439134 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b89c2b-61f5-4203-8ed6-0383e39ed400 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:35.439134 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b89c2b-61f5-4203-8ed6-0383e39ed400 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:35.440899 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b89c2b-61f5-4203-8ed6-0383e39ed400 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:35.460263 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b89c2b-61f5-4203-8ed6-0383e39ed400 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:35.466469 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b89c2b-61f5-4203-8ed6-0383e39ed400 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:35.503157 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 932/1850] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 05:56:35.546372 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d61e5935-e16c-466a-8447-0f94eee7a08e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c08dc531c0454faaab88a0643b971c42'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:35.548472 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d61e5935-e16c-466a-8447-0f94eee7a08e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c08dc531c0454faaab88a0643b971c42'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:35.564540 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d61e5935-e16c-466a-8447-0f94eee7a08e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c08dc531c0454faaab88a0643b971c42'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:35.565454 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d61e5935-e16c-466a-8447-0f94eee7a08e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c08dc531c0454faaab88a0643b971c42'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:35.583751 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d61e5935-e16c-466a-8447-0f94eee7a08e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c08dc531c0454faaab88a0643b971c42'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:35.605109 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03803cc-f96f-488e-9453-ecd3df68d45e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:35.605469 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03803cc-f96f-488e-9453-ecd3df68d45e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:35.605766 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03803cc-f96f-488e-9453-ecd3df68d45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:35.608165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 919/1851] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:56:35 2022] DELETE /identity/v3/users/c08dc531c0454faaab88a0643b971c42 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:35.630162 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-c03803cc-f96f-488e-9453-ecd3df68d45e None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:35.631520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c03803cc-f96f-488e-9453-ecd3df68d45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:35.745853 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 933/1852] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:35.777364 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e5935-e16c-466a-8447-0f94eee7a08e admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:35.782706 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d61e5935-e16c-466a-8447-0f94eee7a08e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:35.869726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e5935-e16c-466a-8447-0f94eee7a08e admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:35.876155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9538942-870f-4d89-97ef-c51258627312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:35.877972 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9538942-870f-4d89-97ef-c51258627312 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:35.878469 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9538942-870f-4d89-97ef-c51258627312 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:35.879200 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9538942-870f-4d89-97ef-c51258627312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:35.891363 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9538942-870f-4d89-97ef-c51258627312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:35.893380 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9538942-870f-4d89-97ef-c51258627312 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:35.905281 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 920/1853] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:35.924058 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03803cc-f96f-488e-9453-ecd3df68d45e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:35.925964 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c03803cc-f96f-488e-9453-ecd3df68d45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:35.942193 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03803cc-f96f-488e-9453-ecd3df68d45e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:35.953286 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a0e10-7955-47fa-b07b-27cd1e7ccfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:35.955146 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a0e10-7955-47fa-b07b-27cd1e7ccfb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:35.955731 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a0e10-7955-47fa-b07b-27cd1e7ccfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:35.956283 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a0e10-7955-47fa-b07b-27cd1e7ccfb2 admin admin] PATH_INFO: `/v3/projects/ebfadec412c84fd2991e82825d621f96` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:35.957841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a0e10-7955-47fa-b07b-27cd1e7ccfb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebfadec412c84fd2991e82825d621f96)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:35.961617 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a0e10-7955-47fa-b07b-27cd1e7ccfb2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:36.085704 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-4d0a0e10-7955-47fa-b07b-27cd1e7ccfb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebfadec412c84fd2991e82825d621f96', 'request_id': 'req-4d0a0e10-7955-47fa-b07b-27cd1e7ccfb2'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:36.100083 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-4d0a0e10-7955-47fa-b07b-27cd1e7ccfb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebfadec412c84fd2991e82825d621f96', 'request_id': 'req-4d0a0e10-7955-47fa-b07b-27cd1e7ccfb2'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:36.110402 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-4d0a0e10-7955-47fa-b07b-27cd1e7ccfb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebfadec412c84fd2991e82825d621f96', 'request_id': 'req-4d0a0e10-7955-47fa-b07b-27cd1e7ccfb2'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:36.127232 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-4d0a0e10-7955-47fa-b07b-27cd1e7ccfb2 admin admin] The token cache is being invalidate because project ebfadec412c84fd2991e82825d621f96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:56:36.128602 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-4d0a0e10-7955-47fa-b07b-27cd1e7ccfb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:36.129375 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-4d0a0e10-7955-47fa-b07b-27cd1e7ccfb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:36.137434 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb88f0-5dbf-4579-b232-b5cf4bd4b4d2 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:36.137728 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb88f0-5dbf-4579-b232-b5cf4bd4b4d2 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:36.138004 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb88f0-5dbf-4579-b232-b5cf4bd4b4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:36.139809 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 934/1854] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:56:35 2022] DELETE /identity/v3/projects/ebfadec412c84fd2991e82825d621f96 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:36.174759 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-fbbb88f0-5dbf-4579-b232-b5cf4bd4b4d2 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:36.176420 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-fbbb88f0-5dbf-4579-b232-b5cf4bd4b4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:36.204816 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:36.279246 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 921/1855] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:36.281836 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b7932-32ba-4d70-ac57-d02c9bc14398 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:36.282127 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b7932-32ba-4d70-ac57-d02c9bc14398 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:36.282821 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b7932-32ba-4d70-ac57-d02c9bc14398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:36.315741 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-011b7932-32ba-4d70-ac57-d02c9bc14398 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:36.317443 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-011b7932-32ba-4d70-ac57-d02c9bc14398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:36.328124 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 935/1856] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:36.333229 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb88f0-5dbf-4579-b232-b5cf4bd4b4d2 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:36.354286 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb88f0-5dbf-4579-b232-b5cf4bd4b4d2 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:36.369609 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab188c47-822c-4cf9-8c99-c7f6b7b5eee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:36.371671 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab188c47-822c-4cf9-8c99-c7f6b7b5eee3 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:36.372983 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab188c47-822c-4cf9-8c99-c7f6b7b5eee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:36.373525 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab188c47-822c-4cf9-8c99-c7f6b7b5eee3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:36.375476 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab188c47-822c-4cf9-8c99-c7f6b7b5eee3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:56:36.376006 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab188c47-822c-4cf9-8c99-c7f6b7b5eee3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:36.379173 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab188c47-822c-4cf9-8c99-c7f6b7b5eee3 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:36.387209 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b7932-32ba-4d70-ac57-d02c9bc14398 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:36.391071 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-011b7932-32ba-4d70-ac57-d02c9bc14398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:36.406166 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b7932-32ba-4d70-ac57-d02c9bc14398 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:36.414096 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b160906-a556-48fb-96d8-242ba52c4d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:36.415752 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b160906-a556-48fb-96d8-242ba52c4d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:36.416203 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b160906-a556-48fb-96d8-242ba52c4d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:36.416608 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b160906-a556-48fb-96d8-242ba52c4d96 admin admin] PATH_INFO: `/v3/projects/ac027e1572e840a588e1d8a770d0fa6e` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:36.418241 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b160906-a556-48fb-96d8-242ba52c4d96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac027e1572e840a588e1d8a770d0fa6e)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:36.420468 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b160906-a556-48fb-96d8-242ba52c4d96 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:36.443851 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 922/1857] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:56:36.449526 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab188c47-822c-4cf9-8c99-c7f6b7b5eee3 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:36.471679 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab188c47-822c-4cf9-8c99-c7f6b7b5eee3 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:36.495620 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c5bde-bc8c-4cdd-a72e-d70393d3c00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:36.496322 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c5bde-bc8c-4cdd-a72e-d70393d3c00c admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:36.496609 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c5bde-bc8c-4cdd-a72e-d70393d3c00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:36.496887 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c5bde-bc8c-4cdd-a72e-d70393d3c00c admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:36.497592 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c5bde-bc8c-4cdd-a72e-d70393d3c00c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:36.505896 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c5bde-bc8c-4cdd-a72e-d70393d3c00c admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:36.543266 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8b160906-a556-48fb-96d8-242ba52c4d96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac027e1572e840a588e1d8a770d0fa6e', 'request_id': 'req-8b160906-a556-48fb-96d8-242ba52c4d96'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:36.551926 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8b160906-a556-48fb-96d8-242ba52c4d96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac027e1572e840a588e1d8a770d0fa6e', 'request_id': 'req-8b160906-a556-48fb-96d8-242ba52c4d96'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:36.554143 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:36.570906 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8b160906-a556-48fb-96d8-242ba52c4d96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac027e1572e840a588e1d8a770d0fa6e', 'request_id': 'req-8b160906-a556-48fb-96d8-242ba52c4d96'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:36.600287 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8b160906-a556-48fb-96d8-242ba52c4d96 admin admin] The token cache is being invalidate because project ac027e1572e840a588e1d8a770d0fa6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:56:36.600287 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8b160906-a556-48fb-96d8-242ba52c4d96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:36.600512 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 923/1858] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:36 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:36.600601 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8b160906-a556-48fb-96d8-242ba52c4d96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:36.601761 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c5bde-bc8c-4cdd-a72e-d70393d3c00c admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:36.606574 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 936/1859] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:56:36 2022] DELETE /identity/v3/projects/ac027e1572e840a588e1d8a770d0fa6e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:36.608359 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-824c5bde-bc8c-4cdd-a72e-d70393d3c00c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:36.609983 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b160906-a556-48fb-96d8-242ba52c4d96 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:36.621731 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8b160906-a556-48fb-96d8-242ba52c4d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:36.760420 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c5bde-bc8c-4cdd-a72e-d70393d3c00c admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:36.764852 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b160906-a556-48fb-96d8-242ba52c4d96 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:36.772989 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd0f35-8dc5-4bcf-9dd1-a6eca3d52bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:36.773701 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd0f35-8dc5-4bcf-9dd1-a6eca3d52bfa admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:36.773988 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd0f35-8dc5-4bcf-9dd1-a6eca3d52bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:36.774271 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd0f35-8dc5-4bcf-9dd1-a6eca3d52bfa admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:36.774976 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd0f35-8dc5-4bcf-9dd1-a6eca3d52bfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:36.779739 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15fa8b-7e51-450e-bc8c-14e57b9fe6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:36.782666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15fa8b-7e51-450e-bc8c-14e57b9fe6d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:36.782666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15fa8b-7e51-450e-bc8c-14e57b9fe6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:36.782666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15fa8b-7e51-450e-bc8c-14e57b9fe6d3 admin admin] PATH_INFO: `/v3/users/679139d7557d4b19bac0f30c82d769a3` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:36.782926 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd0f35-8dc5-4bcf-9dd1-a6eca3d52bfa admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:36.784265 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15fa8b-7e51-450e-bc8c-14e57b9fe6d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=679139d7557d4b19bac0f30c82d769a3)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:36.786223 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15fa8b-7e51-450e-bc8c-14e57b9fe6d3 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:36.836886 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 924/1860] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:36 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:36.845435 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd0f35-8dc5-4bcf-9dd1-a6eca3d52bfa admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:36.884537 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd0f35-8dc5-4bcf-9dd1-a6eca3d52bfa admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:36.904900 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50a332-4a2c-4adb-9850-46eb3568f3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:36.905930 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50a332-4a2c-4adb-9850-46eb3568f3e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:36.908762 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50a332-4a2c-4adb-9850-46eb3568f3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:36.909173 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50a332-4a2c-4adb-9850-46eb3568f3e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:36.912694 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50a332-4a2c-4adb-9850-46eb3568f3e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:36.918904 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50a332-4a2c-4adb-9850-46eb3568f3e0 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:36.937014 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6e15fa8b-7e51-450e-bc8c-14e57b9fe6d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '679139d7557d4b19bac0f30c82d769a3'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:36.945206 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 925/1861] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:36.951047 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50a332-4a2c-4adb-9850-46eb3568f3e0 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:36.955703 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6e15fa8b-7e51-450e-bc8c-14e57b9fe6d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '679139d7557d4b19bac0f30c82d769a3'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:36.969267 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50a332-4a2c-4adb-9850-46eb3568f3e0 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:36.974175 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6e15fa8b-7e51-450e-bc8c-14e57b9fe6d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '679139d7557d4b19bac0f30c82d769a3'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:36.975152 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6e15fa8b-7e51-450e-bc8c-14e57b9fe6d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '679139d7557d4b19bac0f30c82d769a3'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:36.989250 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc2082-cd2c-44c2-bc7b-5a92a9a74316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:36.991548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc2082-cd2c-44c2-bc7b-5a92a9a74316 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:36.992769 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc2082-cd2c-44c2-bc7b-5a92a9a74316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:36.993160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc2082-cd2c-44c2-bc7b-5a92a9a74316 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:36.995173 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc2082-cd2c-44c2-bc7b-5a92a9a74316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:36.998971 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc2082-cd2c-44c2-bc7b-5a92a9a74316 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:37.003741 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6e15fa8b-7e51-450e-bc8c-14e57b9fe6d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '679139d7557d4b19bac0f30c82d769a3'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:37.029302 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 926/1862] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:37.030423 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc2082-cd2c-44c2-bc7b-5a92a9a74316 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:37.036334 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d4bc2082-cd2c-44c2-bc7b-5a92a9a74316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:37.040429 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 937/1863] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:56:36 2022] DELETE /identity/v3/users/679139d7557d4b19bac0f30c82d769a3 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:37.070233 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc2082-cd2c-44c2-bc7b-5a92a9a74316 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:37.143105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15fa8b-7e51-450e-bc8c-14e57b9fe6d3 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:37.146230 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6e15fa8b-7e51-450e-bc8c-14e57b9fe6d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:37.181564 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:37.197414 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156e345-418f-4e47-935c-a74b11356af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:37.198990 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156e345-418f-4e47-935c-a74b11356af5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:37.199521 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156e345-418f-4e47-935c-a74b11356af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:37.200734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156e345-418f-4e47-935c-a74b11356af5 admin admin] PATH_INFO: `/v3/projects/8dc73cb751b14c8eb6cd219217ae8f69/users/2c7bc7de206c43d48bec43a57927c8f5/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:37.224023 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156e345-418f-4e47-935c-a74b11356af5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc73cb751b14c8eb6cd219217ae8f69, user_id=2c7bc7de206c43d48bec43a57927c8f5, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:37.227101 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156e345-418f-4e47-935c-a74b11356af5 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:37.253065 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 927/1864] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:37 2022] PUT /identity/v3/projects/8dc73cb751b14c8eb6cd219217ae8f69/users/2c7bc7de206c43d48bec43a57927c8f5/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:37.265045 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcfd1f-e5aa-4efb-8afc-967f0a135462 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:37.265610 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcfd1f-e5aa-4efb-8afc-967f0a135462 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:37.265610 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcfd1f-e5aa-4efb-8afc-967f0a135462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:37.308614 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15fa8b-7e51-450e-bc8c-14e57b9fe6d3 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:37.313787 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:37.318935 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-92bcfd1f-e5aa-4efb-8afc-967f0a135462 None None] MFA Rules not processed for user `2c7bc7de206c43d48bec43a57927c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:37.320848 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-92bcfd1f-e5aa-4efb-8afc-967f0a135462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:37.384605 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91605d34-4fcd-4105-99c5-e9e8073e6d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:37.385398 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91605d34-4fcd-4105-99c5-e9e8073e6d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:37.385685 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91605d34-4fcd-4105-99c5-e9e8073e6d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:37.385963 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91605d34-4fcd-4105-99c5-e9e8073e6d8c admin admin] PATH_INFO: `/v3/users/3b7d095220d5490abb2f2445dbab7970` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:37.387470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91605d34-4fcd-4105-99c5-e9e8073e6d8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b7d095220d5490abb2f2445dbab7970)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:37.389670 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91605d34-4fcd-4105-99c5-e9e8073e6d8c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:37.418396 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 928/1865] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:56:37.422881 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcfd1f-e5aa-4efb-8afc-967f0a135462 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:37.438775 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcfd1f-e5aa-4efb-8afc-967f0a135462 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:37.445579 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b1667-63ce-4b05-8efd-ea52adbfd0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:37.446724 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b1667-63ce-4b05-8efd-ea52adbfd0bf admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:37.447168 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b1667-63ce-4b05-8efd-ea52adbfd0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:37.448004 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b1667-63ce-4b05-8efd-ea52adbfd0bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:37.449897 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b1667-63ce-4b05-8efd-ea52adbfd0bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:37.453060 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b1667-63ce-4b05-8efd-ea52adbfd0bf admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:37.456333 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-91605d34-4fcd-4105-99c5-e9e8073e6d8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b7d095220d5490abb2f2445dbab7970'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:37.465150 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-91605d34-4fcd-4105-99c5-e9e8073e6d8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b7d095220d5490abb2f2445dbab7970'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:37.475564 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-91605d34-4fcd-4105-99c5-e9e8073e6d8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b7d095220d5490abb2f2445dbab7970'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:37.476625 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-91605d34-4fcd-4105-99c5-e9e8073e6d8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b7d095220d5490abb2f2445dbab7970'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:37.492544 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-91605d34-4fcd-4105-99c5-e9e8073e6d8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b7d095220d5490abb2f2445dbab7970'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:37.495637 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 929/1866] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:37 2022] POST /identity/v3/projects => generated 387 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:37.499263 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b1667-63ce-4b05-8efd-ea52adbfd0bf admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:37.501590 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-aa9b1667-63ce-4b05-8efd-ea52adbfd0bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:37.508751 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 938/1867] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:56:37 2022] DELETE /identity/v3/users/3b7d095220d5490abb2f2445dbab7970 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:37.510213 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fae19-680f-40a1-8f28-3571bc327fa8 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:37.510578 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fae19-680f-40a1-8f28-3571bc327fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:37.511090 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fae19-680f-40a1-8f28-3571bc327fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:37.559708 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-df4fae19-680f-40a1-8f28-3571bc327fa8 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:37.561543 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-df4fae19-680f-40a1-8f28-3571bc327fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:37.637839 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b1667-63ce-4b05-8efd-ea52adbfd0bf admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:37.640581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 939/1868] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:37.647021 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5effad49-878c-40ad-858d-d9aad7003a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:37.647755 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effad49-878c-40ad-858d-d9aad7003a20 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:37.648040 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effad49-878c-40ad-858d-d9aad7003a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:37.648341 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effad49-878c-40ad-858d-d9aad7003a20 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:37.649043 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5effad49-878c-40ad-858d-d9aad7003a20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:37.651488 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5effad49-878c-40ad-858d-d9aad7003a20 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:37.675218 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 930/1869] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:37 2022] POST /identity/v3/users => generated 300 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 05:56:37.679637 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5effad49-878c-40ad-858d-d9aad7003a20 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:37.679984 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4fae19-680f-40a1-8f28-3571bc327fa8 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:37.681911 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-5effad49-878c-40ad-858d-d9aad7003a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:37.695649 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4fae19-680f-40a1-8f28-3571bc327fa8 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:37.702573 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055caa9-c0a8-49ba-91a0-af7b6fd63ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:37.703298 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055caa9-c0a8-49ba-91a0-af7b6fd63ebd admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:37.703575 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055caa9-c0a8-49ba-91a0-af7b6fd63ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:37.703856 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055caa9-c0a8-49ba-91a0-af7b6fd63ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:37.704974 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055caa9-c0a8-49ba-91a0-af7b6fd63ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:37.706731 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055caa9-c0a8-49ba-91a0-af7b6fd63ebd admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:37.725891 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 940/1870] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:37.727360 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055caa9-c0a8-49ba-91a0-af7b6fd63ebd admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:37.738937 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:37.749315 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055caa9-c0a8-49ba-91a0-af7b6fd63ebd admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:37.754688 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c2d11-e49c-4bfa-94c9-46df8156ed14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:37.755873 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c2d11-e49c-4bfa-94c9-46df8156ed14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:37.756295 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c2d11-e49c-4bfa-94c9-46df8156ed14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:37.756580 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c2d11-e49c-4bfa-94c9-46df8156ed14 admin admin] PATH_INFO: `/v3/projects/5037290f8c3c45dbb246031fdf2f3bb6/users/00cf9e9aae284a819638488c182cc9d7/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:37.780649 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856c2d11-e49c-4bfa-94c9-46df8156ed14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5037290f8c3c45dbb246031fdf2f3bb6, user_id=00cf9e9aae284a819638488c182cc9d7, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:37.792060 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856c2d11-e49c-4bfa-94c9-46df8156ed14 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:37.797438 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:37.808383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5effad49-878c-40ad-858d-d9aad7003a20 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:37.822138 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f276e89-ece1-464b-b807-059f3b19d916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:37.822859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f276e89-ece1-464b-b807-059f3b19d916 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:37.830703 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 941/1871] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:37 2022] PUT /identity/v3/projects/5037290f8c3c45dbb246031fdf2f3bb6/users/00cf9e9aae284a819638488c182cc9d7/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:37.831903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f276e89-ece1-464b-b807-059f3b19d916 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:37.832427 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c2d11-e49c-4bfa-94c9-46df8156ed14 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:37.833013 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f276e89-ece1-464b-b807-059f3b19d916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:37.860299 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f276e89-ece1-464b-b807-059f3b19d916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:37.864758 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f276e89-ece1-464b-b807-059f3b19d916 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:37.888675 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 931/1872] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 05:56:37.936891 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c2d11-e49c-4bfa-94c9-46df8156ed14 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:37.943098 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b45fea-0a8c-4a57-ad26-1b869db5d7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:37.943983 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b45fea-0a8c-4a57-ad26-1b869db5d7db admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:37.944342 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b45fea-0a8c-4a57-ad26-1b869db5d7db admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:37.944683 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b45fea-0a8c-4a57-ad26-1b869db5d7db admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:37.946041 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b45fea-0a8c-4a57-ad26-1b869db5d7db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:37.948345 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b45fea-0a8c-4a57-ad26-1b869db5d7db admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:37.979527 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 942/1873] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:37.981423 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f276e89-ece1-464b-b807-059f3b19d916 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:37.995806 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f276e89-ece1-464b-b807-059f3b19d916 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:38.003476 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb17bd-b30f-4892-97bf-dae665bfc4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:38.004458 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb17bd-b30f-4892-97bf-dae665bfc4a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:38.004740 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb17bd-b30f-4892-97bf-dae665bfc4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:38.005016 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb17bd-b30f-4892-97bf-dae665bfc4a3 admin admin] PATH_INFO: `/v3/projects/5037290f8c3c45dbb246031fdf2f3bb6/users/00cf9e9aae284a819638488c182cc9d7/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:38.007393 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb17bd-b30f-4892-97bf-dae665bfc4a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5037290f8c3c45dbb246031fdf2f3bb6, user_id=00cf9e9aae284a819638488c182cc9d7, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:38.010245 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb17bd-b30f-4892-97bf-dae665bfc4a3 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:38.028968 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 932/1874] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:37 2022] PUT /identity/v3/projects/5037290f8c3c45dbb246031fdf2f3bb6/users/00cf9e9aae284a819638488c182cc9d7/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:38.041354 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ffa642-f725-4edc-9a67-44f5ad0ceea7 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:38.041643 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ffa642-f725-4edc-9a67-44f5ad0ceea7 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:38.041924 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ffa642-f725-4edc-9a67-44f5ad0ceea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:38.093591 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-b2ffa642-f725-4edc-9a67-44f5ad0ceea7 None None] MFA Rules not processed for user `00cf9e9aae284a819638488c182cc9d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:38.095406 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b2ffa642-f725-4edc-9a67-44f5ad0ceea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:38.206268 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb17bd-b30f-4892-97bf-dae665bfc4a3 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:38.208615 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-55bb17bd-b30f-4892-97bf-dae665bfc4a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:38.228914 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 943/1875] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:38 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:38.245145 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ffa642-f725-4edc-9a67-44f5ad0ceea7 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:38.248302 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b2ffa642-f725-4edc-9a67-44f5ad0ceea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:38.332793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb17bd-b30f-4892-97bf-dae665bfc4a3 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:38.354484 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6943afc2-6419-4353-ae70-61ae26adebb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:38.355541 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943afc2-6419-4353-ae70-61ae26adebb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:38.355942 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943afc2-6419-4353-ae70-61ae26adebb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:38.356275 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943afc2-6419-4353-ae70-61ae26adebb1 admin admin] PATH_INFO: `/v3/projects/9f5abf62fd674f0b91a077428d509bf0` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:38.357582 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6943afc2-6419-4353-ae70-61ae26adebb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f5abf62fd674f0b91a077428d509bf0)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:38.358193 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ffa642-f725-4edc-9a67-44f5ad0ceea7 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:38.360722 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6943afc2-6419-4353-ae70-61ae26adebb1 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:38.372322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477f0c7-8560-4c4a-9de1-0cd60adca035 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:38.373472 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477f0c7-8560-4c4a-9de1-0cd60adca035 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:38.374040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477f0c7-8560-4c4a-9de1-0cd60adca035 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:38.374572 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477f0c7-8560-4c4a-9de1-0cd60adca035 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:38.400205 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9477f0c7-8560-4c4a-9de1-0cd60adca035 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:38.403483 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9477f0c7-8560-4c4a-9de1-0cd60adca035 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:38.424321 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 944/1876] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:38 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:38.436927 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-6943afc2-6419-4353-ae70-61ae26adebb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f5abf62fd674f0b91a077428d509bf0', 'request_id': 'req-6943afc2-6419-4353-ae70-61ae26adebb1'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:38.448709 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-6943afc2-6419-4353-ae70-61ae26adebb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f5abf62fd674f0b91a077428d509bf0', 'request_id': 'req-6943afc2-6419-4353-ae70-61ae26adebb1'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:38.458981 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-6943afc2-6419-4353-ae70-61ae26adebb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f5abf62fd674f0b91a077428d509bf0', 'request_id': 'req-6943afc2-6419-4353-ae70-61ae26adebb1'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:38.510067 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-6943afc2-6419-4353-ae70-61ae26adebb1 admin admin] The token cache is being invalidate because project 9f5abf62fd674f0b91a077428d509bf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:56:38.510355 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-6943afc2-6419-4353-ae70-61ae26adebb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:38.511107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-6943afc2-6419-4353-ae70-61ae26adebb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:38.514592 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 933/1877] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:56:38 2022] DELETE /identity/v3/projects/9f5abf62fd674f0b91a077428d509bf0 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:38.529316 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477f0c7-8560-4c4a-9de1-0cd60adca035 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:38.560958 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477f0c7-8560-4c4a-9de1-0cd60adca035 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:38.620026 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:38.722373 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3c9cf-0b87-4c05-8041-eaf78e622981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:38.723586 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3c9cf-0b87-4c05-8041-eaf78e622981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:38.724011 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3c9cf-0b87-4c05-8041-eaf78e622981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:38.730073 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3c9cf-0b87-4c05-8041-eaf78e622981 admin admin] PATH_INFO: `/v3/users/9dbe68d821ce4ec298cde74aaef276ec` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:38.737176 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3c9cf-0b87-4c05-8041-eaf78e622981 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dbe68d821ce4ec298cde74aaef276ec)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:38.739829 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3c9cf-0b87-4c05-8041-eaf78e622981 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:38.841870 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f9e3c9cf-0b87-4c05-8041-eaf78e622981 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dbe68d821ce4ec298cde74aaef276ec'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:38.850378 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f9e3c9cf-0b87-4c05-8041-eaf78e622981 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dbe68d821ce4ec298cde74aaef276ec'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:38.866480 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f9e3c9cf-0b87-4c05-8041-eaf78e622981 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dbe68d821ce4ec298cde74aaef276ec'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:38.867643 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f9e3c9cf-0b87-4c05-8041-eaf78e622981 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dbe68d821ce4ec298cde74aaef276ec'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:38.899674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f9e3c9cf-0b87-4c05-8041-eaf78e622981 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dbe68d821ce4ec298cde74aaef276ec'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:38.906533 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 945/1878] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:56:38 2022] DELETE /identity/v3/users/9dbe68d821ce4ec298cde74aaef276ec => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:38.939877 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6943afc2-6419-4353-ae70-61ae26adebb1 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:38.941714 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-6943afc2-6419-4353-ae70-61ae26adebb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:38.980771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6943afc2-6419-4353-ae70-61ae26adebb1 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:39.074048 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:39.097219 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89844ce9-f75f-4978-9030-c3ce82dfd87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:39.098120 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89844ce9-f75f-4978-9030-c3ce82dfd87d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:39.098400 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89844ce9-f75f-4978-9030-c3ce82dfd87d admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:39.099071 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89844ce9-f75f-4978-9030-c3ce82dfd87d admin admin] PATH_INFO: `/v3/projects/5188705e22434d9e97cc2a89e4645d8e` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:39.100094 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89844ce9-f75f-4978-9030-c3ce82dfd87d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5188705e22434d9e97cc2a89e4645d8e)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:39.102171 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89844ce9-f75f-4978-9030-c3ce82dfd87d admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:39.192102 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-89844ce9-f75f-4978-9030-c3ce82dfd87d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5188705e22434d9e97cc2a89e4645d8e', 'request_id': 'req-89844ce9-f75f-4978-9030-c3ce82dfd87d'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:39.213207 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-89844ce9-f75f-4978-9030-c3ce82dfd87d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5188705e22434d9e97cc2a89e4645d8e', 'request_id': 'req-89844ce9-f75f-4978-9030-c3ce82dfd87d'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:39.226417 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-89844ce9-f75f-4978-9030-c3ce82dfd87d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5188705e22434d9e97cc2a89e4645d8e', 'request_id': 'req-89844ce9-f75f-4978-9030-c3ce82dfd87d'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:39.263273 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-89844ce9-f75f-4978-9030-c3ce82dfd87d admin admin] The token cache is being invalidate because project 5188705e22434d9e97cc2a89e4645d8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:56:39.263639 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-89844ce9-f75f-4978-9030-c3ce82dfd87d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:39.267709 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-89844ce9-f75f-4978-9030-c3ce82dfd87d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:39.280393 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 934/1879] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:56:38 2022] DELETE /identity/v3/projects/5188705e22434d9e97cc2a89e4645d8e => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:39.282991 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3c9cf-0b87-4c05-8041-eaf78e622981 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:39.284819 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f9e3c9cf-0b87-4c05-8041-eaf78e622981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:39.316453 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3c9cf-0b87-4c05-8041-eaf78e622981 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:39.396395 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89844ce9-f75f-4978-9030-c3ce82dfd87d admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:39.398660 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-89844ce9-f75f-4978-9030-c3ce82dfd87d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:39.471635 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3ab60-b38e-4565-ac90-268a299098fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:39.472555 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3ab60-b38e-4565-ac90-268a299098fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:39.472860 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3ab60-b38e-4565-ac90-268a299098fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:39.473146 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3ab60-b38e-4565-ac90-268a299098fc admin admin] PATH_INFO: `/v3/users/ff672b0cbecd4f019657144e191f5e96` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:39.475518 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3ab60-b38e-4565-ac90-268a299098fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff672b0cbecd4f019657144e191f5e96)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:39.477630 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3ab60-b38e-4565-ac90-268a299098fc admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:39.574549 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89844ce9-f75f-4978-9030-c3ce82dfd87d admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:39.575306 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:39.591887 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f650b-97cd-463b-9ac6-21ee7b7a8d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:39.593485 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f650b-97cd-463b-9ac6-21ee7b7a8d7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:39.593986 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f650b-97cd-463b-9ac6-21ee7b7a8d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:39.594481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f650b-97cd-463b-9ac6-21ee7b7a8d7a admin admin] PATH_INFO: `/v3/users/2c7bc7de206c43d48bec43a57927c8f5` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:39.596228 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f650b-97cd-463b-9ac6-21ee7b7a8d7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c7bc7de206c43d48bec43a57927c8f5)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:39.600987 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-67d3ab60-b38e-4565-ac90-268a299098fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff672b0cbecd4f019657144e191f5e96'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:39.602384 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f650b-97cd-463b-9ac6-21ee7b7a8d7a admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:39.619952 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-67d3ab60-b38e-4565-ac90-268a299098fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff672b0cbecd4f019657144e191f5e96'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:39.648869 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-67d3ab60-b38e-4565-ac90-268a299098fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff672b0cbecd4f019657144e191f5e96'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:39.649888 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-67d3ab60-b38e-4565-ac90-268a299098fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff672b0cbecd4f019657144e191f5e96'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:39.673108 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-67d3ab60-b38e-4565-ac90-268a299098fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff672b0cbecd4f019657144e191f5e96'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:39.676788 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c61f650b-97cd-463b-9ac6-21ee7b7a8d7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c7bc7de206c43d48bec43a57927c8f5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:39.678443 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c61f650b-97cd-463b-9ac6-21ee7b7a8d7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c7bc7de206c43d48bec43a57927c8f5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:39.695504 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c61f650b-97cd-463b-9ac6-21ee7b7a8d7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c7bc7de206c43d48bec43a57927c8f5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:39.696404 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c61f650b-97cd-463b-9ac6-21ee7b7a8d7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c7bc7de206c43d48bec43a57927c8f5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:39.701629 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 946/1880] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:56:39 2022] DELETE /identity/v3/users/ff672b0cbecd4f019657144e191f5e96 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:39.717969 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c61f650b-97cd-463b-9ac6-21ee7b7a8d7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c7bc7de206c43d48bec43a57927c8f5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:39.734957 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 935/1881] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:56:39 2022] DELETE /identity/v3/users/2c7bc7de206c43d48bec43a57927c8f5 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:39.740129 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c004e3f-c1f8-4596-a5d1-0a6109484856 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:39.740423 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c004e3f-c1f8-4596-a5d1-0a6109484856 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:39.741065 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c004e3f-c1f8-4596-a5d1-0a6109484856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:39.761077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-8c004e3f-c1f8-4596-a5d1-0a6109484856 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:39.762299 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8c004e3f-c1f8-4596-a5d1-0a6109484856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:39.847824 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 947/1882] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:39.862850 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f650b-97cd-463b-9ac6-21ee7b7a8d7a admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:39.865419 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c61f650b-97cd-463b-9ac6-21ee7b7a8d7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:39.872484 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:39.888827 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c004e3f-c1f8-4596-a5d1-0a6109484856 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:39.891625 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8c004e3f-c1f8-4596-a5d1-0a6109484856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:39.906244 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c004e3f-c1f8-4596-a5d1-0a6109484856 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:39.922316 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e499c75-26dd-431a-850c-87af6b521973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:39.922316 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e499c75-26dd-431a-850c-87af6b521973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:39.922316 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e499c75-26dd-431a-850c-87af6b521973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:39.922316 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e499c75-26dd-431a-850c-87af6b521973 admin admin] PATH_INFO: `/v3/projects/a0ab100267fc4878a257d5563034d247` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:39.922761 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e499c75-26dd-431a-850c-87af6b521973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0ab100267fc4878a257d5563034d247)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:39.922761 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e499c75-26dd-431a-850c-87af6b521973 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:39.943939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f650b-97cd-463b-9ac6-21ee7b7a8d7a admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:39.948179 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa587d-f022-4234-8c9d-24a65ff0883b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:39.948978 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa587d-f022-4234-8c9d-24a65ff0883b service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:39.949334 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa587d-f022-4234-8c9d-24a65ff0883b service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:39.949723 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa587d-f022-4234-8c9d-24a65ff0883b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:39.974819 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa587d-f022-4234-8c9d-24a65ff0883b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:39.978190 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa587d-f022-4234-8c9d-24a65ff0883b service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:40.008362 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 936/1883] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:40.013543 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-7e499c75-26dd-431a-850c-87af6b521973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0ab100267fc4878a257d5563034d247', 'request_id': 'req-7e499c75-26dd-431a-850c-87af6b521973'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:40.021296 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-7e499c75-26dd-431a-850c-87af6b521973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0ab100267fc4878a257d5563034d247', 'request_id': 'req-7e499c75-26dd-431a-850c-87af6b521973'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:40.035434 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-7e499c75-26dd-431a-850c-87af6b521973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0ab100267fc4878a257d5563034d247', 'request_id': 'req-7e499c75-26dd-431a-850c-87af6b521973'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:40.050831 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-7e499c75-26dd-431a-850c-87af6b521973 admin admin] The token cache is being invalidate because project a0ab100267fc4878a257d5563034d247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:56:40.052002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-7e499c75-26dd-431a-850c-87af6b521973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:40.053258 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-7e499c75-26dd-431a-850c-87af6b521973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:40.056119 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 948/1884] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:56:39 2022] DELETE /identity/v3/projects/a0ab100267fc4878a257d5563034d247 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 05:56:40.062555 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81b8d1-edbc-47ec-9092-75bc62de4223 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:40.062917 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81b8d1-edbc-47ec-9092-75bc62de4223 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:40.063286 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81b8d1-edbc-47ec-9092-75bc62de4223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:40.117240 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-9c81b8d1-edbc-47ec-9092-75bc62de4223 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:40.118694 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9c81b8d1-edbc-47ec-9092-75bc62de4223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:40.202723 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 937/1885] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:40.211976 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfe910-6fe3-4559-915d-6202ed6b1491 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:40.212260 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfe910-6fe3-4559-915d-6202ed6b1491 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:40.212535 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfe910-6fe3-4559-915d-6202ed6b1491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:40.230916 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-71dfe910-6fe3-4559-915d-6202ed6b1491 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:40.232170 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-71dfe910-6fe3-4559-915d-6202ed6b1491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:40.241033 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 949/1886] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:40.245183 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81b8d1-edbc-47ec-9092-75bc62de4223 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:40.255164 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81b8d1-edbc-47ec-9092-75bc62de4223 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:40.260194 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a38666-7461-4f60-bd0f-65a2533504dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:40.260935 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a38666-7461-4f60-bd0f-65a2533504dd admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:40.261222 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a38666-7461-4f60-bd0f-65a2533504dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:40.261498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a38666-7461-4f60-bd0f-65a2533504dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:40.262362 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a38666-7461-4f60-bd0f-65a2533504dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:56:40.262690 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a38666-7461-4f60-bd0f-65a2533504dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:40.264370 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a38666-7461-4f60-bd0f-65a2533504dd admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:40.276915 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 938/1887] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:56:40.281344 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfe910-6fe3-4559-915d-6202ed6b1491 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:40.291539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfe910-6fe3-4559-915d-6202ed6b1491 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:40.297357 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076290c-88cc-4b7d-a175-e418ece404bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:40.298124 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076290c-88cc-4b7d-a175-e418ece404bd admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:40.298390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076290c-88cc-4b7d-a175-e418ece404bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:40.298660 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076290c-88cc-4b7d-a175-e418ece404bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:40.299496 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076290c-88cc-4b7d-a175-e418ece404bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:40.301547 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076290c-88cc-4b7d-a175-e418ece404bd admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:40.329985 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a38666-7461-4f60-bd0f-65a2533504dd admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:40.333130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-32a38666-7461-4f60-bd0f-65a2533504dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:40.343399 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 950/1888] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:40 2022] POST /identity/v3/projects => generated 393 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:40.344664 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076290c-88cc-4b7d-a175-e418ece404bd admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:40.350271 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a38666-7461-4f60-bd0f-65a2533504dd admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:40.361616 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:40.417418 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076290c-88cc-4b7d-a175-e418ece404bd admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:40.422894 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a124f65-0865-4ba0-b4b3-99297bedbbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:40.423785 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a124f65-0865-4ba0-b4b3-99297bedbbaf admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:40.424078 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a124f65-0865-4ba0-b4b3-99297bedbbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:40.424354 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a124f65-0865-4ba0-b4b3-99297bedbbaf admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:40.425131 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a124f65-0865-4ba0-b4b3-99297bedbbaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:40.427110 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a124f65-0865-4ba0-b4b3-99297bedbbaf admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:40.429522 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae216e1f-64ac-44a9-927e-133fee4295c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:40.431453 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae216e1f-64ac-44a9-927e-133fee4295c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:40.431758 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae216e1f-64ac-44a9-927e-133fee4295c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:40.432117 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae216e1f-64ac-44a9-927e-133fee4295c2 admin admin] PATH_INFO: `/v3/projects/e5d52463b0214aae9056115a4a562bec` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:40.433587 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae216e1f-64ac-44a9-927e-133fee4295c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5d52463b0214aae9056115a4a562bec)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:40.435916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae216e1f-64ac-44a9-927e-133fee4295c2 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:40.457387 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 951/1889] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:40 2022] POST /identity/v3/users => generated 297 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:40.459214 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a124f65-0865-4ba0-b4b3-99297bedbbaf admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:40.471221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a124f65-0865-4ba0-b4b3-99297bedbbaf admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:40.476256 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868ad41-3b0c-4ce4-afdd-772f812ede05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:40.476919 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868ad41-3b0c-4ce4-afdd-772f812ede05 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:40.477201 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868ad41-3b0c-4ce4-afdd-772f812ede05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:40.477520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868ad41-3b0c-4ce4-afdd-772f812ede05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:40.478387 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868ad41-3b0c-4ce4-afdd-772f812ede05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:40.480162 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868ad41-3b0c-4ce4-afdd-772f812ede05 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:40.495236 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 952/1890] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 05:56:40.496501 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868ad41-3b0c-4ce4-afdd-772f812ede05 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:40.500635 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:40.510669 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868ad41-3b0c-4ce4-afdd-772f812ede05 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:40.514222 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-ae216e1f-64ac-44a9-927e-133fee4295c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5d52463b0214aae9056115a4a562bec', 'request_id': 'req-ae216e1f-64ac-44a9-927e-133fee4295c2'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:40.545966 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-ae216e1f-64ac-44a9-927e-133fee4295c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5d52463b0214aae9056115a4a562bec', 'request_id': 'req-ae216e1f-64ac-44a9-927e-133fee4295c2'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:40.554066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-ae216e1f-64ac-44a9-927e-133fee4295c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5d52463b0214aae9056115a4a562bec', 'request_id': 'req-ae216e1f-64ac-44a9-927e-133fee4295c2'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:40.580770 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-ae216e1f-64ac-44a9-927e-133fee4295c2 admin admin] The token cache is being invalidate because project e5d52463b0214aae9056115a4a562bec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:56:40.581272 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-ae216e1f-64ac-44a9-927e-133fee4295c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:40.584983 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-ae216e1f-64ac-44a9-927e-133fee4295c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:40.594902 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 939/1891] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:56:40 2022] DELETE /identity/v3/projects/e5d52463b0214aae9056115a4a562bec => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:40.596520 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2bf1a-1f15-44f9-a647-61a62989f7e7 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:40.596812 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2bf1a-1f15-44f9-a647-61a62989f7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:40.597088 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2bf1a-1f15-44f9-a647-61a62989f7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:40.630011 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf85ece-a421-4afc-915b-32cc81af525c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:40.630525 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-bee2bf1a-1f15-44f9-a647-61a62989f7e7 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:40.632344 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-bee2bf1a-1f15-44f9-a647-61a62989f7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:40.634511 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf85ece-a421-4afc-915b-32cc81af525c admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:40.635210 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf85ece-a421-4afc-915b-32cc81af525c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:40.635785 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf85ece-a421-4afc-915b-32cc81af525c admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:40.637833 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf85ece-a421-4afc-915b-32cc81af525c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:40.640482 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf85ece-a421-4afc-915b-32cc81af525c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:40.643557 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 940/1892] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:40.651697 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1af68-5112-494e-808f-8c517ceb06ca None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:40.652093 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1af68-5112-494e-808f-8c517ceb06ca None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:40.652442 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1af68-5112-494e-808f-8c517ceb06ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:40.663575 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 953/1893] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:40.664631 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf85ece-a421-4afc-915b-32cc81af525c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:40.667042 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7cf85ece-a421-4afc-915b-32cc81af525c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:40.687277 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf85ece-a421-4afc-915b-32cc81af525c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:40.693619 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740bdcdc-b878-46aa-b5a1-494f9550837b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:40.695019 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bdcdc-b878-46aa-b5a1-494f9550837b admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:40.695379 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bdcdc-b878-46aa-b5a1-494f9550837b admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:40.695657 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bdcdc-b878-46aa-b5a1-494f9550837b admin admin] PATH_INFO: `/v3/projects/dfc92eeb94d14317898f098165bf37c3/users/3b83181703404e0696bfab83942ec98f/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:40.713605 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-57c1af68-5112-494e-808f-8c517ceb06ca None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:40.715356 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-57c1af68-5112-494e-808f-8c517ceb06ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:40.718197 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740bdcdc-b878-46aa-b5a1-494f9550837b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfc92eeb94d14317898f098165bf37c3, user_id=3b83181703404e0696bfab83942ec98f, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:40.723862 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740bdcdc-b878-46aa-b5a1-494f9550837b admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:40.731021 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 941/1894] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:40.732831 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1af68-5112-494e-808f-8c517ceb06ca None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:40.745033 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1af68-5112-494e-808f-8c517ceb06ca None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:40.751489 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 954/1895] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:40 2022] PUT /identity/v3/projects/dfc92eeb94d14317898f098165bf37c3/users/3b83181703404e0696bfab83942ec98f/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:40.757925 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f0a58-692a-4a1b-8267-48f0c9cccb9d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:40.758305 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f0a58-692a-4a1b-8267-48f0c9cccb9d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:40.758592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f0a58-692a-4a1b-8267-48f0c9cccb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:40.794967 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-176f0a58-692a-4a1b-8267-48f0c9cccb9d None None] MFA Rules not processed for user `3b83181703404e0696bfab83942ec98f`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:40.796229 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-176f0a58-692a-4a1b-8267-48f0c9cccb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:40.834425 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd8f78-e358-46fa-bf83-163108de2f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:40.835781 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd8f78-e358-46fa-bf83-163108de2f16 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:40.836341 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd8f78-e358-46fa-bf83-163108de2f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:40.836909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd8f78-e358-46fa-bf83-163108de2f16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:40.838550 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd8f78-e358-46fa-bf83-163108de2f16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:56:40.839156 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd8f78-e358-46fa-bf83-163108de2f16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:40.842004 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd8f78-e358-46fa-bf83-163108de2f16 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:40.865318 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 942/1896] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:56:40.867901 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd8f78-e358-46fa-bf83-163108de2f16 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:40.880013 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd8f78-e358-46fa-bf83-163108de2f16 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:40.880548 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:40.885854 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad3b86-0d02-4d95-a636-dfb6feff38dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:40.886988 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad3b86-0d02-4d95-a636-dfb6feff38dd admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:40.887382 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad3b86-0d02-4d95-a636-dfb6feff38dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:40.887729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad3b86-0d02-4d95-a636-dfb6feff38dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:40.888687 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad3b86-0d02-4d95-a636-dfb6feff38dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:40.890972 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad3b86-0d02-4d95-a636-dfb6feff38dd admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:40.924870 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 955/1897] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:40.930401 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f0a58-692a-4a1b-8267-48f0c9cccb9d None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:40.935348 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 943/1898] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:40 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:40.937426 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad3b86-0d02-4d95-a636-dfb6feff38dd admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:40.949369 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f0a58-692a-4a1b-8267-48f0c9cccb9d None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:41.030527 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7498a-7b7a-4acb-bfd8-6f68264949a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:41.031230 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7498a-7b7a-4acb-bfd8-6f68264949a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:41.031579 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7498a-7b7a-4acb-bfd8-6f68264949a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:41.031843 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7498a-7b7a-4acb-bfd8-6f68264949a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:41.034571 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7498a-7b7a-4acb-bfd8-6f68264949a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:41.037959 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7498a-7b7a-4acb-bfd8-6f68264949a7 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:41.087706 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad3b86-0d02-4d95-a636-dfb6feff38dd admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:41.107877 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8bd7c4-f9b1-4d16-9730-f329e8827559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:41.108729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bd7c4-f9b1-4d16-9730-f329e8827559 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:41.109687 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bd7c4-f9b1-4d16-9730-f329e8827559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:41.109687 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bd7c4-f9b1-4d16-9730-f329e8827559 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:41.110129 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8bd7c4-f9b1-4d16-9730-f329e8827559 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:41.113974 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8bd7c4-f9b1-4d16-9730-f329e8827559 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:41.117904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 956/1899] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:40 2022] POST /identity/v3/projects => generated 393 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:41.123538 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7498a-7b7a-4acb-bfd8-6f68264949a7 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:41.159293 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 944/1900] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:40 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:41.169677 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8bd7c4-f9b1-4d16-9730-f329e8827559 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:41.209531 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8bd7c4-f9b1-4d16-9730-f329e8827559 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:41.230514 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7498a-7b7a-4acb-bfd8-6f68264949a7 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:41.232920 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:41.252766 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76173a4-f063-4896-8a99-d42f8c9a800a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:41.253624 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76173a4-f063-4896-8a99-d42f8c9a800a admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:41.253974 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76173a4-f063-4896-8a99-d42f8c9a800a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:41.254320 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76173a4-f063-4896-8a99-d42f8c9a800a admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:41.255461 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76173a4-f063-4896-8a99-d42f8c9a800a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:41.257554 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76173a4-f063-4896-8a99-d42f8c9a800a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:41.305392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 957/1901] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:41 2022] POST /identity/v3/users => generated 303 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:41.308627 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76173a4-f063-4896-8a99-d42f8c9a800a admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:41.325240 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76173a4-f063-4896-8a99-d42f8c9a800a admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:41.333245 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5686fc-3fd6-4ba5-ac10-e698a354bee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:41.335899 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5686fc-3fd6-4ba5-ac10-e698a354bee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:41.336359 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5686fc-3fd6-4ba5-ac10-e698a354bee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:41.336852 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5686fc-3fd6-4ba5-ac10-e698a354bee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:41.337933 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5686fc-3fd6-4ba5-ac10-e698a354bee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:41.340452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5686fc-3fd6-4ba5-ac10-e698a354bee1 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:41.360376 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 958/1902] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:41.366662 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5686fc-3fd6-4ba5-ac10-e698a354bee1 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:41.383827 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5686fc-3fd6-4ba5-ac10-e698a354bee1 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:41.392385 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61805f4-3ca1-4137-a125-03ec01e59382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:41.394546 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61805f4-3ca1-4137-a125-03ec01e59382 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:41.395053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61805f4-3ca1-4137-a125-03ec01e59382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:41.395484 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61805f4-3ca1-4137-a125-03ec01e59382 admin admin] PATH_INFO: `/v3/projects/179d76ac629b414b8882b91f2a4c8489/users/840f12fbf2f14f3cbd4f58569695e64f/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:41.406448 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98216bec-4175-4381-9eb9-62dfa9ee09d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:41.407376 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98216bec-4175-4381-9eb9-62dfa9ee09d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:41.407759 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98216bec-4175-4381-9eb9-62dfa9ee09d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:41.408178 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98216bec-4175-4381-9eb9-62dfa9ee09d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:41.409019 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98216bec-4175-4381-9eb9-62dfa9ee09d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:41.410743 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98216bec-4175-4381-9eb9-62dfa9ee09d2 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:41.422446 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61805f4-3ca1-4137-a125-03ec01e59382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=179d76ac629b414b8882b91f2a4c8489, user_id=840f12fbf2f14f3cbd4f58569695e64f, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:41.426138 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61805f4-3ca1-4137-a125-03ec01e59382 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:41.434840 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 945/1903] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:41.436122 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98216bec-4175-4381-9eb9-62dfa9ee09d2 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:41.444168 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-98216bec-4175-4381-9eb9-62dfa9ee09d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:41.456329 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 959/1904] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:41 2022] PUT /identity/v3/projects/179d76ac629b414b8882b91f2a4c8489/users/840f12fbf2f14f3cbd4f58569695e64f/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:41.457363 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61805f4-3ca1-4137-a125-03ec01e59382 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:41.473177 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98216bec-4175-4381-9eb9-62dfa9ee09d2 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:41.532536 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:41.580756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876bd8c-ecaa-4b6b-b5a8-c077f47afab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:41.586261 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61805f4-3ca1-4137-a125-03ec01e59382 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:41.591702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876bd8c-ecaa-4b6b-b5a8-c077f47afab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:41.596206 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876bd8c-ecaa-4b6b-b5a8-c077f47afab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:41.596505 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876bd8c-ecaa-4b6b-b5a8-c077f47afab8 admin admin] PATH_INFO: `/v3/projects/8dc73cb751b14c8eb6cd219217ae8f69` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:41.599482 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876bd8c-ecaa-4b6b-b5a8-c077f47afab8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dc73cb751b14c8eb6cd219217ae8f69)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:41.600955 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff8ee8-5a5c-4c72-9e61-9377689f413a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:41.601947 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff8ee8-5a5c-4c72-9e61-9377689f413a admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:41.602323 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff8ee8-5a5c-4c72-9e61-9377689f413a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:41.602712 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff8ee8-5a5c-4c72-9e61-9377689f413a admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:41.603048 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876bd8c-ecaa-4b6b-b5a8-c077f47afab8 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:41.603910 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff8ee8-5a5c-4c72-9e61-9377689f413a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:41.608238 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff8ee8-5a5c-4c72-9e61-9377689f413a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:41.634833 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 960/1905] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:41.636512 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff8ee8-5a5c-4c72-9e61-9377689f413a admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:41.652466 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff8ee8-5a5c-4c72-9e61-9377689f413a admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:41.659604 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acafce0-8d49-4574-be76-cab643f10324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:41.660746 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acafce0-8d49-4574-be76-cab643f10324 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:41.661122 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acafce0-8d49-4574-be76-cab643f10324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:41.661529 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acafce0-8d49-4574-be76-cab643f10324 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:41.662413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acafce0-8d49-4574-be76-cab643f10324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:41.665696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acafce0-8d49-4574-be76-cab643f10324 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:41.688463 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 961/1906] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:41.691626 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6761fe9-4323-4306-8660-7509d51b4004 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:41.692028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6761fe9-4323-4306-8660-7509d51b4004 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:41.692530 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6761fe9-4323-4306-8660-7509d51b4004 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:41.694310 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f876bd8c-ecaa-4b6b-b5a8-c077f47afab8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dc73cb751b14c8eb6cd219217ae8f69', 'request_id': 'req-f876bd8c-ecaa-4b6b-b5a8-c077f47afab8'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:41.694679 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 962/1907] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jul 4 05:56:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:56:41.695517 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6761fe9-4323-4306-8660-7509d51b4004 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:41.716205 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f876bd8c-ecaa-4b6b-b5a8-c077f47afab8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dc73cb751b14c8eb6cd219217ae8f69', 'request_id': 'req-f876bd8c-ecaa-4b6b-b5a8-c077f47afab8'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:41.724188 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f876bd8c-ecaa-4b6b-b5a8-c077f47afab8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dc73cb751b14c8eb6cd219217ae8f69', 'request_id': 'req-f876bd8c-ecaa-4b6b-b5a8-c077f47afab8'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:41.749650 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f876bd8c-ecaa-4b6b-b5a8-c077f47afab8 admin admin] The token cache is being invalidate because project 8dc73cb751b14c8eb6cd219217ae8f69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:56:41.750082 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f876bd8c-ecaa-4b6b-b5a8-c077f47afab8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:41.750794 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f876bd8c-ecaa-4b6b-b5a8-c077f47afab8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:41.752774 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 946/1908] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:56:41 2022] DELETE /identity/v3/projects/8dc73cb751b14c8eb6cd219217ae8f69 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:41.753291 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876bd8c-ecaa-4b6b-b5a8-c077f47afab8 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:41.763301 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f876bd8c-ecaa-4b6b-b5a8-c077f47afab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:41.812697 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6761fe9-4323-4306-8660-7509d51b4004 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:41.818879 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411ff87-029c-4436-a52d-89beaafe4e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:41.820520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411ff87-029c-4436-a52d-89beaafe4e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:41.820966 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411ff87-029c-4436-a52d-89beaafe4e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:41.821397 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411ff87-029c-4436-a52d-89beaafe4e81 admin admin] PATH_INFO: `/v3/projects/803942133a9a41a1945b9a2da9f60eb0/users/ad3945e2f0c74e429a2ba6463bae5125/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:41.839450 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411ff87-029c-4436-a52d-89beaafe4e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=803942133a9a41a1945b9a2da9f60eb0, user_id=ad3945e2f0c74e429a2ba6463bae5125, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:41.844553 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411ff87-029c-4436-a52d-89beaafe4e81 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:41.855000 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:41.879322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 963/1909] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:41 2022] PUT /identity/v3/projects/803942133a9a41a1945b9a2da9f60eb0/users/ad3945e2f0c74e429a2ba6463bae5125/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:41.879322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bec4b5-4c92-438c-8df8-e5531534b0c0 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:41.879322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bec4b5-4c92-438c-8df8-e5531534b0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:41.879322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bec4b5-4c92-438c-8df8-e5531534b0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:41.898959 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-84bec4b5-4c92-438c-8df8-e5531534b0c0 None None] MFA Rules not processed for user `6f638cc70c994a529a48cb2c92b70384`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:41.900279 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-84bec4b5-4c92-438c-8df8-e5531534b0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:41.911226 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876bd8c-ecaa-4b6b-b5a8-c077f47afab8 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:41.991386 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 964/1910] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jul 4 05:56:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:41.991821 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bec4b5-4c92-438c-8df8-e5531534b0c0 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:41.993782 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-84bec4b5-4c92-438c-8df8-e5531534b0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:42.002976 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437334c-4263-4f26-a62c-9666ca079852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:42.003977 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437334c-4263-4f26-a62c-9666ca079852 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:42.004800 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437334c-4263-4f26-a62c-9666ca079852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:42.005080 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437334c-4263-4f26-a62c-9666ca079852 admin admin] PATH_INFO: `/v3/projects/179d76ac629b414b8882b91f2a4c8489/users/840f12fbf2f14f3cbd4f58569695e64f/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:42.011637 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437334c-4263-4f26-a62c-9666ca079852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=179d76ac629b414b8882b91f2a4c8489, user_id=840f12fbf2f14f3cbd4f58569695e64f, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:42.014359 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437334c-4263-4f26-a62c-9666ca079852 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:42.026914 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bec4b5-4c92-438c-8df8-e5531534b0c0 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:42.039651 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc135d42-47f7-4f7f-ab53-cf5672c0be33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:42.040572 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc135d42-47f7-4f7f-ab53-cf5672c0be33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:42.043152 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc135d42-47f7-4f7f-ab53-cf5672c0be33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:42.043515 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc135d42-47f7-4f7f-ab53-cf5672c0be33 admin admin] PATH_INFO: `/v3/users/00cf9e9aae284a819638488c182cc9d7` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:42.051629 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 947/1911] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:41 2022] PUT /identity/v3/projects/179d76ac629b414b8882b91f2a4c8489/users/840f12fbf2f14f3cbd4f58569695e64f/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:42.055218 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc135d42-47f7-4f7f-ab53-cf5672c0be33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00cf9e9aae284a819638488c182cc9d7)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:42.057056 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc135d42-47f7-4f7f-ab53-cf5672c0be33 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:42.057455 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4792022-7c59-4058-b6e5-358a00d77948 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:42.059031 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4792022-7c59-4058-b6e5-358a00d77948 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:42.059631 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4792022-7c59-4058-b6e5-358a00d77948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:42.094617 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:42.102215 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-b4792022-7c59-4058-b6e5-358a00d77948 None None] MFA Rules not processed for user `ad3945e2f0c74e429a2ba6463bae5125`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:42.119749 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b4792022-7c59-4058-b6e5-358a00d77948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:42.125378 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fc135d42-47f7-4f7f-ab53-cf5672c0be33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00cf9e9aae284a819638488c182cc9d7'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:42.135313 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fc135d42-47f7-4f7f-ab53-cf5672c0be33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00cf9e9aae284a819638488c182cc9d7'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:42.153922 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fc135d42-47f7-4f7f-ab53-cf5672c0be33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00cf9e9aae284a819638488c182cc9d7'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:42.154852 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fc135d42-47f7-4f7f-ab53-cf5672c0be33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00cf9e9aae284a819638488c182cc9d7'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:42.174012 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fc135d42-47f7-4f7f-ab53-cf5672c0be33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00cf9e9aae284a819638488c182cc9d7'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:42.181163 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 965/1912] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:56:41 2022] DELETE /identity/v3/users/00cf9e9aae284a819638488c182cc9d7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:42.184247 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc135d42-47f7-4f7f-ab53-cf5672c0be33 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:42.184406 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fc135d42-47f7-4f7f-ab53-cf5672c0be33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:42.221943 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 948/1913] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:42.221943 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1da35c-79f2-45bc-80bb-7728027cfa4b None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:42.221943 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1da35c-79f2-45bc-80bb-7728027cfa4b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:42.221943 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1da35c-79f2-45bc-80bb-7728027cfa4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:42.281414 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-ba1da35c-79f2-45bc-80bb-7728027cfa4b None None] MFA Rules not processed for user `840f12fbf2f14f3cbd4f58569695e64f`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:42.282914 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ba1da35c-79f2-45bc-80bb-7728027cfa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:42.324568 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc135d42-47f7-4f7f-ab53-cf5672c0be33 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:42.331846 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88253d-1c4a-4e54-8a7e-d751e6ac2056 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:42.332133 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88253d-1c4a-4e54-8a7e-d751e6ac2056 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:42.332411 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88253d-1c4a-4e54-8a7e-d751e6ac2056 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:42.332735 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88253d-1c4a-4e54-8a7e-d751e6ac2056 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:42.335531 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-cd88253d-1c4a-4e54-8a7e-d751e6ac2056 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:42.351705 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88253d-1c4a-4e54-8a7e-d751e6ac2056 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:42.353615 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88253d-1c4a-4e54-8a7e-d751e6ac2056 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:42.371579 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 966/1914] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:42.372464 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88253d-1c4a-4e54-8a7e-d751e6ac2056 service nova] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:42.374302 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-cd88253d-1c4a-4e54-8a7e-d751e6ac2056 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:42.400908 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:42.428153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 949/1915] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:42.439401 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1da35c-79f2-45bc-80bb-7728027cfa4b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:42.440871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ba1da35c-79f2-45bc-80bb-7728027cfa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:42.473503 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88253d-1c4a-4e54-8a7e-d751e6ac2056 service nova] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:42.491093 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b67db-3406-440d-9d85-e1052b72bb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:42.492062 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b67db-3406-440d-9d85-e1052b72bb61 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:42.492440 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b67db-3406-440d-9d85-e1052b72bb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:42.494498 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b67db-3406-440d-9d85-e1052b72bb61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:42.494498 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b67db-3406-440d-9d85-e1052b72bb61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:42.495781 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b67db-3406-440d-9d85-e1052b72bb61 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:42.512338 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1da35c-79f2-45bc-80bb-7728027cfa4b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:42.516960 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740280af-f85a-4f69-9feb-008977292d7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:42.517864 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740280af-f85a-4f69-9feb-008977292d7b service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:42.518293 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740280af-f85a-4f69-9feb-008977292d7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:42.518750 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740280af-f85a-4f69-9feb-008977292d7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:42.530601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740280af-f85a-4f69-9feb-008977292d7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:42.532727 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740280af-f85a-4f69-9feb-008977292d7b service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:42.534836 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 967/1916] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:42 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:42.539440 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b67db-3406-440d-9d85-e1052b72bb61 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:42.544866 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 950/1917] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 05:56:42.556640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:42.607168 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740280af-f85a-4f69-9feb-008977292d7b service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:42.608738 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-740280af-f85a-4f69-9feb-008977292d7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:42.620473 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b67db-3406-440d-9d85-e1052b72bb61 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:42.623546 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740280af-f85a-4f69-9feb-008977292d7b service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:42.625676 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056e8c2-e8c4-4160-be2f-e6e69315bea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:42.626499 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056e8c2-e8c4-4160-be2f-e6e69315bea3 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:42.626930 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056e8c2-e8c4-4160-be2f-e6e69315bea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:42.627336 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056e8c2-e8c4-4160-be2f-e6e69315bea3 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:42.628111 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056e8c2-e8c4-4160-be2f-e6e69315bea3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:42.630129 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056e8c2-e8c4-4160-be2f-e6e69315bea3 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:42.707710 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 968/1918] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:42 2022] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 05:56:42.709462 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056e8c2-e8c4-4160-be2f-e6e69315bea3 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:42.712856 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0056e8c2-e8c4-4160-be2f-e6e69315bea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:42.725505 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056e8c2-e8c4-4160-be2f-e6e69315bea3 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:42.730275 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6a5d3-9f34-40f2-83cd-995b127ad1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:42.731164 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6a5d3-9f34-40f2-83cd-995b127ad1c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:42.731478 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6a5d3-9f34-40f2-83cd-995b127ad1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:42.731754 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6a5d3-9f34-40f2-83cd-995b127ad1c7 admin admin] PATH_INFO: `/v3/projects/5037290f8c3c45dbb246031fdf2f3bb6` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:42.733265 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6a5d3-9f34-40f2-83cd-995b127ad1c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5037290f8c3c45dbb246031fdf2f3bb6)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:42.735589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6a5d3-9f34-40f2-83cd-995b127ad1c7 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:42.736971 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee326b-ec5e-45a6-91e7-f4e508e26f99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:42.743497 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee326b-ec5e-45a6-91e7-f4e508e26f99 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:42.746805 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee326b-ec5e-45a6-91e7-f4e508e26f99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:42.747122 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee326b-ec5e-45a6-91e7-f4e508e26f99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:42.754954 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-50ee326b-ec5e-45a6-91e7-f4e508e26f99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:42.830798 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee326b-ec5e-45a6-91e7-f4e508e26f99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:42.832252 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee326b-ec5e-45a6-91e7-f4e508e26f99 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:42.840920 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-43c6a5d3-9f34-40f2-83cd-995b127ad1c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5037290f8c3c45dbb246031fdf2f3bb6', 'request_id': 'req-43c6a5d3-9f34-40f2-83cd-995b127ad1c7'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:42.841495 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 951/1919] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 05:56:42.842287 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee326b-ec5e-45a6-91e7-f4e508e26f99 service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:42.847983 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-43c6a5d3-9f34-40f2-83cd-995b127ad1c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5037290f8c3c45dbb246031fdf2f3bb6', 'request_id': 'req-43c6a5d3-9f34-40f2-83cd-995b127ad1c7'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:42.857718 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee326b-ec5e-45a6-91e7-f4e508e26f99 service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:42.865315 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-43c6a5d3-9f34-40f2-83cd-995b127ad1c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5037290f8c3c45dbb246031fdf2f3bb6', 'request_id': 'req-43c6a5d3-9f34-40f2-83cd-995b127ad1c7'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:42.880081 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-43c6a5d3-9f34-40f2-83cd-995b127ad1c7 admin admin] The token cache is being invalidate because project 5037290f8c3c45dbb246031fdf2f3bb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:56:42.880283 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-43c6a5d3-9f34-40f2-83cd-995b127ad1c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:42.881428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-43c6a5d3-9f34-40f2-83cd-995b127ad1c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:42.883464 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 969/1920] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:56:42 2022] DELETE /identity/v3/projects/5037290f8c3c45dbb246031fdf2f3bb6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:42.888687 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b7a3b-e74d-4686-9267-9f67d0a4c8a7 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:42.888990 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b7a3b-e74d-4686-9267-9f67d0a4c8a7 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:42.889866 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b7a3b-e74d-4686-9267-9f67d0a4c8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:42.924642 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:42.925444 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-076b7a3b-e74d-4686-9267-9f67d0a4c8a7 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:42.927746 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-076b7a3b-e74d-4686-9267-9f67d0a4c8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:42.958284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58e64c-fef3-4d6a-a926-6cde27f8f53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:42.958983 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58e64c-fef3-4d6a-a926-6cde27f8f53c admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:42.959291 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58e64c-fef3-4d6a-a926-6cde27f8f53c admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:42.959567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58e64c-fef3-4d6a-a926-6cde27f8f53c admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:42.960303 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e58e64c-fef3-4d6a-a926-6cde27f8f53c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:42.966399 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e58e64c-fef3-4d6a-a926-6cde27f8f53c admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:42.989762 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 952/1921] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:42.990886 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58e64c-fef3-4d6a-a926-6cde27f8f53c admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:42.994896 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-4e58e64c-fef3-4d6a-a926-6cde27f8f53c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:43.016403 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 970/1922] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:56:43.018112 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb9196-40c7-4042-a99b-d19f755367d6 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:43.018405 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb9196-40c7-4042-a99b-d19f755367d6 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:43.018681 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb9196-40c7-4042-a99b-d19f755367d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:43.048249 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-0bdb9196-40c7-4042-a99b-d19f755367d6 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:43.048583 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58e64c-fef3-4d6a-a926-6cde27f8f53c admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:43.049976 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0bdb9196-40c7-4042-a99b-d19f755367d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:43.063272 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 971/1923] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:43.064203 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb9196-40c7-4042-a99b-d19f755367d6 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:43.069939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce35210-e2ff-4778-a0c1-ff67d2a44208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:43.070869 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce35210-e2ff-4778-a0c1-ff67d2a44208 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:43.071151 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce35210-e2ff-4778-a0c1-ff67d2a44208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:43.071454 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce35210-e2ff-4778-a0c1-ff67d2a44208 admin admin] PATH_INFO: `/v3/projects/c078d8b7b8234cbab81490b474acdb83/users/a7b78d61a627414aa1d25f9e78d80b63/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:43.074979 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb9196-40c7-4042-a99b-d19f755367d6 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:43.081508 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7eb9ab-bb90-4203-8e6a-e9fd3d4b0ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:43.082233 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7eb9ab-bb90-4203-8e6a-e9fd3d4b0ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:43.082652 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7eb9ab-bb90-4203-8e6a-e9fd3d4b0ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:43.082956 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7eb9ab-bb90-4203-8e6a-e9fd3d4b0ec9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:43.083782 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7eb9ab-bb90-4203-8e6a-e9fd3d4b0ec9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:56:43.084085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7eb9ab-bb90-4203-8e6a-e9fd3d4b0ec9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:43.086891 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7eb9ab-bb90-4203-8e6a-e9fd3d4b0ec9 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:43.112088 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 972/1924] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:56:43.116420 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7eb9ab-bb90-4203-8e6a-e9fd3d4b0ec9 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:43.120281 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce35210-e2ff-4778-a0c1-ff67d2a44208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c078d8b7b8234cbab81490b474acdb83, user_id=a7b78d61a627414aa1d25f9e78d80b63, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:43.122994 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce35210-e2ff-4778-a0c1-ff67d2a44208 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:43.126555 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7eb9ab-bb90-4203-8e6a-e9fd3d4b0ec9 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:43.131665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa24ce-7f7d-49ab-a1a2-ff13d74fa569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:43.132340 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa24ce-7f7d-49ab-a1a2-ff13d74fa569 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:43.132623 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa24ce-7f7d-49ab-a1a2-ff13d74fa569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:43.132897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa24ce-7f7d-49ab-a1a2-ff13d74fa569 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:43.133592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa24ce-7f7d-49ab-a1a2-ff13d74fa569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:43.136834 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa24ce-7f7d-49ab-a1a2-ff13d74fa569 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:43.140876 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:43.179881 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 973/1925] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:43 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:43.180533 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 953/1926] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:42 2022] PUT /identity/v3/projects/c078d8b7b8234cbab81490b474acdb83/users/a7b78d61a627414aa1d25f9e78d80b63/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:43.183823 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa24ce-7f7d-49ab-a1a2-ff13d74fa569 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:43.184042 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce35210-e2ff-4778-a0c1-ff67d2a44208 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:43.321831 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce35210-e2ff-4778-a0c1-ff67d2a44208 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:43.329452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa24ce-7f7d-49ab-a1a2-ff13d74fa569 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:43.331519 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f705489-0327-4d55-9539-dd0cda24a13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:43.332221 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f705489-0327-4d55-9539-dd0cda24a13e admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:43.332499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f705489-0327-4d55-9539-dd0cda24a13e admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:43.332773 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f705489-0327-4d55-9539-dd0cda24a13e admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:43.341891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f705489-0327-4d55-9539-dd0cda24a13e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:43.344122 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f705489-0327-4d55-9539-dd0cda24a13e admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:43.347063 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a2e65-c444-4148-a4bf-622518de69d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:43.347799 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a2e65-c444-4148-a4bf-622518de69d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:43.348082 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a2e65-c444-4148-a4bf-622518de69d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:43.348360 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a2e65-c444-4148-a4bf-622518de69d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:43.349066 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a2e65-c444-4148-a4bf-622518de69d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:43.354149 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a2e65-c444-4148-a4bf-622518de69d7 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:43.358638 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 954/1927] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:43.363698 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f705489-0327-4d55-9539-dd0cda24a13e admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:43.382820 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f705489-0327-4d55-9539-dd0cda24a13e admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:43.409083 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbca7c9-2ffe-4b2c-a1dc-bdb19aab36cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:43.411293 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbca7c9-2ffe-4b2c-a1dc-bdb19aab36cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:43.413299 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 974/1928] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:43 2022] POST /identity/v3/users => generated 290 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:43.415356 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbca7c9-2ffe-4b2c-a1dc-bdb19aab36cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:43.416011 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbca7c9-2ffe-4b2c-a1dc-bdb19aab36cf admin admin] PATH_INFO: `/v3/projects/c078d8b7b8234cbab81490b474acdb83/users/a7b78d61a627414aa1d25f9e78d80b63/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:43.418568 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a2e65-c444-4148-a4bf-622518de69d7 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:43.441050 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a2e65-c444-4148-a4bf-622518de69d7 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:43.447101 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bcab1-9b52-4d53-84c3-f6a0ff4c2a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:43.448845 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbca7c9-2ffe-4b2c-a1dc-bdb19aab36cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c078d8b7b8234cbab81490b474acdb83, user_id=a7b78d61a627414aa1d25f9e78d80b63, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:43.449276 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bcab1-9b52-4d53-84c3-f6a0ff4c2a66 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:43.449755 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bcab1-9b52-4d53-84c3-f6a0ff4c2a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:43.450521 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bcab1-9b52-4d53-84c3-f6a0ff4c2a66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:43.451977 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbca7c9-2ffe-4b2c-a1dc-bdb19aab36cf admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:43.452589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1bcab1-9b52-4d53-84c3-f6a0ff4c2a66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:43.455086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1bcab1-9b52-4d53-84c3-f6a0ff4c2a66 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:43.474579 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 975/1929] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:43.479695 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bcab1-9b52-4d53-84c3-f6a0ff4c2a66 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:43.507444 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 955/1930] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:43 2022] PUT /identity/v3/projects/c078d8b7b8234cbab81490b474acdb83/users/a7b78d61a627414aa1d25f9e78d80b63/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:43.519743 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bcab1-9b52-4d53-84c3-f6a0ff4c2a66 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:43.520721 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37205fe4-1523-4783-b7c9-a7be32108879 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:43.521022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37205fe4-1523-4783-b7c9-a7be32108879 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:43.522304 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37205fe4-1523-4783-b7c9-a7be32108879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:43.585165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-37205fe4-1523-4783-b7c9-a7be32108879 None None] MFA Rules not processed for user `a7b78d61a627414aa1d25f9e78d80b63`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:43.586808 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-37205fe4-1523-4783-b7c9-a7be32108879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:43.667026 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fe093-eb1e-4d82-bf32-928205e340bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:43.670166 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fe093-eb1e-4d82-bf32-928205e340bb admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:43.670460 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fe093-eb1e-4d82-bf32-928205e340bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:43.670756 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fe093-eb1e-4d82-bf32-928205e340bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:43.672743 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543fe093-eb1e-4d82-bf32-928205e340bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:43.676466 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543fe093-eb1e-4d82-bf32-928205e340bb admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:43.689815 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 976/1931] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:43.695976 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fe093-eb1e-4d82-bf32-928205e340bb admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:43.721560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fe093-eb1e-4d82-bf32-928205e340bb admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:43.735094 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564237a-f6ce-431a-885b-e5a94b3eed4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:43.737565 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564237a-f6ce-431a-885b-e5a94b3eed4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:43.737857 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564237a-f6ce-431a-885b-e5a94b3eed4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:43.738124 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564237a-f6ce-431a-885b-e5a94b3eed4c admin admin] PATH_INFO: `/v3/projects/95d69fd4f7b24ef28f99339dda3264de/users/f63c7168fcd949edbe076d6973632f63/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:43.774648 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 956/1932] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:43.794395 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37205fe4-1523-4783-b7c9-a7be32108879 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:43.796456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564237a-f6ce-431a-885b-e5a94b3eed4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=95d69fd4f7b24ef28f99339dda3264de, user_id=f63c7168fcd949edbe076d6973632f63, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:43.798400 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-37205fe4-1523-4783-b7c9-a7be32108879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:43.803034 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564237a-f6ce-431a-885b-e5a94b3eed4c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:43.835244 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 977/1933] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:43 2022] PUT /identity/v3/projects/95d69fd4f7b24ef28f99339dda3264de/users/f63c7168fcd949edbe076d6973632f63/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:43.841877 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553365ef-471c-4c6f-96c0-2b02e22fd802 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:43.842447 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553365ef-471c-4c6f-96c0-2b02e22fd802 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:43.842566 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553365ef-471c-4c6f-96c0-2b02e22fd802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:43.898944 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:43.911499 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-553365ef-471c-4c6f-96c0-2b02e22fd802 None None] MFA Rules not processed for user `f63c7168fcd949edbe076d6973632f63`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:43.915578 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-553365ef-471c-4c6f-96c0-2b02e22fd802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:43.958672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37205fe4-1523-4783-b7c9-a7be32108879 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:43.967918 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:44.029447 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd6502-7f4f-44d5-a1ac-fe4def88a6f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:44.030357 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd6502-7f4f-44d5-a1ac-fe4def88a6f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:44.030877 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd6502-7f4f-44d5-a1ac-fe4def88a6f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:44.031237 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd6502-7f4f-44d5-a1ac-fe4def88a6f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:44.059439 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 978/1934] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:44.064740 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553365ef-471c-4c6f-96c0-2b02e22fd802 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:44.109283 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd6502-7f4f-44d5-a1ac-fe4def88a6f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:44.111703 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd6502-7f4f-44d5-a1ac-fe4def88a6f9 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:44.133998 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 957/1935] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:44.153710 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553365ef-471c-4c6f-96c0-2b02e22fd802 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:44.155651 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd6502-7f4f-44d5-a1ac-fe4def88a6f9 service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:44.162371 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3c72e-88df-4c35-b59d-368c6b7673ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:44.163446 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3c72e-88df-4c35-b59d-368c6b7673ca admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:44.163888 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3c72e-88df-4c35-b59d-368c6b7673ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:44.164884 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3c72e-88df-4c35-b59d-368c6b7673ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:44.165798 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3c72e-88df-4c35-b59d-368c6b7673ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:44.168345 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3c72e-88df-4c35-b59d-368c6b7673ca admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:44.168992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd6502-7f4f-44d5-a1ac-fe4def88a6f9 service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:44.174429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea172fd-14f6-47f9-93c3-51ecb9f84e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:44.175383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea172fd-14f6-47f9-93c3-51ecb9f84e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:44.175670 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea172fd-14f6-47f9-93c3-51ecb9f84e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:44.175949 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea172fd-14f6-47f9-93c3-51ecb9f84e12 admin admin] PATH_INFO: `/v3/users/ad3945e2f0c74e429a2ba6463bae5125` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:44.177201 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea172fd-14f6-47f9-93c3-51ecb9f84e12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad3945e2f0c74e429a2ba6463bae5125)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:44.179327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea172fd-14f6-47f9-93c3-51ecb9f84e12 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:44.204353 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 979/1936] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:44 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 05:56:44.205477 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3c72e-88df-4c35-b59d-368c6b7673ca admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:44.240008 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-9ea172fd-14f6-47f9-93c3-51ecb9f84e12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad3945e2f0c74e429a2ba6463bae5125'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:44.240743 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-9ea172fd-14f6-47f9-93c3-51ecb9f84e12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad3945e2f0c74e429a2ba6463bae5125'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:44.249221 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-9ea172fd-14f6-47f9-93c3-51ecb9f84e12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad3945e2f0c74e429a2ba6463bae5125'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:44.250290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-9ea172fd-14f6-47f9-93c3-51ecb9f84e12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad3945e2f0c74e429a2ba6463bae5125'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:44.264464 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-9ea172fd-14f6-47f9-93c3-51ecb9f84e12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad3945e2f0c74e429a2ba6463bae5125'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:44.275110 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3c72e-88df-4c35-b59d-368c6b7673ca admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:44.278727 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 958/1937] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:56:44 2022] DELETE /identity/v3/users/ad3945e2f0c74e429a2ba6463bae5125 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 05:56:44.281696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd9ed2-b2c4-492e-abf1-282137194a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:44.281696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd9ed2-b2c4-492e-abf1-282137194a21 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:44.281696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd9ed2-b2c4-492e-abf1-282137194a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:44.281696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd9ed2-b2c4-492e-abf1-282137194a21 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:44.282250 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd9ed2-b2c4-492e-abf1-282137194a21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:44.283126 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3e7b2-5e3f-4836-b4ad-0d54f4aad55b None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:44.283460 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3e7b2-5e3f-4836-b4ad-0d54f4aad55b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:44.283766 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3e7b2-5e3f-4836-b4ad-0d54f4aad55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:44.284345 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd9ed2-b2c4-492e-abf1-282137194a21 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:44.301871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-37a3e7b2-5e3f-4836-b4ad-0d54f4aad55b None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:44.303306 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-37a3e7b2-5e3f-4836-b4ad-0d54f4aad55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:44.307233 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 980/1938] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:44 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:44.307829 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:44.310027 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd9ed2-b2c4-492e-abf1-282137194a21 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:44.311749 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d7dd9ed2-b2c4-492e-abf1-282137194a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:44.323888 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd9ed2-b2c4-492e-abf1-282137194a21 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:44.370109 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 959/1939] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:56:44.370359 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:44.380307 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3e7b2-5e3f-4836-b4ad-0d54f4aad55b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:44.381847 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-37a3e7b2-5e3f-4836-b4ad-0d54f4aad55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:44.394849 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a837148-e125-446a-9c22-9c73603d09b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:44.395567 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a837148-e125-446a-9c22-9c73603d09b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:44.396037 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a837148-e125-446a-9c22-9c73603d09b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:44.396223 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a837148-e125-446a-9c22-9c73603d09b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:44.396927 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a837148-e125-446a-9c22-9c73603d09b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:44.398569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a837148-e125-446a-9c22-9c73603d09b6 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:44.409171 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 981/1940] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 05:56:44.413246 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a837148-e125-446a-9c22-9c73603d09b6 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:44.432023 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a837148-e125-446a-9c22-9c73603d09b6 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:44.437557 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56b85f-33bf-45dc-afcb-e103cc3c6187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:44.438451 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56b85f-33bf-45dc-afcb-e103cc3c6187 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:44.438729 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56b85f-33bf-45dc-afcb-e103cc3c6187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:44.438995 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56b85f-33bf-45dc-afcb-e103cc3c6187 admin admin] PATH_INFO: `/v3/projects/6871b91de9c74be3af792c7028efc60a/users/6d9107d1c6984572a5bd7b918fbf8bb0/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:44.452326 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3e7b2-5e3f-4836-b4ad-0d54f4aad55b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:44.456523 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5a45f-1ab5-4e19-884f-1eca1ebdd932 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:44.457301 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5a45f-1ab5-4e19-884f-1eca1ebdd932 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:44.457586 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5a45f-1ab5-4e19-884f-1eca1ebdd932 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:44.457866 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5a45f-1ab5-4e19-884f-1eca1ebdd932 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:44.470345 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56b85f-33bf-45dc-afcb-e103cc3c6187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6871b91de9c74be3af792c7028efc60a, user_id=6d9107d1c6984572a5bd7b918fbf8bb0, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:44.470772 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe5a45f-1ab5-4e19-884f-1eca1ebdd932 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:44.473098 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe5a45f-1ab5-4e19-884f-1eca1ebdd932 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:44.473268 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56b85f-33bf-45dc-afcb-e103cc3c6187 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:44.487104 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 960/1941] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:44.489345 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 982/1942] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:44 2022] PUT /identity/v3/projects/6871b91de9c74be3af792c7028efc60a/users/6d9107d1c6984572a5bd7b918fbf8bb0/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 05:56:44.495509 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5a45f-1ab5-4e19-884f-1eca1ebdd932 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:44.504878 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5a45f-1ab5-4e19-884f-1eca1ebdd932 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:44.598626 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897834c-0d88-4b41-8856-65e83cefd9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:44.599740 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897834c-0d88-4b41-8856-65e83cefd9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:44.600124 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897834c-0d88-4b41-8856-65e83cefd9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:44.600496 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897834c-0d88-4b41-8856-65e83cefd9a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:44.601378 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897834c-0d88-4b41-8856-65e83cefd9a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:44.603995 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897834c-0d88-4b41-8856-65e83cefd9a6 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:44.620513 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 961/1943] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:44.624938 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56b85f-33bf-45dc-afcb-e103cc3c6187 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:44.661366 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56b85f-33bf-45dc-afcb-e103cc3c6187 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:44.669673 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb682a6-df8e-494f-9d99-5073eb61b0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:44.670645 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb682a6-df8e-494f-9d99-5073eb61b0f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:44.670931 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb682a6-df8e-494f-9d99-5073eb61b0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:44.671216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb682a6-df8e-494f-9d99-5073eb61b0f1 admin admin] PATH_INFO: `/v3/projects/6871b91de9c74be3af792c7028efc60a/users/6d9107d1c6984572a5bd7b918fbf8bb0/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:44.674298 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb682a6-df8e-494f-9d99-5073eb61b0f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6871b91de9c74be3af792c7028efc60a, user_id=6d9107d1c6984572a5bd7b918fbf8bb0, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:44.677459 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb682a6-df8e-494f-9d99-5073eb61b0f1 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:44.695322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 983/1944] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:44 2022] PUT /identity/v3/projects/6871b91de9c74be3af792c7028efc60a/users/6d9107d1c6984572a5bd7b918fbf8bb0/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:44.705644 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d5cf2-3c03-4afc-a9bf-e9e7c681cbf0 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:44.706127 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d5cf2-3c03-4afc-a9bf-e9e7c681cbf0 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:44.706222 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d5cf2-3c03-4afc-a9bf-e9e7c681cbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:44.760523 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-9f0d5cf2-3c03-4afc-a9bf-e9e7c681cbf0 None None] MFA Rules not processed for user `6d9107d1c6984572a5bd7b918fbf8bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:44.761779 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9f0d5cf2-3c03-4afc-a9bf-e9e7c681cbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:44.835601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:44.906219 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 962/1945] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:44.918629 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb682a6-df8e-494f-9d99-5073eb61b0f1 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:44.920645 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9fb682a6-df8e-494f-9d99-5073eb61b0f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:45.027532 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb682a6-df8e-494f-9d99-5073eb61b0f1 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:45.037670 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174765b7-dd0b-45af-ac3d-df71daec6311 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:45.039736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174765b7-dd0b-45af-ac3d-df71daec6311 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:45.040257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174765b7-dd0b-45af-ac3d-df71daec6311 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:45.040704 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174765b7-dd0b-45af-ac3d-df71daec6311 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:45.055056 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174765b7-dd0b-45af-ac3d-df71daec6311 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:45.057213 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174765b7-dd0b-45af-ac3d-df71daec6311 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:45.079484 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d5cf2-3c03-4afc-a9bf-e9e7c681cbf0 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:45.081430 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9f0d5cf2-3c03-4afc-a9bf-e9e7c681cbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:45.093514 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 984/1946] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:45.225304 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d5cf2-3c03-4afc-a9bf-e9e7c681cbf0 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:45.233056 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ca191-1a04-4704-9add-b17d6a501af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:45.234473 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ca191-1a04-4704-9add-b17d6a501af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:45.234938 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ca191-1a04-4704-9add-b17d6a501af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:45.235682 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ca191-1a04-4704-9add-b17d6a501af7 admin admin] PATH_INFO: `/v3/projects/803942133a9a41a1945b9a2da9f60eb0` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:45.238280 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ca191-1a04-4704-9add-b17d6a501af7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=803942133a9a41a1945b9a2da9f60eb0)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:45.240761 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ca191-1a04-4704-9add-b17d6a501af7 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:45.303872 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d84ca191-1a04-4704-9add-b17d6a501af7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '803942133a9a41a1945b9a2da9f60eb0', 'request_id': 'req-d84ca191-1a04-4704-9add-b17d6a501af7'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:45.322288 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d84ca191-1a04-4704-9add-b17d6a501af7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '803942133a9a41a1945b9a2da9f60eb0', 'request_id': 'req-d84ca191-1a04-4704-9add-b17d6a501af7'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:45.336103 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d84ca191-1a04-4704-9add-b17d6a501af7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '803942133a9a41a1945b9a2da9f60eb0', 'request_id': 'req-d84ca191-1a04-4704-9add-b17d6a501af7'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:45.357667 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d84ca191-1a04-4704-9add-b17d6a501af7 admin admin] The token cache is being invalidate because project 803942133a9a41a1945b9a2da9f60eb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:56:45.357983 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d84ca191-1a04-4704-9add-b17d6a501af7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:45.358747 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-d84ca191-1a04-4704-9add-b17d6a501af7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:45.363254 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 963/1947] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:56:45 2022] DELETE /identity/v3/projects/803942133a9a41a1945b9a2da9f60eb0 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 05:56:45.367358 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174765b7-dd0b-45af-ac3d-df71daec6311 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:45.385735 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174765b7-dd0b-45af-ac3d-df71daec6311 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:45.473996 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46450c-6414-4d11-87db-a4249c7505e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:45.474787 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46450c-6414-4d11-87db-a4249c7505e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:45.475245 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46450c-6414-4d11-87db-a4249c7505e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:45.475883 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46450c-6414-4d11-87db-a4249c7505e4 admin admin] PATH_INFO: `/v3/users/a7b78d61a627414aa1d25f9e78d80b63` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:45.477507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46450c-6414-4d11-87db-a4249c7505e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7b78d61a627414aa1d25f9e78d80b63)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:45.480025 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46450c-6414-4d11-87db-a4249c7505e4 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:45.570890 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:45.573608 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9e46450c-6414-4d11-87db-a4249c7505e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7b78d61a627414aa1d25f9e78d80b63'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:45.587044 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9e46450c-6414-4d11-87db-a4249c7505e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7b78d61a627414aa1d25f9e78d80b63'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:45.603320 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9e46450c-6414-4d11-87db-a4249c7505e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7b78d61a627414aa1d25f9e78d80b63'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:45.605165 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9e46450c-6414-4d11-87db-a4249c7505e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7b78d61a627414aa1d25f9e78d80b63'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:45.627983 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9e46450c-6414-4d11-87db-a4249c7505e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7b78d61a627414aa1d25f9e78d80b63'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:45.635795 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 985/1948] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:56:45 2022] DELETE /identity/v3/users/a7b78d61a627414aa1d25f9e78d80b63 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:45.702279 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ca191-1a04-4704-9add-b17d6a501af7 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:45.704225 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d84ca191-1a04-4704-9add-b17d6a501af7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:45.718235 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ca191-1a04-4704-9add-b17d6a501af7 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:45.786390 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4a286-1a08-4ec3-8add-ab8379b03e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:45.787346 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4a286-1a08-4ec3-8add-ab8379b03e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:45.787676 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4a286-1a08-4ec3-8add-ab8379b03e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:45.787945 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4a286-1a08-4ec3-8add-ab8379b03e6f admin admin] PATH_INFO: `/v3/users/f63c7168fcd949edbe076d6973632f63` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:45.789169 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4a286-1a08-4ec3-8add-ab8379b03e6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f63c7168fcd949edbe076d6973632f63)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:45.791113 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4a286-1a08-4ec3-8add-ab8379b03e6f admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:45.796461 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:45.861628 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-a8f4a286-1a08-4ec3-8add-ab8379b03e6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f63c7168fcd949edbe076d6973632f63'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:45.862291 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-a8f4a286-1a08-4ec3-8add-ab8379b03e6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f63c7168fcd949edbe076d6973632f63'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:45.870551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-a8f4a286-1a08-4ec3-8add-ab8379b03e6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f63c7168fcd949edbe076d6973632f63'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:45.871176 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-a8f4a286-1a08-4ec3-8add-ab8379b03e6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f63c7168fcd949edbe076d6973632f63'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:45.885021 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-a8f4a286-1a08-4ec3-8add-ab8379b03e6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f63c7168fcd949edbe076d6973632f63'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:45.898481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 964/1949] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:56:45 2022] DELETE /identity/v3/users/f63c7168fcd949edbe076d6973632f63 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:45.902916 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f44346-83cc-48c5-8d1f-f229db9ea045 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:45.903225 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f44346-83cc-48c5-8d1f-f229db9ea045 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:45.903509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f44346-83cc-48c5-8d1f-f229db9ea045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:45.926435 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-09f44346-83cc-48c5-8d1f-f229db9ea045 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:45.927680 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-09f44346-83cc-48c5-8d1f-f229db9ea045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:45.942385 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4a286-1a08-4ec3-8add-ab8379b03e6f admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:45.944546 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-a8f4a286-1a08-4ec3-8add-ab8379b03e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:46.000778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 986/1950] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:46.009783 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f44346-83cc-48c5-8d1f-f229db9ea045 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:46.010324 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-09f44346-83cc-48c5-8d1f-f229db9ea045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:46.025311 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4a286-1a08-4ec3-8add-ab8379b03e6f admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:46.030884 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee126fc-feb0-4df6-8a26-6c113a6b7036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:46.031817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee126fc-feb0-4df6-8a26-6c113a6b7036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:46.032097 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee126fc-feb0-4df6-8a26-6c113a6b7036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:46.032371 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee126fc-feb0-4df6-8a26-6c113a6b7036 admin admin] PATH_INFO: `/v3/projects/c078d8b7b8234cbab81490b474acdb83` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:46.034363 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee126fc-feb0-4df6-8a26-6c113a6b7036 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c078d8b7b8234cbab81490b474acdb83)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:46.036523 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee126fc-feb0-4df6-8a26-6c113a6b7036 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:46.093189 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f44346-83cc-48c5-8d1f-f229db9ea045 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:46.101912 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-5ee126fc-feb0-4df6-8a26-6c113a6b7036 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c078d8b7b8234cbab81490b474acdb83', 'request_id': 'req-5ee126fc-feb0-4df6-8a26-6c113a6b7036'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:46.113726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-5ee126fc-feb0-4df6-8a26-6c113a6b7036 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c078d8b7b8234cbab81490b474acdb83', 'request_id': 'req-5ee126fc-feb0-4df6-8a26-6c113a6b7036'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:46.122489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-5ee126fc-feb0-4df6-8a26-6c113a6b7036 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c078d8b7b8234cbab81490b474acdb83', 'request_id': 'req-5ee126fc-feb0-4df6-8a26-6c113a6b7036'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:46.155238 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-5ee126fc-feb0-4df6-8a26-6c113a6b7036 admin admin] The token cache is being invalidate because project c078d8b7b8234cbab81490b474acdb83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:56:46.155923 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-5ee126fc-feb0-4df6-8a26-6c113a6b7036 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:46.156775 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-5ee126fc-feb0-4df6-8a26-6c113a6b7036 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:46.158629 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 965/1951] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:56:45 2022] DELETE /identity/v3/projects/c078d8b7b8234cbab81490b474acdb83 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 05:56:46.164235 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2fa49-81c2-4fcd-8154-e946749ba874 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:46.165205 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2fa49-81c2-4fcd-8154-e946749ba874 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:46.165884 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2fa49-81c2-4fcd-8154-e946749ba874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:46.190623 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-dbb2fa49-81c2-4fcd-8154-e946749ba874 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:46.191940 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-dbb2fa49-81c2-4fcd-8154-e946749ba874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:46.198338 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f7fbab-7099-4270-b6e2-5f22ee01a7d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:46.199694 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7fbab-7099-4270-b6e2-5f22ee01a7d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:46.200168 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7fbab-7099-4270-b6e2-5f22ee01a7d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:46.200628 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7fbab-7099-4270-b6e2-5f22ee01a7d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:46.204642 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-90f7fbab-7099-4270-b6e2-5f22ee01a7d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:46.212215 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:46.303964 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:46.305674 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 966/1952] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:46.314421 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3101d7-3f3c-4810-835b-a8cb7709b6c8 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:46.315347 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3101d7-3f3c-4810-835b-a8cb7709b6c8 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:46.315628 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3101d7-3f3c-4810-835b-a8cb7709b6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:46.369663 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-df3101d7-3f3c-4810-835b-a8cb7709b6c8 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:46.370786 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-df3101d7-3f3c-4810-835b-a8cb7709b6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:46.385390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f7fbab-7099-4270-b6e2-5f22ee01a7d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:46.388017 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f7fbab-7099-4270-b6e2-5f22ee01a7d3 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:46.390338 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 967/1953] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:46.395769 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3101d7-3f3c-4810-835b-a8cb7709b6c8 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:46.418108 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3101d7-3f3c-4810-835b-a8cb7709b6c8 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:46.422661 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 987/1954] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 05:56:46.423831 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f7fbab-7099-4270-b6e2-5f22ee01a7d3 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:46.426137 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-90f7fbab-7099-4270-b6e2-5f22ee01a7d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:46.429044 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d35ed-bfb1-46fd-a643-90aa64567eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:46.430187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d35ed-bfb1-46fd-a643-90aa64567eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:46.430617 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d35ed-bfb1-46fd-a643-90aa64567eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:46.431045 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d35ed-bfb1-46fd-a643-90aa64567eb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:46.431930 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d35ed-bfb1-46fd-a643-90aa64567eb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:56:46.432332 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d35ed-bfb1-46fd-a643-90aa64567eb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:46.434487 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d35ed-bfb1-46fd-a643-90aa64567eb0 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:46.455775 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 968/1955] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:56:46.457366 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d35ed-bfb1-46fd-a643-90aa64567eb0 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:46.460548 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f7fbab-7099-4270-b6e2-5f22ee01a7d3 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:46.469795 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d35ed-bfb1-46fd-a643-90aa64567eb0 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:46.471641 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431fb575-13d5-441b-9286-67eb6c0153d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:46.473378 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fb575-13d5-441b-9286-67eb6c0153d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:46.473762 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fb575-13d5-441b-9286-67eb6c0153d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:46.474053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fb575-13d5-441b-9286-67eb6c0153d7 admin admin] PATH_INFO: `/v3/users/80814b29111547148e5820e94d13b4c2` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:46.476658 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8858b19-7832-46e5-bc4d-8570874ef330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:46.477306 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431fb575-13d5-441b-9286-67eb6c0153d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80814b29111547148e5820e94d13b4c2)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:46.478135 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8858b19-7832-46e5-bc4d-8570874ef330 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:46.479660 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431fb575-13d5-441b-9286-67eb6c0153d7 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:46.479777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8858b19-7832-46e5-bc4d-8570874ef330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:46.479777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8858b19-7832-46e5-bc4d-8570874ef330 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:46.482574 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8858b19-7832-46e5-bc4d-8570874ef330 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:46.483324 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8858b19-7832-46e5-bc4d-8570874ef330 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:46.536480 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 969/1956] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:46 2022] POST /identity/v3/projects => generated 367 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:46.543711 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8858b19-7832-46e5-bc4d-8570874ef330 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:46.584135 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-431fb575-13d5-441b-9286-67eb6c0153d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80814b29111547148e5820e94d13b4c2'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:46.595516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-431fb575-13d5-441b-9286-67eb6c0153d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80814b29111547148e5820e94d13b4c2'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:46.613246 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-431fb575-13d5-441b-9286-67eb6c0153d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80814b29111547148e5820e94d13b4c2'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:46.614245 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-431fb575-13d5-441b-9286-67eb6c0153d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80814b29111547148e5820e94d13b4c2'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:46.647643 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-431fb575-13d5-441b-9286-67eb6c0153d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80814b29111547148e5820e94d13b4c2'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:46.668758 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 988/1957] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:56:46 2022] DELETE /identity/v3/users/80814b29111547148e5820e94d13b4c2 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:46.673061 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8858b19-7832-46e5-bc4d-8570874ef330 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:46.677295 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01eb96-e146-4fe6-90bc-0c04baa6c748 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:46.677683 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01eb96-e146-4fe6-90bc-0c04baa6c748 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:46.678007 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01eb96-e146-4fe6-90bc-0c04baa6c748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:46.721735 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-2d01eb96-e146-4fe6-90bc-0c04baa6c748 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:46.723919 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2d01eb96-e146-4fe6-90bc-0c04baa6c748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:46.797373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65637ca1-dcd4-46e7-9f23-cbe732e11326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:46.798119 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65637ca1-dcd4-46e7-9f23-cbe732e11326 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:46.798403 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65637ca1-dcd4-46e7-9f23-cbe732e11326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:46.798786 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65637ca1-dcd4-46e7-9f23-cbe732e11326 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:46.799625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65637ca1-dcd4-46e7-9f23-cbe732e11326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:46.802685 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65637ca1-dcd4-46e7-9f23-cbe732e11326 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:46.848021 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 970/1958] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:46 2022] POST /identity/v3/users => generated 284 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:46.852896 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65637ca1-dcd4-46e7-9f23-cbe732e11326 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:46.857696 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-65637ca1-dcd4-46e7-9f23-cbe732e11326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:46.892855 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 989/1959] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:46.901414 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01eb96-e146-4fe6-90bc-0c04baa6c748 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:46.903022 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2d01eb96-e146-4fe6-90bc-0c04baa6c748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:46.906684 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65637ca1-dcd4-46e7-9f23-cbe732e11326 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:46.927949 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94a842-c3e1-4209-8c71-c4abdaea96c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:46.928763 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94a842-c3e1-4209-8c71-c4abdaea96c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:46.929052 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94a842-c3e1-4209-8c71-c4abdaea96c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:46.929328 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94a842-c3e1-4209-8c71-c4abdaea96c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:46.930147 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94a842-c3e1-4209-8c71-c4abdaea96c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:46.937583 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94a842-c3e1-4209-8c71-c4abdaea96c3 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:46.941059 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:46.965117 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 971/1960] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:46.965117 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94a842-c3e1-4209-8c71-c4abdaea96c3 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:46.970657 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-7f94a842-c3e1-4209-8c71-c4abdaea96c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:46.978980 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:46.988402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94a842-c3e1-4209-8c71-c4abdaea96c3 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:46.994752 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59273c-8933-47d7-acc2-09bbd169a15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:46.995813 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59273c-8933-47d7-acc2-09bbd169a15d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:46.996054 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59273c-8933-47d7-acc2-09bbd169a15d admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:46.997229 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59273c-8933-47d7-acc2-09bbd169a15d admin admin] PATH_INFO: `/v3/users/3b83181703404e0696bfab83942ec98f` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:46.998235 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59273c-8933-47d7-acc2-09bbd169a15d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b83181703404e0696bfab83942ec98f)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:47.000729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59273c-8933-47d7-acc2-09bbd169a15d admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:47.001403 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01eb96-e146-4fe6-90bc-0c04baa6c748 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:47.006975 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a81b76-3cf4-4f4e-a607-73efbabbdd75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:47.008384 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a81b76-3cf4-4f4e-a607-73efbabbdd75 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:47.008792 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a81b76-3cf4-4f4e-a607-73efbabbdd75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:47.009144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a81b76-3cf4-4f4e-a607-73efbabbdd75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:47.022362 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a81b76-3cf4-4f4e-a607-73efbabbdd75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:47.024065 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a81b76-3cf4-4f4e-a607-73efbabbdd75 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:47.037766 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 990/1961] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 05:56:47.057565 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a81b76-3cf4-4f4e-a607-73efbabbdd75 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:47.059050 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-dd59273c-8933-47d7-acc2-09bbd169a15d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b83181703404e0696bfab83942ec98f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:47.060084 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-dd59273c-8933-47d7-acc2-09bbd169a15d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b83181703404e0696bfab83942ec98f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:47.071641 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a81b76-3cf4-4f4e-a607-73efbabbdd75 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:47.074668 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-dd59273c-8933-47d7-acc2-09bbd169a15d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b83181703404e0696bfab83942ec98f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:47.075641 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-dd59273c-8933-47d7-acc2-09bbd169a15d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b83181703404e0696bfab83942ec98f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:47.088856 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b50266-9202-424f-8c6a-eb72f3e54654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:47.092524 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b50266-9202-424f-8c6a-eb72f3e54654 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:47.092829 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b50266-9202-424f-8c6a-eb72f3e54654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:47.093334 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b50266-9202-424f-8c6a-eb72f3e54654 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:47.094204 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b50266-9202-424f-8c6a-eb72f3e54654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:47.096862 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b50266-9202-424f-8c6a-eb72f3e54654 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:47.110059 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-dd59273c-8933-47d7-acc2-09bbd169a15d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b83181703404e0696bfab83942ec98f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:47.120734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 991/1962] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:47.125664 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b50266-9202-424f-8c6a-eb72f3e54654 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:47.127754 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-49b50266-9202-424f-8c6a-eb72f3e54654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:47.132576 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 972/1963] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:56:46 2022] DELETE /identity/v3/users/3b83181703404e0696bfab83942ec98f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 05:56:47.137817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a027328-6c42-4174-a1cd-27196244447d None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:47.139740 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a027328-6c42-4174-a1cd-27196244447d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:47.142815 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a027328-6c42-4174-a1cd-27196244447d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:47.157133 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b50266-9202-424f-8c6a-eb72f3e54654 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:47.186125 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-9a027328-6c42-4174-a1cd-27196244447d None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:47.188173 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9a027328-6c42-4174-a1cd-27196244447d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:47.304366 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6faa9f-343e-487b-8ee2-712a8bcfe4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:47.307406 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6faa9f-343e-487b-8ee2-712a8bcfe4cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:47.307758 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6faa9f-343e-487b-8ee2-712a8bcfe4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:47.308016 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6faa9f-343e-487b-8ee2-712a8bcfe4cd admin admin] PATH_INFO: `/v3/projects/80f08d071f0c49fcb0be4006dd2bfbb2/users/0d7f039ac1394cc09bb77f15ce1f80cc/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:47.351443 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6faa9f-343e-487b-8ee2-712a8bcfe4cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=80f08d071f0c49fcb0be4006dd2bfbb2, user_id=0d7f039ac1394cc09bb77f15ce1f80cc, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:47.351564 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 973/1964] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:47.352402 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6faa9f-343e-487b-8ee2-712a8bcfe4cd admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:47.372553 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a027328-6c42-4174-a1cd-27196244447d None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:47.374046 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9a027328-6c42-4174-a1cd-27196244447d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:47.386533 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 992/1965] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:47 2022] PUT /identity/v3/projects/80f08d071f0c49fcb0be4006dd2bfbb2/users/0d7f039ac1394cc09bb77f15ce1f80cc/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:47.387784 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6faa9f-343e-487b-8ee2-712a8bcfe4cd admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:47.396291 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4d6faa9f-343e-487b-8ee2-712a8bcfe4cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:47.481341 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a027328-6c42-4174-a1cd-27196244447d None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:47.504902 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6faa9f-343e-487b-8ee2-712a8bcfe4cd admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:47.514598 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e7d89-5f1f-4c0f-a918-3b3d9d6c773e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:47.515780 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e7d89-5f1f-4c0f-a918-3b3d9d6c773e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:47.516425 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e7d89-5f1f-4c0f-a918-3b3d9d6c773e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:47.516892 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e7d89-5f1f-4c0f-a918-3b3d9d6c773e admin admin] PATH_INFO: `/v3/projects/95d69fd4f7b24ef28f99339dda3264de` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:47.518556 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e7d89-5f1f-4c0f-a918-3b3d9d6c773e admin admin] RBAC: Authorizing `identity:delete_project(project_id=95d69fd4f7b24ef28f99339dda3264de)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:47.523203 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e7d89-5f1f-4c0f-a918-3b3d9d6c773e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:47.552994 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:47.598007 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71d6fb-68a0-47a3-8e75-73f12c1197e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:47.598715 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71d6fb-68a0-47a3-8e75-73f12c1197e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:47.598997 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71d6fb-68a0-47a3-8e75-73f12c1197e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:47.599296 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71d6fb-68a0-47a3-8e75-73f12c1197e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:47.610918 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71d6fb-68a0-47a3-8e75-73f12c1197e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:47.612910 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71d6fb-68a0-47a3-8e75-73f12c1197e1 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:47.625819 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 974/1966] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:47.627148 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43601ed-3b40-43ab-8017-3bd295afe1ee None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:47.627492 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43601ed-3b40-43ab-8017-3bd295afe1ee None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:47.627805 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43601ed-3b40-43ab-8017-3bd295afe1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:47.662284 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-296e7d89-5f1f-4c0f-a918-3b3d9d6c773e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95d69fd4f7b24ef28f99339dda3264de', 'request_id': 'req-296e7d89-5f1f-4c0f-a918-3b3d9d6c773e'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:47.676666 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-e43601ed-3b40-43ab-8017-3bd295afe1ee None None] MFA Rules not processed for user `0d7f039ac1394cc09bb77f15ce1f80cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:47.677912 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e43601ed-3b40-43ab-8017-3bd295afe1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:47.678215 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-296e7d89-5f1f-4c0f-a918-3b3d9d6c773e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95d69fd4f7b24ef28f99339dda3264de', 'request_id': 'req-296e7d89-5f1f-4c0f-a918-3b3d9d6c773e'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:47.687910 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:47.700972 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-296e7d89-5f1f-4c0f-a918-3b3d9d6c773e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95d69fd4f7b24ef28f99339dda3264de', 'request_id': 'req-296e7d89-5f1f-4c0f-a918-3b3d9d6c773e'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:47.725752 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-296e7d89-5f1f-4c0f-a918-3b3d9d6c773e admin admin] The token cache is being invalidate because project 95d69fd4f7b24ef28f99339dda3264de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:56:47.726106 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-296e7d89-5f1f-4c0f-a918-3b3d9d6c773e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:47.730282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-296e7d89-5f1f-4c0f-a918-3b3d9d6c773e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:47.736655 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 993/1967] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:56:47 2022] DELETE /identity/v3/projects/95d69fd4f7b24ef28f99339dda3264de => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:47.736655 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e7d89-5f1f-4c0f-a918-3b3d9d6c773e admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:47.738436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-296e7d89-5f1f-4c0f-a918-3b3d9d6c773e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:47.795164 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 975/1968] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:47 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:47.795412 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43601ed-3b40-43ab-8017-3bd295afe1ee None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:47.800919 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e43601ed-3b40-43ab-8017-3bd295afe1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:47.877022 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e7d89-5f1f-4c0f-a918-3b3d9d6c773e admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:47.883550 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d57899-e9d3-41cd-9124-ce9221a4fea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:47.885147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d57899-e9d3-41cd-9124-ce9221a4fea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:47.885677 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d57899-e9d3-41cd-9124-ce9221a4fea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:47.885965 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d57899-e9d3-41cd-9124-ce9221a4fea5 admin admin] PATH_INFO: `/v3/projects/cc5239778fb149fb850adf91ce63839c` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:47.888190 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d57899-e9d3-41cd-9124-ce9221a4fea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc5239778fb149fb850adf91ce63839c)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:47.890593 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d57899-e9d3-41cd-9124-ce9221a4fea5 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:47.927724 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43601ed-3b40-43ab-8017-3bd295afe1ee None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:47.934363 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da123e6d-5880-41f5-b9c4-71972c7b757a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:47.935305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da123e6d-5880-41f5-b9c4-71972c7b757a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:47.935590 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da123e6d-5880-41f5-b9c4-71972c7b757a admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:47.935870 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da123e6d-5880-41f5-b9c4-71972c7b757a admin admin] PATH_INFO: `/v3/users/6d9107d1c6984572a5bd7b918fbf8bb0` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:47.937214 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da123e6d-5880-41f5-b9c4-71972c7b757a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d9107d1c6984572a5bd7b918fbf8bb0)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:47.939259 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da123e6d-5880-41f5-b9c4-71972c7b757a admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:47.959227 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-02d57899-e9d3-41cd-9124-ce9221a4fea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc5239778fb149fb850adf91ce63839c', 'request_id': 'req-02d57899-e9d3-41cd-9124-ce9221a4fea5'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:47.966833 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-02d57899-e9d3-41cd-9124-ce9221a4fea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc5239778fb149fb850adf91ce63839c', 'request_id': 'req-02d57899-e9d3-41cd-9124-ce9221a4fea5'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:47.976118 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-02d57899-e9d3-41cd-9124-ce9221a4fea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc5239778fb149fb850adf91ce63839c', 'request_id': 'req-02d57899-e9d3-41cd-9124-ce9221a4fea5'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:47.989974 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-02d57899-e9d3-41cd-9124-ce9221a4fea5 admin admin] The token cache is being invalidate because project cc5239778fb149fb850adf91ce63839c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:56:47.990591 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-02d57899-e9d3-41cd-9124-ce9221a4fea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:47.991027 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-02d57899-e9d3-41cd-9124-ce9221a4fea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:47.993758 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 994/1969] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:56:47 2022] DELETE /identity/v3/projects/cc5239778fb149fb850adf91ce63839c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:47.994329 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d57899-e9d3-41cd-9124-ce9221a4fea5 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:47.995959 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-02d57899-e9d3-41cd-9124-ce9221a4fea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:47.996136 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-da123e6d-5880-41f5-b9c4-71972c7b757a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d9107d1c6984572a5bd7b918fbf8bb0'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:47.997022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-da123e6d-5880-41f5-b9c4-71972c7b757a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d9107d1c6984572a5bd7b918fbf8bb0'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:48.004584 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-da123e6d-5880-41f5-b9c4-71972c7b757a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d9107d1c6984572a5bd7b918fbf8bb0'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:48.005350 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-da123e6d-5880-41f5-b9c4-71972c7b757a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d9107d1c6984572a5bd7b918fbf8bb0'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:48.013061 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:48.024357 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-da123e6d-5880-41f5-b9c4-71972c7b757a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d9107d1c6984572a5bd7b918fbf8bb0'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:48.039313 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 976/1970] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:56:47 2022] DELETE /identity/v3/users/6d9107d1c6984572a5bd7b918fbf8bb0 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:48.043311 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da123e6d-5880-41f5-b9c4-71972c7b757a admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:48.044700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-da123e6d-5880-41f5-b9c4-71972c7b757a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:48.077564 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d57899-e9d3-41cd-9124-ce9221a4fea5 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:48.098123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:48.124216 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da123e6d-5880-41f5-b9c4-71972c7b757a admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:48.129296 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb46f9f-39d6-48e3-878e-b64d9d2907cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:48.130453 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb46f9f-39d6-48e3-878e-b64d9d2907cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:48.130738 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb46f9f-39d6-48e3-878e-b64d9d2907cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:48.131101 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb46f9f-39d6-48e3-878e-b64d9d2907cf admin admin] PATH_INFO: `/v3/users/c767378588bb4ee6a172f69b3101e073` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:48.132564 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb46f9f-39d6-48e3-878e-b64d9d2907cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c767378588bb4ee6a172f69b3101e073)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:48.134610 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb46f9f-39d6-48e3-878e-b64d9d2907cf admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:48.143819 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301db93-9d47-41c3-bed9-aa7e0f56f9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:48.144490 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301db93-9d47-41c3-bed9-aa7e0f56f9bb admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:48.144757 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301db93-9d47-41c3-bed9-aa7e0f56f9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:48.145092 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301db93-9d47-41c3-bed9-aa7e0f56f9bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:48.145703 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301db93-9d47-41c3-bed9-aa7e0f56f9bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:48.147640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301db93-9d47-41c3-bed9-aa7e0f56f9bb admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:48.180690 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 995/1971] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:47 2022] POST /identity/v3/projects => generated 367 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:48.184970 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301db93-9d47-41c3-bed9-aa7e0f56f9bb admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:48.186892 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a301db93-9d47-41c3-bed9-aa7e0f56f9bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:48.195116 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-ebb46f9f-39d6-48e3-878e-b64d9d2907cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c767378588bb4ee6a172f69b3101e073'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:48.196023 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-ebb46f9f-39d6-48e3-878e-b64d9d2907cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c767378588bb4ee6a172f69b3101e073'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:48.211134 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-ebb46f9f-39d6-48e3-878e-b64d9d2907cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c767378588bb4ee6a172f69b3101e073'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:48.211803 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-ebb46f9f-39d6-48e3-878e-b64d9d2907cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c767378588bb4ee6a172f69b3101e073'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:48.231800 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-ebb46f9f-39d6-48e3-878e-b64d9d2907cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c767378588bb4ee6a172f69b3101e073'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:48.249015 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 977/1972] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:56:48 2022] DELETE /identity/v3/users/c767378588bb4ee6a172f69b3101e073 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:48.250220 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb46f9f-39d6-48e3-878e-b64d9d2907cf admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:48.251975 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ebb46f9f-39d6-48e3-878e-b64d9d2907cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:48.271235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301db93-9d47-41c3-bed9-aa7e0f56f9bb admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:48.346290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:48.351196 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb46f9f-39d6-48e3-878e-b64d9d2907cf admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:48.360025 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f3681-ff7f-4b73-9a0a-219db44d5fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:48.360581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec29acd-51d7-42c5-a703-0dcbed840d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:48.361503 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f3681-ff7f-4b73-9a0a-219db44d5fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:48.361635 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f3681-ff7f-4b73-9a0a-219db44d5fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:48.362099 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f3681-ff7f-4b73-9a0a-219db44d5fbf admin admin] PATH_INFO: `/v3/projects/dfc92eeb94d14317898f098165bf37c3` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:48.362296 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec29acd-51d7-42c5-a703-0dcbed840d22 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:48.363068 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec29acd-51d7-42c5-a703-0dcbed840d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:48.364101 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f3681-ff7f-4b73-9a0a-219db44d5fbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfc92eeb94d14317898f098165bf37c3)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:48.364263 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec29acd-51d7-42c5-a703-0dcbed840d22 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:48.364980 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec29acd-51d7-42c5-a703-0dcbed840d22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:48.366747 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f3681-ff7f-4b73-9a0a-219db44d5fbf admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:48.367160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec29acd-51d7-42c5-a703-0dcbed840d22 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:48.402059 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 978/1973] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:48 2022] POST /identity/v3/users => generated 290 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:48.403171 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec29acd-51d7-42c5-a703-0dcbed840d22 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:48.434152 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ee9f3681-ff7f-4b73-9a0a-219db44d5fbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfc92eeb94d14317898f098165bf37c3', 'request_id': 'req-ee9f3681-ff7f-4b73-9a0a-219db44d5fbf'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:48.435972 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec29acd-51d7-42c5-a703-0dcbed840d22 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:48.443694 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ee9f3681-ff7f-4b73-9a0a-219db44d5fbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfc92eeb94d14317898f098165bf37c3', 'request_id': 'req-ee9f3681-ff7f-4b73-9a0a-219db44d5fbf'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:48.447144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:48.457102 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ee9f3681-ff7f-4b73-9a0a-219db44d5fbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfc92eeb94d14317898f098165bf37c3', 'request_id': 'req-ee9f3681-ff7f-4b73-9a0a-219db44d5fbf'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:48.472517 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ee9f3681-ff7f-4b73-9a0a-219db44d5fbf admin admin] The token cache is being invalidate because project dfc92eeb94d14317898f098165bf37c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:56:48.472840 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ee9f3681-ff7f-4b73-9a0a-219db44d5fbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:48.474012 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ee9f3681-ff7f-4b73-9a0a-219db44d5fbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:48.477212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 996/1974] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:56:48 2022] DELETE /identity/v3/projects/dfc92eeb94d14317898f098165bf37c3 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:48.480909 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f3681-ff7f-4b73-9a0a-219db44d5fbf admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:48.484031 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ee9f3681-ff7f-4b73-9a0a-219db44d5fbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:48.537174 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737187d-454a-46f5-ad1f-84b730a1a8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:48.537967 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737187d-454a-46f5-ad1f-84b730a1a8b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:48.538402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737187d-454a-46f5-ad1f-84b730a1a8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:48.538747 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737187d-454a-46f5-ad1f-84b730a1a8b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:48.539782 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7737187d-454a-46f5-ad1f-84b730a1a8b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:48.541915 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7737187d-454a-46f5-ad1f-84b730a1a8b4 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:48.562575 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 979/1975] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:48.562575 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737187d-454a-46f5-ad1f-84b730a1a8b4 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:48.564488 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-7737187d-454a-46f5-ad1f-84b730a1a8b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:48.576868 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f3681-ff7f-4b73-9a0a-219db44d5fbf admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:48.577570 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737187d-454a-46f5-ad1f-84b730a1a8b4 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:48.582288 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78125891-0fb0-4083-80cc-1586f9ed58ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:48.583203 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf38b62-af87-4452-912c-48338734f96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:48.583362 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78125891-0fb0-4083-80cc-1586f9ed58ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:48.583658 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78125891-0fb0-4083-80cc-1586f9ed58ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:48.583995 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78125891-0fb0-4083-80cc-1586f9ed58ae admin admin] PATH_INFO: `/v3/users/840f12fbf2f14f3cbd4f58569695e64f` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:48.584822 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf38b62-af87-4452-912c-48338734f96f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:48.585105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf38b62-af87-4452-912c-48338734f96f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:48.585390 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78125891-0fb0-4083-80cc-1586f9ed58ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=840f12fbf2f14f3cbd4f58569695e64f)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:48.585833 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf38b62-af87-4452-912c-48338734f96f admin admin] PATH_INFO: `/v3/projects/6871b91de9c74be3af792c7028efc60a` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:48.587079 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf38b62-af87-4452-912c-48338734f96f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6871b91de9c74be3af792c7028efc60a)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:48.587357 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78125891-0fb0-4083-80cc-1586f9ed58ae admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:48.590030 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf38b62-af87-4452-912c-48338734f96f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:48.650802 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-78125891-0fb0-4083-80cc-1586f9ed58ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '840f12fbf2f14f3cbd4f58569695e64f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:48.651951 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-78125891-0fb0-4083-80cc-1586f9ed58ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '840f12fbf2f14f3cbd4f58569695e64f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:48.659457 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-caf38b62-af87-4452-912c-48338734f96f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6871b91de9c74be3af792c7028efc60a', 'request_id': 'req-caf38b62-af87-4452-912c-48338734f96f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:48.667075 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-caf38b62-af87-4452-912c-48338734f96f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6871b91de9c74be3af792c7028efc60a', 'request_id': 'req-caf38b62-af87-4452-912c-48338734f96f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:48.670383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-78125891-0fb0-4083-80cc-1586f9ed58ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '840f12fbf2f14f3cbd4f58569695e64f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:48.671377 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-78125891-0fb0-4083-80cc-1586f9ed58ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '840f12fbf2f14f3cbd4f58569695e64f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:48.680816 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-caf38b62-af87-4452-912c-48338734f96f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6871b91de9c74be3af792c7028efc60a', 'request_id': 'req-caf38b62-af87-4452-912c-48338734f96f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:48.692153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-78125891-0fb0-4083-80cc-1586f9ed58ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '840f12fbf2f14f3cbd4f58569695e64f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:48.698063 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-caf38b62-af87-4452-912c-48338734f96f admin admin] The token cache is being invalidate because project 6871b91de9c74be3af792c7028efc60a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:56:48.698274 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-caf38b62-af87-4452-912c-48338734f96f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:48.698915 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-caf38b62-af87-4452-912c-48338734f96f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:48.704293 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 997/1976] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:56:48 2022] DELETE /identity/v3/projects/6871b91de9c74be3af792c7028efc60a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:48.704293 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf38b62-af87-4452-912c-48338734f96f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:48.704293 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-caf38b62-af87-4452-912c-48338734f96f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:48.710483 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 980/1977] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:56:48 2022] DELETE /identity/v3/users/840f12fbf2f14f3cbd4f58569695e64f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:48.711383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78125891-0fb0-4083-80cc-1586f9ed58ae admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:48.713103 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-78125891-0fb0-4083-80cc-1586f9ed58ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:48.803325 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:48.811600 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78125891-0fb0-4083-80cc-1586f9ed58ae admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:48.837407 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf38b62-af87-4452-912c-48338734f96f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:48.839923 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf1153-cb3b-43ae-815e-a51f90a7e201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:48.840873 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf1153-cb3b-43ae-815e-a51f90a7e201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:48.841256 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf1153-cb3b-43ae-815e-a51f90a7e201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:48.841579 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf1153-cb3b-43ae-815e-a51f90a7e201 admin admin] PATH_INFO: `/v3/projects/2e60bd4a2caf4c1da184b0d216d379ba` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:48.843546 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf1153-cb3b-43ae-815e-a51f90a7e201 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e60bd4a2caf4c1da184b0d216d379ba)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:48.850987 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf1153-cb3b-43ae-815e-a51f90a7e201 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:48.857264 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e7d05-63b7-46dc-a5b6-35eea82e1018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:48.857986 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e7d05-63b7-46dc-a5b6-35eea82e1018 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:48.858469 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e7d05-63b7-46dc-a5b6-35eea82e1018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:48.858575 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e7d05-63b7-46dc-a5b6-35eea82e1018 admin admin] PATH_INFO: `/v3/projects/8727125525f7488f8b221a04557a18d8/users/69b70d5d25ad4310b0b17142e9fc5c81/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:48.893327 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331e7d05-63b7-46dc-a5b6-35eea82e1018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8727125525f7488f8b221a04557a18d8, user_id=69b70d5d25ad4310b0b17142e9fc5c81, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:48.910549 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331e7d05-63b7-46dc-a5b6-35eea82e1018 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:48.943241 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:48.953783 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 998/1978] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:48 2022] PUT /identity/v3/projects/8727125525f7488f8b221a04557a18d8/users/69b70d5d25ad4310b0b17142e9fc5c81/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:48.958255 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831fb1d-742a-4545-afd0-862334583b7f None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:48.958583 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831fb1d-742a-4545-afd0-862334583b7f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:48.958991 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831fb1d-742a-4545-afd0-862334583b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:48.974018 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e4cf1153-cb3b-43ae-815e-a51f90a7e201 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e60bd4a2caf4c1da184b0d216d379ba', 'request_id': 'req-e4cf1153-cb3b-43ae-815e-a51f90a7e201'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:48.991826 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e4cf1153-cb3b-43ae-815e-a51f90a7e201 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e60bd4a2caf4c1da184b0d216d379ba', 'request_id': 'req-e4cf1153-cb3b-43ae-815e-a51f90a7e201'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:48.999799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e4cf1153-cb3b-43ae-815e-a51f90a7e201 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e60bd4a2caf4c1da184b0d216d379ba', 'request_id': 'req-e4cf1153-cb3b-43ae-815e-a51f90a7e201'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:49.015843 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e4cf1153-cb3b-43ae-815e-a51f90a7e201 admin admin] The token cache is being invalidate because project 2e60bd4a2caf4c1da184b0d216d379ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:56:49.016253 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e4cf1153-cb3b-43ae-815e-a51f90a7e201 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:49.017570 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e4cf1153-cb3b-43ae-815e-a51f90a7e201 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:49.019742 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 981/1979] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:56:48 2022] DELETE /identity/v3/projects/2e60bd4a2caf4c1da184b0d216d379ba => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:49.020645 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf1153-cb3b-43ae-815e-a51f90a7e201 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:49.021979 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e4cf1153-cb3b-43ae-815e-a51f90a7e201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:49.050078 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-0831fb1d-742a-4545-afd0-862334583b7f None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:49.052939 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0831fb1d-742a-4545-afd0-862334583b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:49.166452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf1153-cb3b-43ae-815e-a51f90a7e201 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:49.208293 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 999/1980] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:49.210646 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849f761-93ea-4f05-842a-4faa38b4d263 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:49.211169 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849f761-93ea-4f05-842a-4faa38b4d263 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:49.211699 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849f761-93ea-4f05-842a-4faa38b4d263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:49.245410 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6849f761-93ea-4f05-842a-4faa38b4d263 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:49.246655 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6849f761-93ea-4f05-842a-4faa38b4d263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:49.270797 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1000/1981] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:49.272099 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849f761-93ea-4f05-842a-4faa38b4d263 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:49.274703 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6849f761-93ea-4f05-842a-4faa38b4d263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:49.298822 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc65e7d-f4df-4459-b3f5-39434b24d484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:49.299592 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc65e7d-f4df-4459-b3f5-39434b24d484 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:49.299876 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc65e7d-f4df-4459-b3f5-39434b24d484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:49.300152 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc65e7d-f4df-4459-b3f5-39434b24d484 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:49.301940 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc65e7d-f4df-4459-b3f5-39434b24d484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:49.302534 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849f761-93ea-4f05-842a-4faa38b4d263 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:49.317784 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc65e7d-f4df-4459-b3f5-39434b24d484 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:49.319941 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b09a05-ed73-4950-b0d5-c56bca2de19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:49.324301 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b09a05-ed73-4950-b0d5-c56bca2de19f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:49.324597 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b09a05-ed73-4950-b0d5-c56bca2de19f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:49.324947 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b09a05-ed73-4950-b0d5-c56bca2de19f admin admin] PATH_INFO: `/v3/projects/179d76ac629b414b8882b91f2a4c8489` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:49.326551 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b09a05-ed73-4950-b0d5-c56bca2de19f admin admin] RBAC: Authorizing `identity:delete_project(project_id=179d76ac629b414b8882b91f2a4c8489)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:49.328534 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b09a05-ed73-4950-b0d5-c56bca2de19f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:49.344184 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 982/1982] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:49.344184 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2fb85-0979-4ec7-8f34-6b709bb84b31 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:49.344184 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2fb85-0979-4ec7-8f34-6b709bb84b31 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:49.344184 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2fb85-0979-4ec7-8f34-6b709bb84b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:49.362424 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-07f2fb85-0979-4ec7-8f34-6b709bb84b31 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:49.363936 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-07f2fb85-0979-4ec7-8f34-6b709bb84b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:49.386077 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 983/1983] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:49.386077 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80219cef-faec-419d-bb3f-5f17dc8071e8 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:49.386077 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80219cef-faec-419d-bb3f-5f17dc8071e8 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:49.386077 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80219cef-faec-419d-bb3f-5f17dc8071e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:49.400190 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-72b09a05-ed73-4950-b0d5-c56bca2de19f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '179d76ac629b414b8882b91f2a4c8489', 'request_id': 'req-72b09a05-ed73-4950-b0d5-c56bca2de19f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:49.405690 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-80219cef-faec-419d-bb3f-5f17dc8071e8 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:49.406404 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-80219cef-faec-419d-bb3f-5f17dc8071e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:49.417712 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-72b09a05-ed73-4950-b0d5-c56bca2de19f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '179d76ac629b414b8882b91f2a4c8489', 'request_id': 'req-72b09a05-ed73-4950-b0d5-c56bca2de19f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:49.430941 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-72b09a05-ed73-4950-b0d5-c56bca2de19f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '179d76ac629b414b8882b91f2a4c8489', 'request_id': 'req-72b09a05-ed73-4950-b0d5-c56bca2de19f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:49.439116 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:49.446865 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-72b09a05-ed73-4950-b0d5-c56bca2de19f admin admin] The token cache is being invalidate because project 179d76ac629b414b8882b91f2a4c8489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:56:49.447463 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-72b09a05-ed73-4950-b0d5-c56bca2de19f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:49.448319 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-72b09a05-ed73-4950-b0d5-c56bca2de19f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:49.453456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1001/1984] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:56:49 2022] DELETE /identity/v3/projects/179d76ac629b414b8882b91f2a4c8489 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:49.454264 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b09a05-ed73-4950-b0d5-c56bca2de19f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:49.458787 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-72b09a05-ed73-4950-b0d5-c56bca2de19f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:49.506288 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 984/1985] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:49.507594 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80219cef-faec-419d-bb3f-5f17dc8071e8 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:49.510375 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-80219cef-faec-419d-bb3f-5f17dc8071e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:49.522229 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80219cef-faec-419d-bb3f-5f17dc8071e8 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:49.527100 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ca155-8d64-4725-8339-19fc7a8948b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:49.527811 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ca155-8d64-4725-8339-19fc7a8948b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:49.528100 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ca155-8d64-4725-8339-19fc7a8948b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:49.528378 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ca155-8d64-4725-8339-19fc7a8948b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:49.529118 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ca155-8d64-4725-8339-19fc7a8948b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:56:49.529429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ca155-8d64-4725-8339-19fc7a8948b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:49.531062 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ca155-8d64-4725-8339-19fc7a8948b8 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:49.543807 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b09a05-ed73-4950-b0d5-c56bca2de19f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:49.548273 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 985/1986] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:56:49.549760 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e45949-1a8a-4bdd-b91a-125a0a6e586b None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:49.550058 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e45949-1a8a-4bdd-b91a-125a0a6e586b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:49.550338 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e45949-1a8a-4bdd-b91a-125a0a6e586b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:49.552695 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c779642-e389-4197-b10c-503d288cd31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:49.553704 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c779642-e389-4197-b10c-503d288cd31b admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:49.554080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c779642-e389-4197-b10c-503d288cd31b admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:49.554525 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c779642-e389-4197-b10c-503d288cd31b admin admin] PATH_INFO: `/v3/projects/8727125525f7488f8b221a04557a18d8/users/69b70d5d25ad4310b0b17142e9fc5c81/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:49.556795 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c779642-e389-4197-b10c-503d288cd31b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8727125525f7488f8b221a04557a18d8, user_id=69b70d5d25ad4310b0b17142e9fc5c81, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:49.559853 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c779642-e389-4197-b10c-503d288cd31b admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:49.572919 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1002/1987] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:49 2022] PUT /identity/v3/projects/8727125525f7488f8b221a04557a18d8/users/69b70d5d25ad4310b0b17142e9fc5c81/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:49.572919 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c779642-e389-4197-b10c-503d288cd31b admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:49.602110 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-09e45949-1a8a-4bdd-b91a-125a0a6e586b None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:49.602308 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:49.603458 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-09e45949-1a8a-4bdd-b91a-125a0a6e586b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:49.691923 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c779642-e389-4197-b10c-503d288cd31b admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:49.698331 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 986/1988] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:49.699301 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e45949-1a8a-4bdd-b91a-125a0a6e586b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:49.706236 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa51feb-a7b1-4a6b-8345-ce1e8085d5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:49.706956 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa51feb-a7b1-4a6b-8345-ce1e8085d5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:49.707274 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa51feb-a7b1-4a6b-8345-ce1e8085d5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:49.708146 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa51feb-a7b1-4a6b-8345-ce1e8085d5f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:49.708296 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa51feb-a7b1-4a6b-8345-ce1e8085d5f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:56:49.708589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa51feb-a7b1-4a6b-8345-ce1e8085d5f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:49.709239 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e45949-1a8a-4bdd-b91a-125a0a6e586b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:49.710636 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa51feb-a7b1-4a6b-8345-ce1e8085d5f0 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:49.715040 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d679e9-4df4-4f6a-9fe1-270bff446c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:49.715835 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d679e9-4df4-4f6a-9fe1-270bff446c3c admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:49.716212 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d679e9-4df4-4f6a-9fe1-270bff446c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:49.716581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d679e9-4df4-4f6a-9fe1-270bff446c3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:49.717368 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d679e9-4df4-4f6a-9fe1-270bff446c3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:49.719523 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d679e9-4df4-4f6a-9fe1-270bff446c3c admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:49.724402 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1003/1989] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:56:49.725832 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d2396-4e8e-431c-bdff-551a62eb531e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:49.726123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d2396-4e8e-431c-bdff-551a62eb531e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:49.726405 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d2396-4e8e-431c-bdff-551a62eb531e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:49.751228 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 987/1990] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:49 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:49.752664 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73867a-5983-41b8-9fab-29da588e5c7b None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:49.752813 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73867a-5983-41b8-9fab-29da588e5c7b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:49.753175 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73867a-5983-41b8-9fab-29da588e5c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:49.755866 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-0c5d2396-4e8e-431c-bdff-551a62eb531e None None] MFA Rules not processed for user `69b70d5d25ad4310b0b17142e9fc5c81`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:49.757159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0c5d2396-4e8e-431c-bdff-551a62eb531e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:49.773596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-1b73867a-5983-41b8-9fab-29da588e5c7b None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:49.775102 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-1b73867a-5983-41b8-9fab-29da588e5c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:49.848322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1004/1991] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:49 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:49.849392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d2396-4e8e-431c-bdff-551a62eb531e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:49.859642 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 988/1992] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:49.862072 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73867a-5983-41b8-9fab-29da588e5c7b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:49.876268 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73867a-5983-41b8-9fab-29da588e5c7b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:49.880080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d2396-4e8e-431c-bdff-551a62eb531e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:49.881253 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728bdfb-c92f-4a36-92de-c2fb60c323be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:49.881968 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728bdfb-c92f-4a36-92de-c2fb60c323be admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:49.882252 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728bdfb-c92f-4a36-92de-c2fb60c323be admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:49.882531 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728bdfb-c92f-4a36-92de-c2fb60c323be admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:49.883267 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7728bdfb-c92f-4a36-92de-c2fb60c323be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:49.885202 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7728bdfb-c92f-4a36-92de-c2fb60c323be admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:49.896587 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25e4a8-3e4a-4b3f-b56f-39d54abc1f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:49.897689 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25e4a8-3e4a-4b3f-b56f-39d54abc1f76 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:49.898369 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25e4a8-3e4a-4b3f-b56f-39d54abc1f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:49.898840 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25e4a8-3e4a-4b3f-b56f-39d54abc1f76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:49.899808 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25e4a8-3e4a-4b3f-b56f-39d54abc1f76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:49.902055 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25e4a8-3e4a-4b3f-b56f-39d54abc1f76 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:49.912063 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 989/1993] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:49 2022] POST /identity/v3/users => generated 292 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:49.912063 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728bdfb-c92f-4a36-92de-c2fb60c323be admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:49.924662 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728bdfb-c92f-4a36-92de-c2fb60c323be admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:49.929845 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55df39-e54a-4b8f-947e-a2c0eabde53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:49.930201 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55df39-e54a-4b8f-947e-a2c0eabde53b admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:49.930536 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55df39-e54a-4b8f-947e-a2c0eabde53b admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:49.930919 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55df39-e54a-4b8f-947e-a2c0eabde53b admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:49.931799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55df39-e54a-4b8f-947e-a2c0eabde53b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:56:49.932097 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55df39-e54a-4b8f-947e-a2c0eabde53b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:49.933879 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55df39-e54a-4b8f-947e-a2c0eabde53b admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:49.941639 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:49.953536 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 990/1994] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:56:49.953768 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1005/1995] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:49 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:49.953865 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55df39-e54a-4b8f-947e-a2c0eabde53b admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:49.953954 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25e4a8-3e4a-4b3f-b56f-39d54abc1f76 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:49.954028 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-0c55df39-e54a-4b8f-947e-a2c0eabde53b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:50.020306 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55df39-e54a-4b8f-947e-a2c0eabde53b admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:50.035406 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25e4a8-3e4a-4b3f-b56f-39d54abc1f76 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:50.040575 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3dc5ce-f9be-4c62-a9a2-0f065cafc5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:50.041282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3dc5ce-f9be-4c62-a9a2-0f065cafc5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:50.041543 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3dc5ce-f9be-4c62-a9a2-0f065cafc5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:50.041822 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3dc5ce-f9be-4c62-a9a2-0f065cafc5c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:50.042551 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3dc5ce-f9be-4c62-a9a2-0f065cafc5c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:50.044190 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3dc5ce-f9be-4c62-a9a2-0f065cafc5c0 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:50.057644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1006/1996] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:50.057644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3dc5ce-f9be-4c62-a9a2-0f065cafc5c0 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:50.065180 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:50.072119 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3dc5ce-f9be-4c62-a9a2-0f065cafc5c0 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:50.083519 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a804be-f2bf-4fc1-bc6f-0cdb82f84394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:50.084360 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a804be-f2bf-4fc1-bc6f-0cdb82f84394 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:50.084647 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09cc497-d67a-4a37-b4dc-0c1558190295 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:50.084770 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a804be-f2bf-4fc1-bc6f-0cdb82f84394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:50.085089 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a804be-f2bf-4fc1-bc6f-0cdb82f84394 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:50.085493 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cc497-d67a-4a37-b4dc-0c1558190295 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:50.085841 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cc497-d67a-4a37-b4dc-0c1558190295 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:50.086035 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a804be-f2bf-4fc1-bc6f-0cdb82f84394 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:50.086198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cc497-d67a-4a37-b4dc-0c1558190295 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:50.088259 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a804be-f2bf-4fc1-bc6f-0cdb82f84394 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:50.125974 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1007/1997] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:50 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:50.127478 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a804be-f2bf-4fc1-bc6f-0cdb82f84394 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:50.156798 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09cc497-d67a-4a37-b4dc-0c1558190295 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:50.158519 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09cc497-d67a-4a37-b4dc-0c1558190295 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:50.171011 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 991/1998] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:49 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:50.171889 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09cc497-d67a-4a37-b4dc-0c1558190295 service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:50.183208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09cc497-d67a-4a37-b4dc-0c1558190295 service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:50.234040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a804be-f2bf-4fc1-bc6f-0cdb82f84394 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:50.241870 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6701c4-30dd-43c4-a551-e57cc5b7224c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:50.242730 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6701c4-30dd-43c4-a551-e57cc5b7224c admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:50.246676 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6701c4-30dd-43c4-a551-e57cc5b7224c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:50.246676 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6701c4-30dd-43c4-a551-e57cc5b7224c admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:50.247008 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6701c4-30dd-43c4-a551-e57cc5b7224c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:50.251286 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6701c4-30dd-43c4-a551-e57cc5b7224c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:50.253239 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d17ba7-d714-47ba-a3ae-3631b0dc4201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:50.254285 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d17ba7-d714-47ba-a3ae-3631b0dc4201 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:50.254285 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d17ba7-d714-47ba-a3ae-3631b0dc4201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:50.254457 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d17ba7-d714-47ba-a3ae-3631b0dc4201 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:50.255356 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d17ba7-d714-47ba-a3ae-3631b0dc4201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:50.259238 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d17ba7-d714-47ba-a3ae-3631b0dc4201 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:50.267723 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:50.275343 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 992/1999] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:50.276767 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d17ba7-d714-47ba-a3ae-3631b0dc4201 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:50.280147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1008/2000] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:50 2022] POST /identity/v3/users => generated 290 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:50.281092 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6701c4-30dd-43c4-a551-e57cc5b7224c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:50.288951 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d17ba7-d714-47ba-a3ae-3631b0dc4201 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:50.293833 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2122fc-10dc-43a4-952f-ddde7b7ed031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:50.294531 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2122fc-10dc-43a4-952f-ddde7b7ed031 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:50.294818 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2122fc-10dc-43a4-952f-ddde7b7ed031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:50.295089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2122fc-10dc-43a4-952f-ddde7b7ed031 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:50.295815 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2122fc-10dc-43a4-952f-ddde7b7ed031 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:50.305047 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2122fc-10dc-43a4-952f-ddde7b7ed031 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:50.330546 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 993/2001] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:50 2022] POST /identity/v3/users => generated 293 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:50.331826 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2122fc-10dc-43a4-952f-ddde7b7ed031 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:50.342189 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2122fc-10dc-43a4-952f-ddde7b7ed031 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:50.349411 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd06e3-e9ee-4757-9737-8d78a57d060c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:50.350339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd06e3-e9ee-4757-9737-8d78a57d060c admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:50.350609 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd06e3-e9ee-4757-9737-8d78a57d060c admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:50.350878 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd06e3-e9ee-4757-9737-8d78a57d060c admin admin] PATH_INFO: `/v3/projects/800a59d7ff034d54be53784e780b55ae/users/cee803bd1c784506b7df9360757abc46/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:50.371913 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6701c4-30dd-43c4-a551-e57cc5b7224c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:50.376312 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd06e3-e9ee-4757-9737-8d78a57d060c admin admin] RBAC: Authorizing `identity:create_grant(project_id=800a59d7ff034d54be53784e780b55ae, user_id=cee803bd1c784506b7df9360757abc46, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:50.376869 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e5ce1-01bd-4942-9055-a44045956bee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:50.378211 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e5ce1-01bd-4942-9055-a44045956bee service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:50.378416 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e5ce1-01bd-4942-9055-a44045956bee service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:50.378695 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e5ce1-01bd-4942-9055-a44045956bee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:50.387317 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd06e3-e9ee-4757-9737-8d78a57d060c admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:50.387587 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-148e5ce1-01bd-4942-9055-a44045956bee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:50.405721 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 994/2002] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:50 2022] PUT /identity/v3/projects/800a59d7ff034d54be53784e780b55ae/users/cee803bd1c784506b7df9360757abc46/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:50.406624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd06e3-e9ee-4757-9737-8d78a57d060c admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:50.454213 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e5ce1-01bd-4942-9055-a44045956bee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:50.455840 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e5ce1-01bd-4942-9055-a44045956bee service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:50.465917 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1009/2003] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:50 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:50.466763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e5ce1-01bd-4942-9055-a44045956bee service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:50.487933 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e5ce1-01bd-4942-9055-a44045956bee service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:50.489379 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd06e3-e9ee-4757-9737-8d78a57d060c admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:50.493730 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a30b9-7781-4b1d-b3d6-e3b70072dd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:50.494630 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a30b9-7781-4b1d-b3d6-e3b70072dd36 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:50.494741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f1541-f5c7-4b08-a2c6-fb12619e8c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:50.494966 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a30b9-7781-4b1d-b3d6-e3b70072dd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:50.495329 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a30b9-7781-4b1d-b3d6-e3b70072dd36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:50.495705 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f1541-f5c7-4b08-a2c6-fb12619e8c1f admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:50.495996 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f1541-f5c7-4b08-a2c6-fb12619e8c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:50.496095 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a30b9-7781-4b1d-b3d6-e3b70072dd36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:50.496272 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f1541-f5c7-4b08-a2c6-fb12619e8c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:50.497127 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f1541-f5c7-4b08-a2c6-fb12619e8c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:50.497932 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a30b9-7781-4b1d-b3d6-e3b70072dd36 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:50.498933 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f1541-f5c7-4b08-a2c6-fb12619e8c1f admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:50.511772 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 995/2004] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:50.515212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1010/2005] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:50.515353 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c47b68-19f1-4f94-a02b-1e58f06cb184 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:50.515353 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c47b68-19f1-4f94-a02b-1e58f06cb184 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:50.515353 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c47b68-19f1-4f94-a02b-1e58f06cb184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:50.516148 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a30b9-7781-4b1d-b3d6-e3b70072dd36 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:50.529464 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a30b9-7781-4b1d-b3d6-e3b70072dd36 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:50.539335 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0976aa-c1a4-470d-8cb0-cb8b897f86b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:50.539335 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0976aa-c1a4-470d-8cb0-cb8b897f86b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:50.539335 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0976aa-c1a4-470d-8cb0-cb8b897f86b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:50.539335 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0976aa-c1a4-470d-8cb0-cb8b897f86b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:50.539756 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0976aa-c1a4-470d-8cb0-cb8b897f86b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:50.541921 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0976aa-c1a4-470d-8cb0-cb8b897f86b0 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:50.551091 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-87c47b68-19f1-4f94-a02b-1e58f06cb184 None None] MFA Rules not processed for user `cee803bd1c784506b7df9360757abc46`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:50.553177 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-87c47b68-19f1-4f94-a02b-1e58f06cb184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:50.555220 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1011/2006] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:50.556245 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0976aa-c1a4-470d-8cb0-cb8b897f86b0 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:50.563019 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:50.572040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0976aa-c1a4-470d-8cb0-cb8b897f86b0 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:50.577237 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41639b-b868-402b-a5ac-08753c4a497a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:50.577931 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41639b-b868-402b-a5ac-08753c4a497a admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:50.578218 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41639b-b868-402b-a5ac-08753c4a497a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:50.578644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41639b-b868-402b-a5ac-08753c4a497a admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:50.579417 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41639b-b868-402b-a5ac-08753c4a497a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:50.582365 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41639b-b868-402b-a5ac-08753c4a497a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:50.595985 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1012/2007] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:50.597209 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41639b-b868-402b-a5ac-08753c4a497a admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:50.610181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41639b-b868-402b-a5ac-08753c4a497a admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:50.616840 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13039e4e-45b2-41f7-b459-1bbf5090ae9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:50.618155 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13039e4e-45b2-41f7-b459-1bbf5090ae9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:50.618440 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13039e4e-45b2-41f7-b459-1bbf5090ae9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:50.618992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13039e4e-45b2-41f7-b459-1bbf5090ae9c admin admin] PATH_INFO: `/v3/projects/a866b768fd444e7ca909e594a10c47a8/users/b4cd8a8d29504be08fb4dfa892a7aa45/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:50.638178 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13039e4e-45b2-41f7-b459-1bbf5090ae9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a866b768fd444e7ca909e594a10c47a8, user_id=b4cd8a8d29504be08fb4dfa892a7aa45, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:50.642976 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13039e4e-45b2-41f7-b459-1bbf5090ae9c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:50.650076 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 996/2008] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:50.651141 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c47b68-19f1-4f94-a02b-1e58f06cb184 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:50.662723 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c47b68-19f1-4f94-a02b-1e58f06cb184 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:50.663745 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1013/2009] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:50 2022] PUT /identity/v3/projects/a866b768fd444e7ca909e594a10c47a8/users/b4cd8a8d29504be08fb4dfa892a7aa45/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:50.664618 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13039e4e-45b2-41f7-b459-1bbf5090ae9c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:50.716106 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:50.739919 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a637fb-d69c-4d0d-914c-b1fd6cab68ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:50.740892 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a637fb-d69c-4d0d-914c-b1fd6cab68ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:50.741157 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a637fb-d69c-4d0d-914c-b1fd6cab68ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:50.741486 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a637fb-d69c-4d0d-914c-b1fd6cab68ce admin admin] PATH_INFO: `/v3/projects/4ebc9f36053a40f0a88bba03a38ac64b/users/8fa8f26b17db40a0a254ee4f9759fc55/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:50.750492 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13039e4e-45b2-41f7-b459-1bbf5090ae9c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:50.755864 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf15a6-2a56-4ef4-af67-7f2346da5744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:50.756951 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf15a6-2a56-4ef4-af67-7f2346da5744 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:50.757287 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf15a6-2a56-4ef4-af67-7f2346da5744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:50.757565 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf15a6-2a56-4ef4-af67-7f2346da5744 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:50.758466 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf15a6-2a56-4ef4-af67-7f2346da5744 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:50.761658 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf15a6-2a56-4ef4-af67-7f2346da5744 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:50.764208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a637fb-d69c-4d0d-914c-b1fd6cab68ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ebc9f36053a40f0a88bba03a38ac64b, user_id=8fa8f26b17db40a0a254ee4f9759fc55, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:50.768224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a637fb-d69c-4d0d-914c-b1fd6cab68ce admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:50.788217 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 997/2010] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:50 2022] PUT /identity/v3/projects/4ebc9f36053a40f0a88bba03a38ac64b/users/8fa8f26b17db40a0a254ee4f9759fc55/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:50.789621 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b2ce2-0de0-4856-89e8-320041c8c85b None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:50.789934 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b2ce2-0de0-4856-89e8-320041c8c85b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:50.790188 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b2ce2-0de0-4856-89e8-320041c8c85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:50.799317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1014/2011] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:50 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:50.801048 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969b42f-993e-4861-a278-994b5b5a8824 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:50.801747 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969b42f-993e-4861-a278-994b5b5a8824 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:50.802249 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969b42f-993e-4861-a278-994b5b5a8824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:50.828895 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-ea7b2ce2-0de0-4856-89e8-320041c8c85b None None] MFA Rules not processed for user `b4cd8a8d29504be08fb4dfa892a7aa45`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:50.830265 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ea7b2ce2-0de0-4856-89e8-320041c8c85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:50.837468 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6969b42f-993e-4861-a278-994b5b5a8824 None None] MFA Rules not processed for user `8fa8f26b17db40a0a254ee4f9759fc55`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:50.840255 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6969b42f-993e-4861-a278-994b5b5a8824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:50.932302 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 998/2012] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:50.932302 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b2ce2-0de0-4856-89e8-320041c8c85b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:50.947257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1015/2013] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:50.947257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969b42f-993e-4861-a278-994b5b5a8824 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:50.999529 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:51.018427 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b2ce2-0de0-4856-89e8-320041c8c85b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:51.023671 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8f051-30d6-4dd8-addb-ec10bd4491bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:51.024355 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8f051-30d6-4dd8-addb-ec10bd4491bd admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:51.024640 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8f051-30d6-4dd8-addb-ec10bd4491bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:51.032962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969b42f-993e-4861-a278-994b5b5a8824 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:51.034420 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8f051-30d6-4dd8-addb-ec10bd4491bd admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:51.035245 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8f051-30d6-4dd8-addb-ec10bd4491bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:51.038637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0545f2-9ed2-4d05-a580-cdab63564fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:51.039652 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0545f2-9ed2-4d05-a580-cdab63564fce admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:51.040141 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0545f2-9ed2-4d05-a580-cdab63564fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:51.040349 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8f051-30d6-4dd8-addb-ec10bd4491bd admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:51.040823 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0545f2-9ed2-4d05-a580-cdab63564fce admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:51.041792 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0545f2-9ed2-4d05-a580-cdab63564fce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:51.044544 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0545f2-9ed2-4d05-a580-cdab63564fce admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:51.079118 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 999/2014] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:50 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:51.080060 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8f051-30d6-4dd8-addb-ec10bd4491bd admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:51.091988 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1016/2015] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:50 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:51.094079 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0545f2-9ed2-4d05-a580-cdab63564fce admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:51.189434 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0545f2-9ed2-4d05-a580-cdab63564fce admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:51.190634 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:51.197998 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab46a7-95bb-438d-bfa7-4660d3b10704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:51.199105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab46a7-95bb-438d-bfa7-4660d3b10704 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:51.199565 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab46a7-95bb-438d-bfa7-4660d3b10704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:51.199992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab46a7-95bb-438d-bfa7-4660d3b10704 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:51.200867 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab46a7-95bb-438d-bfa7-4660d3b10704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:51.201853 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8f051-30d6-4dd8-addb-ec10bd4491bd admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:51.203055 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab46a7-95bb-438d-bfa7-4660d3b10704 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:51.225537 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1017/2016] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:51.227540 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab46a7-95bb-438d-bfa7-4660d3b10704 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:51.242703 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab46a7-95bb-438d-bfa7-4660d3b10704 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:51.248793 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff569f7-7c0a-4faa-a13b-80227b933cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:51.249498 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff569f7-7c0a-4faa-a13b-80227b933cad admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:51.249773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff569f7-7c0a-4faa-a13b-80227b933cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:51.250050 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff569f7-7c0a-4faa-a13b-80227b933cad admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:51.255804 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff569f7-7c0a-4faa-a13b-80227b933cad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:51.258061 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff569f7-7c0a-4faa-a13b-80227b933cad admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:51.283553 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1018/2017] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:51 2022] POST /identity/v3/users => generated 295 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:51.283948 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99efd731-a808-48e1-a662-5ec4f47c3a4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:51.284452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff569f7-7c0a-4faa-a13b-80227b933cad admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:51.284986 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efd731-a808-48e1-a662-5ec4f47c3a4c service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:51.285272 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efd731-a808-48e1-a662-5ec4f47c3a4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:51.285551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efd731-a808-48e1-a662-5ec4f47c3a4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:51.299739 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff569f7-7c0a-4faa-a13b-80227b933cad admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:51.304665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c627f4-571f-4ffd-918f-db7a56bc7ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:51.305690 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c627f4-571f-4ffd-918f-db7a56bc7ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:51.305980 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c627f4-571f-4ffd-918f-db7a56bc7ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:51.306260 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c627f4-571f-4ffd-918f-db7a56bc7ad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:51.306989 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c627f4-571f-4ffd-918f-db7a56bc7ad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:51.308650 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c627f4-571f-4ffd-918f-db7a56bc7ad2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:51.321327 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1019/2018] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:51.321947 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c627f4-571f-4ffd-918f-db7a56bc7ad2 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:51.332124 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c627f4-571f-4ffd-918f-db7a56bc7ad2 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:51.336891 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86c63b-2040-4741-8e2c-5427de8215ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:51.337557 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86c63b-2040-4741-8e2c-5427de8215ad admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:51.337840 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86c63b-2040-4741-8e2c-5427de8215ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:51.338189 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86c63b-2040-4741-8e2c-5427de8215ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:51.338914 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86c63b-2040-4741-8e2c-5427de8215ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:51.340709 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86c63b-2040-4741-8e2c-5427de8215ad admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:51.352936 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1020/2019] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:51.353904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86c63b-2040-4741-8e2c-5427de8215ad admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:51.366521 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86c63b-2040-4741-8e2c-5427de8215ad admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:51.369009 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99efd731-a808-48e1-a662-5ec4f47c3a4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:51.370716 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99efd731-a808-48e1-a662-5ec4f47c3a4c service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:51.371787 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a28f6e-5485-42e6-ae9f-55cf7d95eedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:51.372910 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a28f6e-5485-42e6-ae9f-55cf7d95eedc admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:51.373191 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a28f6e-5485-42e6-ae9f-55cf7d95eedc admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:51.373468 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a28f6e-5485-42e6-ae9f-55cf7d95eedc admin admin] PATH_INFO: `/v3/projects/b319633e8e744c7b9d9354882553087d/users/a72015367a7a4d5299857906c9a1d2b3/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:51.382778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1000/2020] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:51.383772 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99efd731-a808-48e1-a662-5ec4f47c3a4c service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:51.396594 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a28f6e-5485-42e6-ae9f-55cf7d95eedc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b319633e8e744c7b9d9354882553087d, user_id=a72015367a7a4d5299857906c9a1d2b3, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:51.397131 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99efd731-a808-48e1-a662-5ec4f47c3a4c service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:51.399370 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a28f6e-5485-42e6-ae9f-55cf7d95eedc admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:51.402960 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49a3a4-62c4-4e67-98a4-757bd906e19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:51.404086 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49a3a4-62c4-4e67-98a4-757bd906e19f admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:51.404541 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49a3a4-62c4-4e67-98a4-757bd906e19f admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:51.404893 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49a3a4-62c4-4e67-98a4-757bd906e19f admin admin] PATH_INFO: `/v3/projects/26b487352c49495fbbec054a2386c83b/users/d87ba7a7b0ad46e6a35aeb99e0707daa/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:51.424893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1021/2021] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:51 2022] PUT /identity/v3/projects/b319633e8e744c7b9d9354882553087d/users/a72015367a7a4d5299857906c9a1d2b3/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:51.435204 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a44b9-a276-4086-9582-8749ea301d1e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:51.435983 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a44b9-a276-4086-9582-8749ea301d1e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:51.436511 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a44b9-a276-4086-9582-8749ea301d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:51.442778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49a3a4-62c4-4e67-98a4-757bd906e19f admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b487352c49495fbbec054a2386c83b, user_id=d87ba7a7b0ad46e6a35aeb99e0707daa, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:51.446008 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49a3a4-62c4-4e67-98a4-757bd906e19f admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:51.474879 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1001/2022] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:51 2022] PUT /identity/v3/projects/26b487352c49495fbbec054a2386c83b/users/d87ba7a7b0ad46e6a35aeb99e0707daa/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:51.477816 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49a3a4-62c4-4e67-98a4-757bd906e19f admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:51.494689 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-129a44b9-a276-4086-9582-8749ea301d1e None None] MFA Rules not processed for user `a72015367a7a4d5299857906c9a1d2b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:51.496011 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-129a44b9-a276-4086-9582-8749ea301d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:51.575935 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49a3a4-62c4-4e67-98a4-757bd906e19f admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:51.579892 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:51.583458 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83965e66-2a6a-43f1-83de-b6e104bfd3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:51.584573 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83965e66-2a6a-43f1-83de-b6e104bfd3ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:51.584865 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83965e66-2a6a-43f1-83de-b6e104bfd3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:51.585145 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83965e66-2a6a-43f1-83de-b6e104bfd3ee admin admin] PATH_INFO: `/v3/users/8fa8f26b17db40a0a254ee4f9759fc55` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:51.586663 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83965e66-2a6a-43f1-83de-b6e104bfd3ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fa8f26b17db40a0a254ee4f9759fc55)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:51.597018 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83965e66-2a6a-43f1-83de-b6e104bfd3ee admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:51.602920 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1022/2023] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:56:51.604454 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a44b9-a276-4086-9582-8749ea301d1e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:51.629720 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a44b9-a276-4086-9582-8749ea301d1e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:51.637248 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317a250-e911-4bfd-8ecb-bf18189e1f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:51.638511 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317a250-e911-4bfd-8ecb-bf18189e1f5f admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:51.638511 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317a250-e911-4bfd-8ecb-bf18189e1f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:51.638511 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317a250-e911-4bfd-8ecb-bf18189e1f5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:51.639263 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317a250-e911-4bfd-8ecb-bf18189e1f5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:51.641963 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317a250-e911-4bfd-8ecb-bf18189e1f5f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:51.659611 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1023/2024] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:51.660722 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317a250-e911-4bfd-8ecb-bf18189e1f5f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:51.666266 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:51.671200 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317a250-e911-4bfd-8ecb-bf18189e1f5f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:51.677535 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf10735-275b-4a5a-ab40-57708c2a8bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:51.678544 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf10735-275b-4a5a-ab40-57708c2a8bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:51.678871 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf10735-275b-4a5a-ab40-57708c2a8bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:51.679149 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf10735-275b-4a5a-ab40-57708c2a8bb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:51.679842 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-83965e66-2a6a-43f1-83de-b6e104bfd3ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fa8f26b17db40a0a254ee4f9759fc55'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:51.680204 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf10735-275b-4a5a-ab40-57708c2a8bb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:51.680961 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-83965e66-2a6a-43f1-83de-b6e104bfd3ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fa8f26b17db40a0a254ee4f9759fc55'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:51.682457 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf10735-275b-4a5a-ab40-57708c2a8bb0 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:51.690714 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-83965e66-2a6a-43f1-83de-b6e104bfd3ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fa8f26b17db40a0a254ee4f9759fc55'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:51.691571 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-83965e66-2a6a-43f1-83de-b6e104bfd3ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fa8f26b17db40a0a254ee4f9759fc55'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:51.706487 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-83965e66-2a6a-43f1-83de-b6e104bfd3ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fa8f26b17db40a0a254ee4f9759fc55'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:51.720519 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1024/2025] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:51 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:51.720519 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf10735-275b-4a5a-ab40-57708c2a8bb0 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:51.720751 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1002/2026] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:56:51 2022] DELETE /identity/v3/users/8fa8f26b17db40a0a254ee4f9759fc55 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:51.722333 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3bf10735-275b-4a5a-ab40-57708c2a8bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:51.724220 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83965e66-2a6a-43f1-83de-b6e104bfd3ee admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:51.725921 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-83965e66-2a6a-43f1-83de-b6e104bfd3ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:51.789613 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf10735-275b-4a5a-ab40-57708c2a8bb0 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:51.802732 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83965e66-2a6a-43f1-83de-b6e104bfd3ee admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:51.807528 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fec51a-d166-4382-8e48-88db101008d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:51.808212 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fec51a-d166-4382-8e48-88db101008d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:51.808748 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fec51a-d166-4382-8e48-88db101008d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:51.808748 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fec51a-d166-4382-8e48-88db101008d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:51.809443 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fec51a-d166-4382-8e48-88db101008d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:51.811400 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fec51a-d166-4382-8e48-88db101008d2 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:51.834464 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1003/2027] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:51 2022] POST /identity/v3/users => generated 298 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:51.836092 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b6ade-1d79-42de-a5af-b1e157aaef32 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:51.836642 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b6ade-1d79-42de-a5af-b1e157aaef32 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:51.837285 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b6ade-1d79-42de-a5af-b1e157aaef32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:51.852588 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51a474-35b4-4057-ad54-efedc29f8a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:51.852944 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51a474-35b4-4057-ad54-efedc29f8a95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:51.853230 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51a474-35b4-4057-ad54-efedc29f8a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:51.853500 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51a474-35b4-4057-ad54-efedc29f8a95 admin admin] PATH_INFO: `/v3/projects/26b487352c49495fbbec054a2386c83b/users/d87ba7a7b0ad46e6a35aeb99e0707daa/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:51.854926 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-790b6ade-1d79-42de-a5af-b1e157aaef32 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:51.855945 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51a474-35b4-4057-ad54-efedc29f8a95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b487352c49495fbbec054a2386c83b, user_id=d87ba7a7b0ad46e6a35aeb99e0707daa, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:51.856306 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-790b6ade-1d79-42de-a5af-b1e157aaef32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:51.858737 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51a474-35b4-4057-ad54-efedc29f8a95 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:51.865041 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1004/2028] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:51.865985 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b6ade-1d79-42de-a5af-b1e157aaef32 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:51.873995 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1025/2029] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:51 2022] PUT /identity/v3/projects/26b487352c49495fbbec054a2386c83b/users/d87ba7a7b0ad46e6a35aeb99e0707daa/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:51.878461 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b6ade-1d79-42de-a5af-b1e157aaef32 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:51.881738 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51a474-35b4-4057-ad54-efedc29f8a95 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:51.884218 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3d51a474-35b4-4057-ad54-efedc29f8a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:51.949402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a3850-046b-4074-b4c1-ce89f2a75910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:51.950373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a3850-046b-4074-b4c1-ce89f2a75910 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:51.950800 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a3850-046b-4074-b4c1-ce89f2a75910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:51.951301 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a3850-046b-4074-b4c1-ce89f2a75910 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:51.952185 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a3850-046b-4074-b4c1-ce89f2a75910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:51.953967 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a3850-046b-4074-b4c1-ce89f2a75910 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:51.956339 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51a474-35b4-4057-ad54-efedc29f8a95 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:51.960434 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575fd88-8b05-4a5e-9ce0-366ab29cedf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:51.961210 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575fd88-8b05-4a5e-9ce0-366ab29cedf7 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:51.961499 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575fd88-8b05-4a5e-9ce0-366ab29cedf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:51.961775 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575fd88-8b05-4a5e-9ce0-366ab29cedf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:51.966822 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1005/2030] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:51.968349 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074c4a8-b78e-4e40-a322-9f41e85f2007 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:51.968784 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074c4a8-b78e-4e40-a322-9f41e85f2007 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:51.969202 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074c4a8-b78e-4e40-a322-9f41e85f2007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:51.997384 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575fd88-8b05-4a5e-9ce0-366ab29cedf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:51.998868 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575fd88-8b05-4a5e-9ce0-366ab29cedf7 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:52.005697 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-3074c4a8-b78e-4e40-a322-9f41e85f2007 None None] MFA Rules not processed for user `d87ba7a7b0ad46e6a35aeb99e0707daa`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:52.009806 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-3074c4a8-b78e-4e40-a322-9f41e85f2007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:52.011865 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:52.031664 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1026/2031] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:52.037393 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575fd88-8b05-4a5e-9ce0-366ab29cedf7 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:52.039670 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:52.073307 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575fd88-8b05-4a5e-9ce0-366ab29cedf7 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:52.084799 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84821cb6-4570-4b92-bbbf-aace2af05956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:52.086186 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84821cb6-4570-4b92-bbbf-aace2af05956 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:52.087598 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84821cb6-4570-4b92-bbbf-aace2af05956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:52.087964 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84821cb6-4570-4b92-bbbf-aace2af05956 admin admin] PATH_INFO: `/v3/projects/c9b8ac7726e34adea1ce2511be7ea285/users/d7193ccb122d422a88fa61f72cdf391f/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:52.119267 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1006/2032] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:51 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:52.131157 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074c4a8-b78e-4e40-a322-9f41e85f2007 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:52.134166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-3074c4a8-b78e-4e40-a322-9f41e85f2007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:52.134799 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84821cb6-4570-4b92-bbbf-aace2af05956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9b8ac7726e34adea1ce2511be7ea285, user_id=d7193ccb122d422a88fa61f72cdf391f, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:52.144114 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84821cb6-4570-4b92-bbbf-aace2af05956 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:52.171298 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1027/2033] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:52 2022] PUT /identity/v3/projects/c9b8ac7726e34adea1ce2511be7ea285/users/d7193ccb122d422a88fa61f72cdf391f/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:52.172533 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84821cb6-4570-4b92-bbbf-aace2af05956 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:52.246152 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074c4a8-b78e-4e40-a322-9f41e85f2007 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:52.280267 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84821cb6-4570-4b92-bbbf-aace2af05956 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:52.288966 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd126b-b23e-4d81-babe-52edcce28d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:52.289698 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd126b-b23e-4d81-babe-52edcce28d86 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:52.289983 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd126b-b23e-4d81-babe-52edcce28d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:52.290271 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd126b-b23e-4d81-babe-52edcce28d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:52.291148 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd126b-b23e-4d81-babe-52edcce28d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:52.300554 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd126b-b23e-4d81-babe-52edcce28d86 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:52.324443 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1028/2034] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:52.329952 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd126b-b23e-4d81-babe-52edcce28d86 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:52.338779 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d3209-48a5-43f8-98a9-565ad99d31c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:52.339778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d3209-48a5-43f8-98a9-565ad99d31c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:52.340178 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d3209-48a5-43f8-98a9-565ad99d31c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:52.340459 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d3209-48a5-43f8-98a9-565ad99d31c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:52.342585 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-329d3209-48a5-43f8-98a9-565ad99d31c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:52.351417 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd126b-b23e-4d81-babe-52edcce28d86 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:52.370916 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5fd71-2dee-4a44-9a69-89ad01cd8dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:52.371516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5fd71-2dee-4a44-9a69-89ad01cd8dd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:52.371872 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5fd71-2dee-4a44-9a69-89ad01cd8dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:52.373476 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5fd71-2dee-4a44-9a69-89ad01cd8dd2 admin admin] PATH_INFO: `/v3/projects/c9b8ac7726e34adea1ce2511be7ea285/users/d7193ccb122d422a88fa61f72cdf391f/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:52.380788 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5fd71-2dee-4a44-9a69-89ad01cd8dd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9b8ac7726e34adea1ce2511be7ea285, user_id=d7193ccb122d422a88fa61f72cdf391f, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:52.384896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5fd71-2dee-4a44-9a69-89ad01cd8dd2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:52.411355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1029/2035] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:52 2022] PUT /identity/v3/projects/c9b8ac7726e34adea1ce2511be7ea285/users/d7193ccb122d422a88fa61f72cdf391f/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 05:56:52.422518 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5d35d-92e5-47e1-bc12-f7207e40505c None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:52.423047 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5d35d-92e5-47e1-bc12-f7207e40505c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:52.423047 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5d35d-92e5-47e1-bc12-f7207e40505c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:52.442127 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d3209-48a5-43f8-98a9-565ad99d31c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:52.443728 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d3209-48a5-43f8-98a9-565ad99d31c1 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:52.468398 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1007/2036] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 05:56:52.478366 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-eeb5d35d-92e5-47e1-bc12-f7207e40505c None None] MFA Rules not processed for user `d7193ccb122d422a88fa61f72cdf391f`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:52.479824 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-eeb5d35d-92e5-47e1-bc12-f7207e40505c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:52.533294 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d3209-48a5-43f8-98a9-565ad99d31c1 service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:52.534815 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-329d3209-48a5-43f8-98a9-565ad99d31c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:52.567155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d3209-48a5-43f8-98a9-565ad99d31c1 service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:52.656644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1030/2037] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:56:52.672347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5d35d-92e5-47e1-bc12-f7207e40505c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:52.677209 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:52.680595 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-eeb5d35d-92e5-47e1-bc12-f7207e40505c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:52.754390 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fb7ac-a50a-4905-b89f-f936efc8b899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:52.756596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fb7ac-a50a-4905-b89f-f936efc8b899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:52.758142 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fb7ac-a50a-4905-b89f-f936efc8b899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:52.758497 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fb7ac-a50a-4905-b89f-f936efc8b899 admin admin] PATH_INFO: `/v3/projects/4ebc9f36053a40f0a88bba03a38ac64b` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:52.760718 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962fb7ac-a50a-4905-b89f-f936efc8b899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ebc9f36053a40f0a88bba03a38ac64b)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:52.766302 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962fb7ac-a50a-4905-b89f-f936efc8b899 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:52.808355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:52.830032 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5d35d-92e5-47e1-bc12-f7207e40505c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:52.839501 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad77d02-b2ad-4a4f-8e84-7752cb97c7e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:52.840398 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad77d02-b2ad-4a4f-8e84-7752cb97c7e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:52.842033 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad77d02-b2ad-4a4f-8e84-7752cb97c7e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:52.842033 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad77d02-b2ad-4a4f-8e84-7752cb97c7e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:52.845310 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7ad77d02-b2ad-4a4f-8e84-7752cb97c7e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:52.872614 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-962fb7ac-a50a-4905-b89f-f936efc8b899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ebc9f36053a40f0a88bba03a38ac64b', 'request_id': 'req-962fb7ac-a50a-4905-b89f-f936efc8b899'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:52.883783 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-962fb7ac-a50a-4905-b89f-f936efc8b899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ebc9f36053a40f0a88bba03a38ac64b', 'request_id': 'req-962fb7ac-a50a-4905-b89f-f936efc8b899'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:52.894949 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-962fb7ac-a50a-4905-b89f-f936efc8b899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ebc9f36053a40f0a88bba03a38ac64b', 'request_id': 'req-962fb7ac-a50a-4905-b89f-f936efc8b899'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:52.916758 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-962fb7ac-a50a-4905-b89f-f936efc8b899 admin admin] The token cache is being invalidate because project 4ebc9f36053a40f0a88bba03a38ac64b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:56:52.919220 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-962fb7ac-a50a-4905-b89f-f936efc8b899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:52.920548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-962fb7ac-a50a-4905-b89f-f936efc8b899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:52.925041 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1008/2038] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:56:52 2022] DELETE /identity/v3/projects/4ebc9f36053a40f0a88bba03a38ac64b => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:52.930068 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad74b70-08e2-4a46-ab39-64ef19cb5ece None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:52.930365 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad74b70-08e2-4a46-ab39-64ef19cb5ece None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:52.930864 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad74b70-08e2-4a46-ab39-64ef19cb5ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:52.951833 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad77d02-b2ad-4a4f-8e84-7752cb97c7e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:52.953641 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad77d02-b2ad-4a4f-8e84-7752cb97c7e9 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:52.977082 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-0ad74b70-08e2-4a46-ab39-64ef19cb5ece None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:52.978767 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-0ad74b70-08e2-4a46-ab39-64ef19cb5ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:52.978916 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1031/2039] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:53.098175 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1009/2040] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:53.106629 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092269ad-21c9-4e67-8333-266c140b068b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:53.107020 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092269ad-21c9-4e67-8333-266c140b068b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:53.107490 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092269ad-21c9-4e67-8333-266c140b068b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:53.143803 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-092269ad-21c9-4e67-8333-266c140b068b None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:53.145309 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-092269ad-21c9-4e67-8333-266c140b068b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:53.181505 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1032/2041] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:56:53.186304 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad74b70-08e2-4a46-ab39-64ef19cb5ece None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:53.197891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad74b70-08e2-4a46-ab39-64ef19cb5ece None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:53.203393 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd94ab-aa35-4054-8b0e-104ff973a303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:53.204191 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd94ab-aa35-4054-8b0e-104ff973a303 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:53.204580 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd94ab-aa35-4054-8b0e-104ff973a303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:53.204919 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd94ab-aa35-4054-8b0e-104ff973a303 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:53.206561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd94ab-aa35-4054-8b0e-104ff973a303 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:56:53.207054 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd94ab-aa35-4054-8b0e-104ff973a303 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:53.209079 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd94ab-aa35-4054-8b0e-104ff973a303 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:53.225331 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1010/2042] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:56:53.232576 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092269ad-21c9-4e67-8333-266c140b068b None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:53.245490 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092269ad-21c9-4e67-8333-266c140b068b None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:53.250497 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867447b7-3ec0-461c-9709-02e3ba93ffdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:53.251169 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867447b7-3ec0-461c-9709-02e3ba93ffdb admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:53.251588 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867447b7-3ec0-461c-9709-02e3ba93ffdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:53.251866 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867447b7-3ec0-461c-9709-02e3ba93ffdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:53.252555 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867447b7-3ec0-461c-9709-02e3ba93ffdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:53.254557 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867447b7-3ec0-461c-9709-02e3ba93ffdb admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:53.301824 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1033/2043] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:53 2022] POST /identity/v3/projects => generated 377 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:53.303098 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd94ab-aa35-4054-8b0e-104ff973a303 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:53.316905 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd94ab-aa35-4054-8b0e-104ff973a303 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:53.392259 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:53.412137 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8eedc-cb0b-4c82-b439-cfec4026bc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:53.413423 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8eedc-cb0b-4c82-b439-cfec4026bc2d admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:53.414316 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8eedc-cb0b-4c82-b439-cfec4026bc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:53.415314 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8eedc-cb0b-4c82-b439-cfec4026bc2d admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:53.416151 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8eedc-cb0b-4c82-b439-cfec4026bc2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:53.419210 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8eedc-cb0b-4c82-b439-cfec4026bc2d admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:53.472167 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1011/2044] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:53 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 05:56:53.472961 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867447b7-3ec0-461c-9709-02e3ba93ffdb admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:53.484285 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867447b7-3ec0-461c-9709-02e3ba93ffdb admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:53.491986 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a6c67-b35c-4833-ac15-699bf55d7f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:53.494074 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a6c67-b35c-4833-ac15-699bf55d7f01 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:53.495509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a6c67-b35c-4833-ac15-699bf55d7f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:53.496000 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a6c67-b35c-4833-ac15-699bf55d7f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:53.497079 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a6c67-b35c-4833-ac15-699bf55d7f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:53.498898 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a6c67-b35c-4833-ac15-699bf55d7f01 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:53.510913 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1034/2045] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:53.515024 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8eedc-cb0b-4c82-b439-cfec4026bc2d admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:53.534615 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8eedc-cb0b-4c82-b439-cfec4026bc2d admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:53.546379 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559dd52-7b44-4858-b395-f6e0e906897f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:53.549178 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559dd52-7b44-4858-b395-f6e0e906897f admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:53.549481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559dd52-7b44-4858-b395-f6e0e906897f admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:53.549763 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559dd52-7b44-4858-b395-f6e0e906897f admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:53.550541 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559dd52-7b44-4858-b395-f6e0e906897f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:53.562343 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559dd52-7b44-4858-b395-f6e0e906897f admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:53.604849 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1012/2046] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:53.609105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a6c67-b35c-4833-ac15-699bf55d7f01 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:53.622194 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a6c67-b35c-4833-ac15-699bf55d7f01 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:53.635314 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab59f62-ccc5-47e1-95b8-6b831b196a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:53.637350 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab59f62-ccc5-47e1-95b8-6b831b196a70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:53.637633 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab59f62-ccc5-47e1-95b8-6b831b196a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:53.638008 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab59f62-ccc5-47e1-95b8-6b831b196a70 admin admin] PATH_INFO: `/v3/projects/c10f5f8821694132b66cf135144b3d3c/users/f88c264468e24e43b932c4b2ac8d6829/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:53.665384 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab59f62-ccc5-47e1-95b8-6b831b196a70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c10f5f8821694132b66cf135144b3d3c, user_id=f88c264468e24e43b932c4b2ac8d6829, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:53.669049 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab59f62-ccc5-47e1-95b8-6b831b196a70 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:53.687460 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1035/2047] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:53 2022] PUT /identity/v3/projects/c10f5f8821694132b66cf135144b3d3c/users/f88c264468e24e43b932c4b2ac8d6829/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:53.701729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49fb1b-ed79-4b2e-ba80-60df2311428d None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:53.702019 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49fb1b-ed79-4b2e-ba80-60df2311428d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:53.702296 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49fb1b-ed79-4b2e-ba80-60df2311428d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:53.766390 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-1b49fb1b-ed79-4b2e-ba80-60df2311428d None None] MFA Rules not processed for user `f88c264468e24e43b932c4b2ac8d6829`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:53.768025 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-1b49fb1b-ed79-4b2e-ba80-60df2311428d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:53.863372 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1013/2048] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:53.876251 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab59f62-ccc5-47e1-95b8-6b831b196a70 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:53.878328 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0ab59f62-ccc5-47e1-95b8-6b831b196a70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:53.969514 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab59f62-ccc5-47e1-95b8-6b831b196a70 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:53.977152 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b837ec-de7b-4e5a-b63c-b4a6c2ba04fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:53.977823 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b837ec-de7b-4e5a-b63c-b4a6c2ba04fc service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:53.978107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b837ec-de7b-4e5a-b63c-b4a6c2ba04fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:53.978415 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b837ec-de7b-4e5a-b63c-b4a6c2ba04fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:53.993893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b837ec-de7b-4e5a-b63c-b4a6c2ba04fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:53.996940 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b837ec-de7b-4e5a-b63c-b4a6c2ba04fc service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:54.006933 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1036/2049] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 05:56:54.185984 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49fb1b-ed79-4b2e-ba80-60df2311428d None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:54.187872 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-1b49fb1b-ed79-4b2e-ba80-60df2311428d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:54.213111 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49fb1b-ed79-4b2e-ba80-60df2311428d None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:54.222902 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0056f-7269-48ff-b66a-e3247528a3f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:54.225124 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0056f-7269-48ff-b66a-e3247528a3f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:54.225413 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0056f-7269-48ff-b66a-e3247528a3f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:54.225699 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0056f-7269-48ff-b66a-e3247528a3f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:54.229197 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-05a0056f-7269-48ff-b66a-e3247528a3f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:54.335352 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0056f-7269-48ff-b66a-e3247528a3f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:54.336832 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0056f-7269-48ff-b66a-e3247528a3f0 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:54.348998 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1014/2050] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:54 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:54.811671 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b837ec-de7b-4e5a-b63c-b4a6c2ba04fc service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:54.822196 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b837ec-de7b-4e5a-b63c-b4a6c2ba04fc service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:54.828989 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cdd9a-c695-4b8e-bc23-2a7131a45424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:54.829904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cdd9a-c695-4b8e-bc23-2a7131a45424 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:54.830328 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cdd9a-c695-4b8e-bc23-2a7131a45424 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:54.830702 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cdd9a-c695-4b8e-bc23-2a7131a45424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:54.834651 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-615cdd9a-c695-4b8e-bc23-2a7131a45424 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:54.885161 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:54.933316 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615cdd9a-c695-4b8e-bc23-2a7131a45424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:54.934827 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615cdd9a-c695-4b8e-bc23-2a7131a45424 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:54.955393 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1037/2051] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:55.872131 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0056f-7269-48ff-b66a-e3247528a3f0 service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:55.883737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0056f-7269-48ff-b66a-e3247528a3f0 service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:55.896437 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d092fa9-3e2b-42ca-a0fa-fc1741956bea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:55.897523 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d092fa9-3e2b-42ca-a0fa-fc1741956bea service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:55.898591 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d092fa9-3e2b-42ca-a0fa-fc1741956bea service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:55.899093 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d092fa9-3e2b-42ca-a0fa-fc1741956bea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:55.903717 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9d092fa9-3e2b-42ca-a0fa-fc1741956bea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:55.968028 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:55.994607 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d092fa9-3e2b-42ca-a0fa-fc1741956bea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:55.996352 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d092fa9-3e2b-42ca-a0fa-fc1741956bea service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:56.010670 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1015/2052] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:55 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:56.351562 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cdd9a-c695-4b8e-bc23-2a7131a45424 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:56.353193 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-615cdd9a-c695-4b8e-bc23-2a7131a45424 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:56.444946 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cdd9a-c695-4b8e-bc23-2a7131a45424 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:56.450060 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e2989-7121-4735-9a89-cf6c3d0ebf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:56.452145 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e2989-7121-4735-9a89-cf6c3d0ebf92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:56.452686 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e2989-7121-4735-9a89-cf6c3d0ebf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:56.453068 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e2989-7121-4735-9a89-cf6c3d0ebf92 admin admin] PATH_INFO: `/v3/users/0d7f039ac1394cc09bb77f15ce1f80cc` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:56.454475 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e2989-7121-4735-9a89-cf6c3d0ebf92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d7f039ac1394cc09bb77f15ce1f80cc)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:56.457220 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e2989-7121-4735-9a89-cf6c3d0ebf92 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:56.523411 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a23e2989-7121-4735-9a89-cf6c3d0ebf92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d7f039ac1394cc09bb77f15ce1f80cc'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:56.536945 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a23e2989-7121-4735-9a89-cf6c3d0ebf92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d7f039ac1394cc09bb77f15ce1f80cc'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:56.548393 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a23e2989-7121-4735-9a89-cf6c3d0ebf92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d7f039ac1394cc09bb77f15ce1f80cc'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:56.549160 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a23e2989-7121-4735-9a89-cf6c3d0ebf92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d7f039ac1394cc09bb77f15ce1f80cc'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:56.567383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a23e2989-7121-4735-9a89-cf6c3d0ebf92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d7f039ac1394cc09bb77f15ce1f80cc'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:56.574317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1038/2053] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:56:56 2022] DELETE /identity/v3/users/0d7f039ac1394cc09bb77f15ce1f80cc => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:56.583967 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15dc5df-a26a-44db-a013-737bac6a9cd8 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:56.584671 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15dc5df-a26a-44db-a013-737bac6a9cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:56.585046 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15dc5df-a26a-44db-a013-737bac6a9cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:56.625871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d15dc5df-a26a-44db-a013-737bac6a9cd8 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:56.627207 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d15dc5df-a26a-44db-a013-737bac6a9cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:56.751256 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1016/2054] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:56.794665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e2989-7121-4735-9a89-cf6c3d0ebf92 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:56.796235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a23e2989-7121-4735-9a89-cf6c3d0ebf92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:56.925769 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e2989-7121-4735-9a89-cf6c3d0ebf92 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:56.935667 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5105a6b-545e-4578-b7e9-f7fa173d938f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:56.936193 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5105a6b-545e-4578-b7e9-f7fa173d938f service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:56.936505 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5105a6b-545e-4578-b7e9-f7fa173d938f service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:56.936780 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5105a6b-545e-4578-b7e9-f7fa173d938f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:56.948893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5105a6b-545e-4578-b7e9-f7fa173d938f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:56.950395 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5105a6b-545e-4578-b7e9-f7fa173d938f service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:56.954735 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:56.962655 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1039/2055] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:56:57.678627 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15dc5df-a26a-44db-a013-737bac6a9cd8 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:57.680150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d15dc5df-a26a-44db-a013-737bac6a9cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:57.702233 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15dc5df-a26a-44db-a013-737bac6a9cd8 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:57.702233 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b2514-5c26-4baf-9b4f-d4ff4b45de00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:57.702233 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b2514-5c26-4baf-9b4f-d4ff4b45de00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:57.702233 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b2514-5c26-4baf-9b4f-d4ff4b45de00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:57.702579 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b2514-5c26-4baf-9b4f-d4ff4b45de00 admin admin] PATH_INFO: `/v3/projects/80f08d071f0c49fcb0be4006dd2bfbb2` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:57.703846 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b2514-5c26-4baf-9b4f-d4ff4b45de00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80f08d071f0c49fcb0be4006dd2bfbb2)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:57.705936 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b2514-5c26-4baf-9b4f-d4ff4b45de00 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:57.769301 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e92b2514-5c26-4baf-9b4f-d4ff4b45de00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80f08d071f0c49fcb0be4006dd2bfbb2', 'request_id': 'req-e92b2514-5c26-4baf-9b4f-d4ff4b45de00'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:57.781980 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e92b2514-5c26-4baf-9b4f-d4ff4b45de00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80f08d071f0c49fcb0be4006dd2bfbb2', 'request_id': 'req-e92b2514-5c26-4baf-9b4f-d4ff4b45de00'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:57.796171 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e92b2514-5c26-4baf-9b4f-d4ff4b45de00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80f08d071f0c49fcb0be4006dd2bfbb2', 'request_id': 'req-e92b2514-5c26-4baf-9b4f-d4ff4b45de00'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:57.815840 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e92b2514-5c26-4baf-9b4f-d4ff4b45de00 admin admin] The token cache is being invalidate because project 80f08d071f0c49fcb0be4006dd2bfbb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:56:57.816224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e92b2514-5c26-4baf-9b4f-d4ff4b45de00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:57.816963 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e92b2514-5c26-4baf-9b4f-d4ff4b45de00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:57.819017 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1017/2056] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:56:57 2022] DELETE /identity/v3/projects/80f08d071f0c49fcb0be4006dd2bfbb2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:57.822693 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5105a6b-545e-4578-b7e9-f7fa173d938f service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:57.833769 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5105a6b-545e-4578-b7e9-f7fa173d938f service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:57.901303 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3119b-e529-485a-951e-57d5f7321b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:57.902201 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3119b-e529-485a-951e-57d5f7321b3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:57.902509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3119b-e529-485a-951e-57d5f7321b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:57.902779 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3119b-e529-485a-951e-57d5f7321b3a admin admin] PATH_INFO: `/v3/users/69b70d5d25ad4310b0b17142e9fc5c81` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:57.904047 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3119b-e529-485a-951e-57d5f7321b3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=69b70d5d25ad4310b0b17142e9fc5c81)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:57.905977 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3119b-e529-485a-951e-57d5f7321b3a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:57.959834 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fcb3119b-e529-485a-951e-57d5f7321b3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69b70d5d25ad4310b0b17142e9fc5c81'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:57.967945 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fcb3119b-e529-485a-951e-57d5f7321b3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69b70d5d25ad4310b0b17142e9fc5c81'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:57.977642 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fcb3119b-e529-485a-951e-57d5f7321b3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69b70d5d25ad4310b0b17142e9fc5c81'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:57.978370 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fcb3119b-e529-485a-951e-57d5f7321b3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69b70d5d25ad4310b0b17142e9fc5c81'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:57.996657 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fcb3119b-e529-485a-951e-57d5f7321b3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69b70d5d25ad4310b0b17142e9fc5c81'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:58.006742 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1040/2057] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:56:57 2022] DELETE /identity/v3/users/69b70d5d25ad4310b0b17142e9fc5c81 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:58.284621 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b2514-5c26-4baf-9b4f-d4ff4b45de00 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:58.286314 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e92b2514-5c26-4baf-9b4f-d4ff4b45de00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:58.305798 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b2514-5c26-4baf-9b4f-d4ff4b45de00 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:58.382078 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314b4a7-7bda-4e10-8992-7ed6f5e2092a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:58.383567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314b4a7-7bda-4e10-8992-7ed6f5e2092a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:58.383886 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314b4a7-7bda-4e10-8992-7ed6f5e2092a admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:58.384191 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314b4a7-7bda-4e10-8992-7ed6f5e2092a admin admin] PATH_INFO: `/v3/projects/8727125525f7488f8b221a04557a18d8` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:58.385600 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8314b4a7-7bda-4e10-8992-7ed6f5e2092a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8727125525f7488f8b221a04557a18d8)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:58.388118 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8314b4a7-7bda-4e10-8992-7ed6f5e2092a admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:58.395096 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:58.443617 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-8314b4a7-7bda-4e10-8992-7ed6f5e2092a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8727125525f7488f8b221a04557a18d8', 'request_id': 'req-8314b4a7-7bda-4e10-8992-7ed6f5e2092a'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:58.452854 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-8314b4a7-7bda-4e10-8992-7ed6f5e2092a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8727125525f7488f8b221a04557a18d8', 'request_id': 'req-8314b4a7-7bda-4e10-8992-7ed6f5e2092a'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:58.463588 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-8314b4a7-7bda-4e10-8992-7ed6f5e2092a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8727125525f7488f8b221a04557a18d8', 'request_id': 'req-8314b4a7-7bda-4e10-8992-7ed6f5e2092a'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:58.474967 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-8314b4a7-7bda-4e10-8992-7ed6f5e2092a admin admin] The token cache is being invalidate because project 8727125525f7488f8b221a04557a18d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:56:58.475288 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-8314b4a7-7bda-4e10-8992-7ed6f5e2092a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:58.476146 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-8314b4a7-7bda-4e10-8992-7ed6f5e2092a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:58.478065 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1018/2058] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:56:58 2022] DELETE /identity/v3/projects/8727125525f7488f8b221a04557a18d8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:58.483078 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3895525-fff9-4d9d-93d9-b1bcdc5b8cfc None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:58.483389 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3895525-fff9-4d9d-93d9-b1bcdc5b8cfc None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:58.483699 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3895525-fff9-4d9d-93d9-b1bcdc5b8cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:58.502962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-c3895525-fff9-4d9d-93d9-b1bcdc5b8cfc None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:58.504507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c3895525-fff9-4d9d-93d9-b1bcdc5b8cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:58.572224 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1041/2059] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:58.581387 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010f465-adb1-4324-b499-0b5b97155ad1 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:58.581676 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010f465-adb1-4324-b499-0b5b97155ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:58.581923 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010f465-adb1-4324-b499-0b5b97155ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:58.600698 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-e010f465-adb1-4324-b499-0b5b97155ad1 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:58.601999 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e010f465-adb1-4324-b499-0b5b97155ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:58.609896 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1019/2060] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:56:58.614616 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3895525-fff9-4d9d-93d9-b1bcdc5b8cfc None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:58.624442 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3895525-fff9-4d9d-93d9-b1bcdc5b8cfc None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:58.629019 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17995dbb-b279-41c9-9b32-e467b15b7769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:58.629656 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17995dbb-b279-41c9-9b32-e467b15b7769 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:58.629928 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17995dbb-b279-41c9-9b32-e467b15b7769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:58.630193 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17995dbb-b279-41c9-9b32-e467b15b7769 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:58.630915 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17995dbb-b279-41c9-9b32-e467b15b7769 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:56:58.631247 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17995dbb-b279-41c9-9b32-e467b15b7769 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:58.632901 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17995dbb-b279-41c9-9b32-e467b15b7769 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:58.644434 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1042/2061] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:56:58.648699 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010f465-adb1-4324-b499-0b5b97155ad1 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:58.658798 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010f465-adb1-4324-b499-0b5b97155ad1 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:58.664116 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71b4af-0988-493e-a30b-9ce25eca2aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:58.664798 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71b4af-0988-493e-a30b-9ce25eca2aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:58.665082 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71b4af-0988-493e-a30b-9ce25eca2aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:58.665360 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71b4af-0988-493e-a30b-9ce25eca2aa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:58.666050 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71b4af-0988-493e-a30b-9ce25eca2aa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:58.668012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71b4af-0988-493e-a30b-9ce25eca2aa9 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:58.696626 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1020/2062] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:58 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 05:56:58.701436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17995dbb-b279-41c9-9b32-e467b15b7769 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:58.708209 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:58.712103 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17995dbb-b279-41c9-9b32-e467b15b7769 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:58.726744 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71b4af-0988-493e-a30b-9ce25eca2aa9 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:58.728621 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ea71b4af-0988-493e-a30b-9ce25eca2aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:58.785983 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3ac74-735d-4f79-adde-8542bc743c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:58.786678 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3ac74-735d-4f79-adde-8542bc743c88 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:58.786978 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3ac74-735d-4f79-adde-8542bc743c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:58.787266 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3ac74-735d-4f79-adde-8542bc743c88 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:58.787956 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3ac74-735d-4f79-adde-8542bc743c88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:58.790003 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3ac74-735d-4f79-adde-8542bc743c88 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:58.802662 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71b4af-0988-493e-a30b-9ce25eca2aa9 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:58.808065 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7c31a-8206-4dd7-a488-2f32a81d2651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:58.808953 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7c31a-8206-4dd7-a488-2f32a81d2651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:58.809232 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7c31a-8206-4dd7-a488-2f32a81d2651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:58.809511 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7c31a-8206-4dd7-a488-2f32a81d2651 admin admin] PATH_INFO: `/v3/users/b4cd8a8d29504be08fb4dfa892a7aa45` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:58.810730 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7c31a-8206-4dd7-a488-2f32a81d2651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4cd8a8d29504be08fb4dfa892a7aa45)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:58.812687 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7c31a-8206-4dd7-a488-2f32a81d2651 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:58.813250 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1043/2063] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:58 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:58.828503 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3ac74-735d-4f79-adde-8542bc743c88 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:58.841785 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3ac74-735d-4f79-adde-8542bc743c88 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:58.847687 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843d4a2-0d6d-4d84-948a-e9b93cbf2798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:58.849746 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843d4a2-0d6d-4d84-948a-e9b93cbf2798 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:58.850072 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843d4a2-0d6d-4d84-948a-e9b93cbf2798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:58.850539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843d4a2-0d6d-4d84-948a-e9b93cbf2798 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:58.851596 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2843d4a2-0d6d-4d84-948a-e9b93cbf2798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:58.853641 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2843d4a2-0d6d-4d84-948a-e9b93cbf2798 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:58.867876 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1044/2064] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:58.870302 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-bca7c31a-8206-4dd7-a488-2f32a81d2651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4cd8a8d29504be08fb4dfa892a7aa45'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:58.871070 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-bca7c31a-8206-4dd7-a488-2f32a81d2651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4cd8a8d29504be08fb4dfa892a7aa45'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:58.872498 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843d4a2-0d6d-4d84-948a-e9b93cbf2798 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:58.874785 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2843d4a2-0d6d-4d84-948a-e9b93cbf2798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:58.881893 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-bca7c31a-8206-4dd7-a488-2f32a81d2651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4cd8a8d29504be08fb4dfa892a7aa45'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:58.882749 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-bca7c31a-8206-4dd7-a488-2f32a81d2651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4cd8a8d29504be08fb4dfa892a7aa45'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:58.890640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843d4a2-0d6d-4d84-948a-e9b93cbf2798 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:58.896733 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:58.897588 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec91f44-1de0-477b-88ba-fccb78e2a777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:58.898334 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec91f44-1de0-477b-88ba-fccb78e2a777 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:58.898849 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec91f44-1de0-477b-88ba-fccb78e2a777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:58.899157 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec91f44-1de0-477b-88ba-fccb78e2a777 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:58.900072 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec91f44-1de0-477b-88ba-fccb78e2a777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:58.900732 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-bca7c31a-8206-4dd7-a488-2f32a81d2651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4cd8a8d29504be08fb4dfa892a7aa45'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:56:58.901826 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec91f44-1de0-477b-88ba-fccb78e2a777 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:58.921428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1045/2065] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 05:56:58.924913 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec91f44-1de0-477b-88ba-fccb78e2a777 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:58.926467 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1021/2066] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:56:58 2022] DELETE /identity/v3/users/b4cd8a8d29504be08fb4dfa892a7aa45 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 05:56:58.932763 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c70788-fe3b-4cd3-aa9f-c548fc8f0635 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:58.933061 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c70788-fe3b-4cd3-aa9f-c548fc8f0635 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:58.933341 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c70788-fe3b-4cd3-aa9f-c548fc8f0635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:58.939334 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec91f44-1de0-477b-88ba-fccb78e2a777 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:58.955277 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-30c70788-fe3b-4cd3-aa9f-c548fc8f0635 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:58.956761 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-30c70788-fe3b-4cd3-aa9f-c548fc8f0635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:59.032525 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7768d09-3d8d-49fa-b165-fed7075af845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:59.033438 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7768d09-3d8d-49fa-b165-fed7075af845 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:59.033817 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7768d09-3d8d-49fa-b165-fed7075af845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:59.034188 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7768d09-3d8d-49fa-b165-fed7075af845 admin admin] PATH_INFO: `/v3/projects/18fa9a873e84480fbf262b14078df428/users/37b4819417964d7283798754f66efb1a/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:59.057190 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7768d09-3d8d-49fa-b165-fed7075af845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18fa9a873e84480fbf262b14078df428, user_id=37b4819417964d7283798754f66efb1a, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:59.062147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7768d09-3d8d-49fa-b165-fed7075af845 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:59.067377 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1022/2067] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:59.081020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c70788-fe3b-4cd3-aa9f-c548fc8f0635 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:59.084913 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-30c70788-fe3b-4cd3-aa9f-c548fc8f0635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:59.088415 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1046/2068] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:58 2022] PUT /identity/v3/projects/18fa9a873e84480fbf262b14078df428/users/37b4819417964d7283798754f66efb1a/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:59.100596 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94c152-0f32-42c4-ba3e-fe6cf5a6ff08 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:59.101027 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94c152-0f32-42c4-ba3e-fe6cf5a6ff08 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:59.101433 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94c152-0f32-42c4-ba3e-fe6cf5a6ff08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:59.131358 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-3f94c152-0f32-42c4-ba3e-fe6cf5a6ff08 None None] MFA Rules not processed for user `37b4819417964d7283798754f66efb1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:59.133377 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3f94c152-0f32-42c4-ba3e-fe6cf5a6ff08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:59.181636 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c70788-fe3b-4cd3-aa9f-c548fc8f0635 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:59.200023 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:59.241600 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1047/2069] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:56:59.246019 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94c152-0f32-42c4-ba3e-fe6cf5a6ff08 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:59.256600 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb42ea6-e523-4a42-a6ee-f10563389310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:59.260341 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb42ea6-e523-4a42-a6ee-f10563389310 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:59.260341 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb42ea6-e523-4a42-a6ee-f10563389310 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:59.260341 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb42ea6-e523-4a42-a6ee-f10563389310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:59.353350 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:59.372931 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb42ea6-e523-4a42-a6ee-f10563389310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:59.379353 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb42ea6-e523-4a42-a6ee-f10563389310 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:59.393239 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94c152-0f32-42c4-ba3e-fe6cf5a6ff08 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:59.414046 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1023/2070] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:56:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 05:56:59.415446 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53df502-48ef-41ab-9d6e-bd3fdb9fa4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:59.416755 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53df502-48ef-41ab-9d6e-bd3fdb9fa4ee admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:59.417105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53df502-48ef-41ab-9d6e-bd3fdb9fa4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:59.417559 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53df502-48ef-41ab-9d6e-bd3fdb9fa4ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:59.420555 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53df502-48ef-41ab-9d6e-bd3fdb9fa4ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:59.423750 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53df502-48ef-41ab-9d6e-bd3fdb9fa4ee admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:59.483910 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1048/2071] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:56:59 2022] POST /identity/v3/projects => generated 373 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:59.487322 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb42ea6-e523-4a42-a6ee-f10563389310 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:59.501475 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb42ea6-e523-4a42-a6ee-f10563389310 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:59.636323 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc6c36-6ee4-499e-947a-d4cef571a8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:59.637125 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc6c36-6ee4-499e-947a-d4cef571a8e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:59.637479 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc6c36-6ee4-499e-947a-d4cef571a8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:59.637823 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc6c36-6ee4-499e-947a-d4cef571a8e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:59.638610 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc6c36-6ee4-499e-947a-d4cef571a8e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:59.640729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc6c36-6ee4-499e-947a-d4cef571a8e7 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:59.668774 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1024/2072] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:56:59 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:56:59.672997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53df502-48ef-41ab-9d6e-bd3fdb9fa4ee admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:59.683840 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53df502-48ef-41ab-9d6e-bd3fdb9fa4ee admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:59.689071 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39148a62-1c0b-425d-bc38-2e91ff54c573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:59.689742 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39148a62-1c0b-425d-bc38-2e91ff54c573 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:59.690025 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39148a62-1c0b-425d-bc38-2e91ff54c573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:59.690300 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39148a62-1c0b-425d-bc38-2e91ff54c573 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:59.691022 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39148a62-1c0b-425d-bc38-2e91ff54c573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:59.692721 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39148a62-1c0b-425d-bc38-2e91ff54c573 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:59.703992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1049/2073] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:56:59.708505 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc6c36-6ee4-499e-947a-d4cef571a8e7 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:59.718602 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc6c36-6ee4-499e-947a-d4cef571a8e7 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:59.724300 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb115864-f556-4c6b-a01c-f4869bf79c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:59.725313 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb115864-f556-4c6b-a01c-f4869bf79c6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:59.725622 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb115864-f556-4c6b-a01c-f4869bf79c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:59.725870 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb115864-f556-4c6b-a01c-f4869bf79c6c admin admin] PATH_INFO: `/v3/projects/93c49eca8a884e5db423382bb62c94fd/users/9d3a5e78939646f58bf3ca786a5f6b6b/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:59.742164 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb115864-f556-4c6b-a01c-f4869bf79c6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=93c49eca8a884e5db423382bb62c94fd, user_id=9d3a5e78939646f58bf3ca786a5f6b6b, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:59.744863 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb115864-f556-4c6b-a01c-f4869bf79c6c admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:59.759858 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1025/2074] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:59 2022] PUT /identity/v3/projects/93c49eca8a884e5db423382bb62c94fd/users/9d3a5e78939646f58bf3ca786a5f6b6b/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:59.764389 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39148a62-1c0b-425d-bc38-2e91ff54c573 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:59.774680 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39148a62-1c0b-425d-bc38-2e91ff54c573 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:59.813102 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb115864-f556-4c6b-a01c-f4869bf79c6c admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:59.815328 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-bb115864-f556-4c6b-a01c-f4869bf79c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:59.846819 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54379fea-2004-461a-8296-cc5e610849ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:59.847531 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54379fea-2004-461a-8296-cc5e610849ef admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:59.847811 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54379fea-2004-461a-8296-cc5e610849ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:59.848083 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54379fea-2004-461a-8296-cc5e610849ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:59.848806 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54379fea-2004-461a-8296-cc5e610849ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:59.850460 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54379fea-2004-461a-8296-cc5e610849ef admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:59.865015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1050/2075] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 05:56:59.866054 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54379fea-2004-461a-8296-cc5e610849ef admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:56:59.876681 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54379fea-2004-461a-8296-cc5e610849ef admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:59.881649 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f1879-a5e6-4e0f-a0a9-4e2a52f6ad8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:59.882531 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f1879-a5e6-4e0f-a0a9-4e2a52f6ad8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:59.882829 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f1879-a5e6-4e0f-a0a9-4e2a52f6ad8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:59.883101 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f1879-a5e6-4e0f-a0a9-4e2a52f6ad8e admin admin] PATH_INFO: `/v3/projects/93c49eca8a884e5db423382bb62c94fd/users/9d3a5e78939646f58bf3ca786a5f6b6b/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:59.885094 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f1879-a5e6-4e0f-a0a9-4e2a52f6ad8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=93c49eca8a884e5db423382bb62c94fd, user_id=9d3a5e78939646f58bf3ca786a5f6b6b, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:59.887933 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f1879-a5e6-4e0f-a0a9-4e2a52f6ad8e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:59.898675 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb115864-f556-4c6b-a01c-f4869bf79c6c admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:56:59.898866 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1051/2076] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:56:59 2022] PUT /identity/v3/projects/93c49eca8a884e5db423382bb62c94fd/users/9d3a5e78939646f58bf3ca786a5f6b6b/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:56:59.908926 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aaff06-a086-4270-be9d-282309ef89eb None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:59.909207 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aaff06-a086-4270-be9d-282309ef89eb None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:59.909479 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aaff06-a086-4270-be9d-282309ef89eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:59.934925 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-49aaff06-a086-4270-be9d-282309ef89eb None None] MFA Rules not processed for user `9d3a5e78939646f58bf3ca786a5f6b6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:56:59.936173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-49aaff06-a086-4270-be9d-282309ef89eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:56:59.956698 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2c69d-39a7-4bb7-8c57-a31c04773269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:56:59.957571 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2c69d-39a7-4bb7-8c57-a31c04773269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:56:59.957862 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2c69d-39a7-4bb7-8c57-a31c04773269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:56:59.958136 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2c69d-39a7-4bb7-8c57-a31c04773269 admin admin] PATH_INFO: `/v3/projects/a866b768fd444e7ca909e594a10c47a8` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:56:59.959379 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2c69d-39a7-4bb7-8c57-a31c04773269 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a866b768fd444e7ca909e594a10c47a8)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:56:59.961310 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2c69d-39a7-4bb7-8c57-a31c04773269 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:56:59.968169 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:56:59.968847 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:00.010040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1052/2077] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:56:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:57:00.012053 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-82f2c69d-39a7-4bb7-8c57-a31c04773269 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a866b768fd444e7ca909e594a10c47a8', 'request_id': 'req-82f2c69d-39a7-4bb7-8c57-a31c04773269'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:00.020228 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-82f2c69d-39a7-4bb7-8c57-a31c04773269 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a866b768fd444e7ca909e594a10c47a8', 'request_id': 'req-82f2c69d-39a7-4bb7-8c57-a31c04773269'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:00.021918 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aaff06-a086-4270-be9d-282309ef89eb None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:00.023304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-49aaff06-a086-4270-be9d-282309ef89eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:00.027392 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-82f2c69d-39a7-4bb7-8c57-a31c04773269 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a866b768fd444e7ca909e594a10c47a8', 'request_id': 'req-82f2c69d-39a7-4bb7-8c57-a31c04773269'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:00.037945 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-82f2c69d-39a7-4bb7-8c57-a31c04773269 admin admin] The token cache is being invalidate because project a866b768fd444e7ca909e594a10c47a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:57:00.038305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-82f2c69d-39a7-4bb7-8c57-a31c04773269 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:00.039018 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-82f2c69d-39a7-4bb7-8c57-a31c04773269 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:00.041020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1026/2078] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:56:59 2022] DELETE /identity/v3/projects/a866b768fd444e7ca909e594a10c47a8 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:00.044658 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2c69d-39a7-4bb7-8c57-a31c04773269 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:00.045927 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-82f2c69d-39a7-4bb7-8c57-a31c04773269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:00.081180 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aaff06-a086-4270-be9d-282309ef89eb None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:00.109724 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2c69d-39a7-4bb7-8c57-a31c04773269 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:00.114621 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb4505-9667-4df6-b853-25e2e683a973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:00.115602 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb4505-9667-4df6-b853-25e2e683a973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:00.115881 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb4505-9667-4df6-b853-25e2e683a973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:00.116153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb4505-9667-4df6-b853-25e2e683a973 admin admin] PATH_INFO: `/v3/users/d87ba7a7b0ad46e6a35aeb99e0707daa` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:00.117364 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb4505-9667-4df6-b853-25e2e683a973 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d87ba7a7b0ad46e6a35aeb99e0707daa)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:00.119323 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb4505-9667-4df6-b853-25e2e683a973 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:00.130330 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0370dd8-a33f-4658-853c-d82e46aaae45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:00.130983 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0370dd8-a33f-4658-853c-d82e46aaae45 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:00.131300 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0370dd8-a33f-4658-853c-d82e46aaae45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:00.131572 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0370dd8-a33f-4658-853c-d82e46aaae45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:00.133389 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c0370dd8-a33f-4658-853c-d82e46aaae45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:00.168450 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-76eb4505-9667-4df6-b853-25e2e683a973 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd87ba7a7b0ad46e6a35aeb99e0707daa'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:00.169065 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-76eb4505-9667-4df6-b853-25e2e683a973 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd87ba7a7b0ad46e6a35aeb99e0707daa'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:00.176302 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-76eb4505-9667-4df6-b853-25e2e683a973 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd87ba7a7b0ad46e6a35aeb99e0707daa'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:00.177312 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-76eb4505-9667-4df6-b853-25e2e683a973 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd87ba7a7b0ad46e6a35aeb99e0707daa'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:00.190390 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-76eb4505-9667-4df6-b853-25e2e683a973 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd87ba7a7b0ad46e6a35aeb99e0707daa'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:00.194909 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0370dd8-a33f-4658-853c-d82e46aaae45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:00.196409 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0370dd8-a33f-4658-853c-d82e46aaae45 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:00.202539 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1027/2079] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:57:00 2022] DELETE /identity/v3/users/d87ba7a7b0ad46e6a35aeb99e0707daa => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 05:57:00.205350 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1053/2080] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:57:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 05:57:00.508206 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb4505-9667-4df6-b853-25e2e683a973 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:00.509831 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-76eb4505-9667-4df6-b853-25e2e683a973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:00.534914 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:00.550441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0370dd8-a33f-4658-853c-d82e46aaae45 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:00.552965 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c0370dd8-a33f-4658-853c-d82e46aaae45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:00.574778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0370dd8-a33f-4658-853c-d82e46aaae45 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:00.621640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:00.629091 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb4505-9667-4df6-b853-25e2e683a973 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:00.635270 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc46d8-c7ee-485a-9657-4f8b06103275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:00.636220 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc46d8-c7ee-485a-9657-4f8b06103275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:00.636719 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc46d8-c7ee-485a-9657-4f8b06103275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:00.636826 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc46d8-c7ee-485a-9657-4f8b06103275 admin admin] PATH_INFO: `/v3/projects/26b487352c49495fbbec054a2386c83b` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:00.638016 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc46d8-c7ee-485a-9657-4f8b06103275 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26b487352c49495fbbec054a2386c83b)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:00.640010 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc46d8-c7ee-485a-9657-4f8b06103275 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:00.655526 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4c15b-150f-4672-a84f-5b8fd55143e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:00.657387 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4c15b-150f-4672-a84f-5b8fd55143e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:00.658017 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4c15b-150f-4672-a84f-5b8fd55143e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:00.658744 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4c15b-150f-4672-a84f-5b8fd55143e5 admin admin] PATH_INFO: `/v3/users/cee803bd1c784506b7df9360757abc46` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:00.665658 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4c15b-150f-4672-a84f-5b8fd55143e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cee803bd1c784506b7df9360757abc46)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:00.667984 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4c15b-150f-4672-a84f-5b8fd55143e5 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:00.724710 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-eddc46d8-c7ee-485a-9657-4f8b06103275 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26b487352c49495fbbec054a2386c83b', 'request_id': 'req-eddc46d8-c7ee-485a-9657-4f8b06103275'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:00.734661 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-eddc46d8-c7ee-485a-9657-4f8b06103275 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26b487352c49495fbbec054a2386c83b', 'request_id': 'req-eddc46d8-c7ee-485a-9657-4f8b06103275'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:00.745301 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-eddc46d8-c7ee-485a-9657-4f8b06103275 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26b487352c49495fbbec054a2386c83b', 'request_id': 'req-eddc46d8-c7ee-485a-9657-4f8b06103275'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:00.757320 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-80b4c15b-150f-4672-a84f-5b8fd55143e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cee803bd1c784506b7df9360757abc46'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:00.759129 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-eddc46d8-c7ee-485a-9657-4f8b06103275 admin admin] The token cache is being invalidate because project 26b487352c49495fbbec054a2386c83b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:57:00.759560 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-eddc46d8-c7ee-485a-9657-4f8b06103275 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:00.760654 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-eddc46d8-c7ee-485a-9657-4f8b06103275 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:00.763215 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1028/2081] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:57:00 2022] DELETE /identity/v3/projects/26b487352c49495fbbec054a2386c83b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:00.767555 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c99c50-7e68-4a7f-8336-e78ef760158f None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:00.769639 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c99c50-7e68-4a7f-8336-e78ef760158f None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:00.770078 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c99c50-7e68-4a7f-8336-e78ef760158f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:00.780527 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-80b4c15b-150f-4672-a84f-5b8fd55143e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cee803bd1c784506b7df9360757abc46'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:00.792462 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-29c99c50-7e68-4a7f-8336-e78ef760158f None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:00.794356 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-29c99c50-7e68-4a7f-8336-e78ef760158f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:00.800774 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-80b4c15b-150f-4672-a84f-5b8fd55143e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cee803bd1c784506b7df9360757abc46'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:00.801669 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-80b4c15b-150f-4672-a84f-5b8fd55143e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cee803bd1c784506b7df9360757abc46'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:00.831155 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-80b4c15b-150f-4672-a84f-5b8fd55143e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cee803bd1c784506b7df9360757abc46'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:00.841836 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1054/2082] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:57:00 2022] DELETE /identity/v3/users/cee803bd1c784506b7df9360757abc46 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 05:57:00.852429 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38934ca7-38bd-4667-93ea-67d44c685dce None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:00.853118 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38934ca7-38bd-4667-93ea-67d44c685dce None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:00.853118 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38934ca7-38bd-4667-93ea-67d44c685dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:00.879137 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-38934ca7-38bd-4667-93ea-67d44c685dce None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:00.880400 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-38934ca7-38bd-4667-93ea-67d44c685dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:00.883667 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1029/2083] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:57:00.893856 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419cd79-eec4-4907-8b9f-017c20a2905d None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:00.893941 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419cd79-eec4-4907-8b9f-017c20a2905d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:00.894148 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419cd79-eec4-4907-8b9f-017c20a2905d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:00.930215 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-0419cd79-eec4-4907-8b9f-017c20a2905d None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:00.931637 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-0419cd79-eec4-4907-8b9f-017c20a2905d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:00.958385 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1055/2084] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:00.970918 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38934ca7-38bd-4667-93ea-67d44c685dce None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:00.972524 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-38934ca7-38bd-4667-93ea-67d44c685dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:00.981955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:01.012167 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1030/2085] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:01.016618 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419cd79-eec4-4907-8b9f-017c20a2905d None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:01.026116 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419cd79-eec4-4907-8b9f-017c20a2905d None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:01.032551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422736d-ca03-4fac-9d45-b5485bede070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:01.033455 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422736d-ca03-4fac-9d45-b5485bede070 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:01.033799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422736d-ca03-4fac-9d45-b5485bede070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:01.034243 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422736d-ca03-4fac-9d45-b5485bede070 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:01.035673 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422736d-ca03-4fac-9d45-b5485bede070 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:57:01.036051 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422736d-ca03-4fac-9d45-b5485bede070 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:01.038173 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422736d-ca03-4fac-9d45-b5485bede070 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:01.038506 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38934ca7-38bd-4667-93ea-67d44c685dce None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:01.042489 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb53d0d-6ad7-4c33-9870-ac1bdc64232d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:01.043441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb53d0d-6ad7-4c33-9870-ac1bdc64232d service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:01.043695 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb53d0d-6ad7-4c33-9870-ac1bdc64232d service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:01.044047 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb53d0d-6ad7-4c33-9870-ac1bdc64232d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:01.052789 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1031/2086] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:57:01.057240 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422736d-ca03-4fac-9d45-b5485bede070 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:01.058600 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb53d0d-6ad7-4c33-9870-ac1bdc64232d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:01.060280 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb53d0d-6ad7-4c33-9870-ac1bdc64232d service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:01.066984 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:01.071374 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422736d-ca03-4fac-9d45-b5485bede070 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:01.074136 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1056/2087] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:57:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 05:57:01.077324 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9781c-2e35-4e98-992e-f97099ddcdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:01.078459 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9781c-2e35-4e98-992e-f97099ddcdac admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:01.078746 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9781c-2e35-4e98-992e-f97099ddcdac admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:01.079019 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9781c-2e35-4e98-992e-f97099ddcdac admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:01.079832 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9781c-2e35-4e98-992e-f97099ddcdac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:01.081997 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9781c-2e35-4e98-992e-f97099ddcdac admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:01.119866 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1032/2088] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:57:01 2022] POST /identity/v3/projects => generated 389 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:57:01.123762 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb53d0d-6ad7-4c33-9870-ac1bdc64232d service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:01.134837 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb53d0d-6ad7-4c33-9870-ac1bdc64232d service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:01.202355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1ed16-bb6f-4bf3-8d22-30e665d27b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:01.202355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1ed16-bb6f-4bf3-8d22-30e665d27b39 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:01.202599 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1ed16-bb6f-4bf3-8d22-30e665d27b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:01.202783 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1ed16-bb6f-4bf3-8d22-30e665d27b39 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:01.203489 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1ed16-bb6f-4bf3-8d22-30e665d27b39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:01.205643 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1ed16-bb6f-4bf3-8d22-30e665d27b39 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:01.243250 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1057/2089] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:57:01 2022] POST /identity/v3/users => generated 295 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:57:01.246476 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9781c-2e35-4e98-992e-f97099ddcdac admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:01.257457 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9781c-2e35-4e98-992e-f97099ddcdac admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:01.262071 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30be62-de1a-4bf4-a5d2-827d90695994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:01.262738 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30be62-de1a-4bf4-a5d2-827d90695994 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:01.263020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30be62-de1a-4bf4-a5d2-827d90695994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:01.263332 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30be62-de1a-4bf4-a5d2-827d90695994 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:01.264061 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30be62-de1a-4bf4-a5d2-827d90695994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:01.265664 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30be62-de1a-4bf4-a5d2-827d90695994 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:01.275847 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1033/2090] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 05:57:01.279796 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1ed16-bb6f-4bf3-8d22-30e665d27b39 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:01.289965 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1ed16-bb6f-4bf3-8d22-30e665d27b39 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:01.294522 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7b688-0e69-4907-8046-8489e386bb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:01.295194 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7b688-0e69-4907-8046-8489e386bb76 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:01.295481 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7b688-0e69-4907-8046-8489e386bb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:01.295753 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7b688-0e69-4907-8046-8489e386bb76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:01.296462 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e7b688-0e69-4907-8046-8489e386bb76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:01.298127 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e7b688-0e69-4907-8046-8489e386bb76 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:01.309597 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1058/2091] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 05:57:01.315794 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30be62-de1a-4bf4-a5d2-827d90695994 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:01.325840 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30be62-de1a-4bf4-a5d2-827d90695994 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:01.330515 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74814f9-e998-48cb-8eac-69e47b3f5885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:01.331454 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74814f9-e998-48cb-8eac-69e47b3f5885 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:01.331737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74814f9-e998-48cb-8eac-69e47b3f5885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:01.332009 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74814f9-e998-48cb-8eac-69e47b3f5885 admin admin] PATH_INFO: `/v3/projects/47f8c16227164d7bb8f90343a5d66226/users/6c260290e56d4383aee7977eb8518ac9/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:01.347838 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74814f9-e998-48cb-8eac-69e47b3f5885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47f8c16227164d7bb8f90343a5d66226, user_id=6c260290e56d4383aee7977eb8518ac9, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:01.350998 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74814f9-e998-48cb-8eac-69e47b3f5885 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:01.365977 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1034/2092] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:57:01 2022] PUT /identity/v3/projects/47f8c16227164d7bb8f90343a5d66226/users/6c260290e56d4383aee7977eb8518ac9/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:01.376167 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5ec24-28bf-41fb-904f-c847b759c8bf None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:01.376520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5ec24-28bf-41fb-904f-c847b759c8bf None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:01.376895 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5ec24-28bf-41fb-904f-c847b759c8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:01.405185 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-44f5ec24-28bf-41fb-904f-c847b759c8bf None None] MFA Rules not processed for user `6c260290e56d4383aee7977eb8518ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:01.406403 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-44f5ec24-28bf-41fb-904f-c847b759c8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:01.478710 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1059/2093] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:57:01.480232 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74814f9-e998-48cb-8eac-69e47b3f5885 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:01.561632 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74814f9-e998-48cb-8eac-69e47b3f5885 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:01.564621 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5ec24-28bf-41fb-904f-c847b759c8bf None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:01.566313 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-44f5ec24-28bf-41fb-904f-c847b759c8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:01.567202 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737abe9b-6d10-4e10-a955-04ed97cd43f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:01.568326 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737abe9b-6d10-4e10-a955-04ed97cd43f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:01.568712 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737abe9b-6d10-4e10-a955-04ed97cd43f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:01.569091 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737abe9b-6d10-4e10-a955-04ed97cd43f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:01.569866 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737abe9b-6d10-4e10-a955-04ed97cd43f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:01.571858 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737abe9b-6d10-4e10-a955-04ed97cd43f9 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:01.599132 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5ec24-28bf-41fb-904f-c847b759c8bf None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:01.606058 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95c44b-ff41-4cef-a3f0-1fb39ff3564c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:01.607825 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95c44b-ff41-4cef-a3f0-1fb39ff3564c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:01.608488 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95c44b-ff41-4cef-a3f0-1fb39ff3564c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:01.608838 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95c44b-ff41-4cef-a3f0-1fb39ff3564c admin admin] PATH_INFO: `/v3/projects/800a59d7ff034d54be53784e780b55ae` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:01.610323 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95c44b-ff41-4cef-a3f0-1fb39ff3564c admin admin] RBAC: Authorizing `identity:delete_project(project_id=800a59d7ff034d54be53784e780b55ae)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:01.613165 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95c44b-ff41-4cef-a3f0-1fb39ff3564c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:01.632501 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1035/2094] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:57:01 2022] POST /identity/v3/projects => generated 389 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:57:01.640622 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737abe9b-6d10-4e10-a955-04ed97cd43f9 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:01.706316 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3d95c44b-ff41-4cef-a3f0-1fb39ff3564c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '800a59d7ff034d54be53784e780b55ae', 'request_id': 'req-3d95c44b-ff41-4cef-a3f0-1fb39ff3564c'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:01.718044 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3d95c44b-ff41-4cef-a3f0-1fb39ff3564c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '800a59d7ff034d54be53784e780b55ae', 'request_id': 'req-3d95c44b-ff41-4cef-a3f0-1fb39ff3564c'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:01.730567 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3d95c44b-ff41-4cef-a3f0-1fb39ff3564c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '800a59d7ff034d54be53784e780b55ae', 'request_id': 'req-3d95c44b-ff41-4cef-a3f0-1fb39ff3564c'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:01.733580 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:01.735504 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737abe9b-6d10-4e10-a955-04ed97cd43f9 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:01.741278 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:01.755364 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3d95c44b-ff41-4cef-a3f0-1fb39ff3564c admin admin] The token cache is being invalidate because project 800a59d7ff034d54be53784e780b55ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:57:01.755364 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3d95c44b-ff41-4cef-a3f0-1fb39ff3564c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:01.756069 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3d95c44b-ff41-4cef-a3f0-1fb39ff3564c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:01.758684 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1060/2095] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:57:01 2022] DELETE /identity/v3/projects/800a59d7ff034d54be53784e780b55ae => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:01.763229 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95c44b-ff41-4cef-a3f0-1fb39ff3564c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:01.766218 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3d95c44b-ff41-4cef-a3f0-1fb39ff3564c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:01.806337 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0775c3-f01a-4a5b-acbf-975085be11cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:01.806337 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0775c3-f01a-4a5b-acbf-975085be11cd admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:01.806337 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0775c3-f01a-4a5b-acbf-975085be11cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:01.806724 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0775c3-f01a-4a5b-acbf-975085be11cd admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:01.807227 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0775c3-f01a-4a5b-acbf-975085be11cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:01.809312 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0775c3-f01a-4a5b-acbf-975085be11cd admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:01.837532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1036/2096] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:57:01 2022] POST /identity/v3/users => generated 301 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 05:57:01.842013 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0775c3-f01a-4a5b-acbf-975085be11cd admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:01.849787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ac0775c3-f01a-4a5b-acbf-975085be11cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:01.862847 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95c44b-ff41-4cef-a3f0-1fb39ff3564c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:01.863904 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0775c3-f01a-4a5b-acbf-975085be11cd admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:01.869001 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccd01a-38ea-4adb-8a0f-6c033a81e116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:01.869782 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccd01a-38ea-4adb-8a0f-6c033a81e116 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:01.870623 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccd01a-38ea-4adb-8a0f-6c033a81e116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:01.870623 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccd01a-38ea-4adb-8a0f-6c033a81e116 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:01.871251 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccd01a-38ea-4adb-8a0f-6c033a81e116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:01.872375 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3394f-a18c-47e1-bb08-0ef5f6f5d3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:01.873146 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccd01a-38ea-4adb-8a0f-6c033a81e116 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:01.873623 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3394f-a18c-47e1-bb08-0ef5f6f5d3b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:01.873773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3394f-a18c-47e1-bb08-0ef5f6f5d3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:01.874001 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3394f-a18c-47e1-bb08-0ef5f6f5d3b6 admin admin] PATH_INFO: `/v3/users/a72015367a7a4d5299857906c9a1d2b3` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:01.875639 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3394f-a18c-47e1-bb08-0ef5f6f5d3b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a72015367a7a4d5299857906c9a1d2b3)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:01.877983 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3394f-a18c-47e1-bb08-0ef5f6f5d3b6 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:01.887233 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1037/2097] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:57:01.891602 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccd01a-38ea-4adb-8a0f-6c033a81e116 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:01.905135 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccd01a-38ea-4adb-8a0f-6c033a81e116 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:01.910890 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbe8b6-94b1-4e01-8d41-380e4748043f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:01.911780 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbe8b6-94b1-4e01-8d41-380e4748043f admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:01.912055 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbe8b6-94b1-4e01-8d41-380e4748043f admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:01.912879 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbe8b6-94b1-4e01-8d41-380e4748043f admin admin] PATH_INFO: `/v3/projects/b7fe28e669ca4ed5ab50df399b568655/users/73c87612a1d14fd0a8d383fe9c103ce6/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:01.941710 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-25b3394f-a18c-47e1-bb08-0ef5f6f5d3b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a72015367a7a4d5299857906c9a1d2b3'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:01.946915 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbe8b6-94b1-4e01-8d41-380e4748043f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7fe28e669ca4ed5ab50df399b568655, user_id=73c87612a1d14fd0a8d383fe9c103ce6, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:01.953591 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbe8b6-94b1-4e01-8d41-380e4748043f admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:01.954339 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-25b3394f-a18c-47e1-bb08-0ef5f6f5d3b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a72015367a7a4d5299857906c9a1d2b3'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:01.974548 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-25b3394f-a18c-47e1-bb08-0ef5f6f5d3b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a72015367a7a4d5299857906c9a1d2b3'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:01.976096 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-25b3394f-a18c-47e1-bb08-0ef5f6f5d3b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a72015367a7a4d5299857906c9a1d2b3'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:01.988609 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1038/2098] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:57:01 2022] PUT /identity/v3/projects/b7fe28e669ca4ed5ab50df399b568655/users/73c87612a1d14fd0a8d383fe9c103ce6/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:01.992826 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbe8b6-94b1-4e01-8d41-380e4748043f admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:01.997887 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-25b3394f-a18c-47e1-bb08-0ef5f6f5d3b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a72015367a7a4d5299857906c9a1d2b3'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:02.008417 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1061/2099] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:57:01 2022] DELETE /identity/v3/users/a72015367a7a4d5299857906c9a1d2b3 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 05:57:02.105793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbe8b6-94b1-4e01-8d41-380e4748043f admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:02.180800 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790b086-4a0c-4581-adc3-1fa27038cae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:02.180800 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790b086-4a0c-4581-adc3-1fa27038cae2 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:02.180800 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790b086-4a0c-4581-adc3-1fa27038cae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:02.180800 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790b086-4a0c-4581-adc3-1fa27038cae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:02.181449 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790b086-4a0c-4581-adc3-1fa27038cae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:02.183065 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790b086-4a0c-4581-adc3-1fa27038cae2 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:02.194266 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1039/2100] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 05:57:02.198444 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3394f-a18c-47e1-bb08-0ef5f6f5d3b6 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:02.200330 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-25b3394f-a18c-47e1-bb08-0ef5f6f5d3b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:02.218567 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3394f-a18c-47e1-bb08-0ef5f6f5d3b6 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:02.227164 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988a30a-0eca-4de5-85dd-0fc7dc157309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:02.229273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988a30a-0eca-4de5-85dd-0fc7dc157309 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:02.229757 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988a30a-0eca-4de5-85dd-0fc7dc157309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:02.230058 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988a30a-0eca-4de5-85dd-0fc7dc157309 admin admin] PATH_INFO: `/v3/projects/b7fe28e669ca4ed5ab50df399b568655/users/73c87612a1d14fd0a8d383fe9c103ce6/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:02.232408 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988a30a-0eca-4de5-85dd-0fc7dc157309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7fe28e669ca4ed5ab50df399b568655, user_id=73c87612a1d14fd0a8d383fe9c103ce6, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:02.235337 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988a30a-0eca-4de5-85dd-0fc7dc157309 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:02.266083 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1062/2101] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:57:02 2022] PUT /identity/v3/projects/b7fe28e669ca4ed5ab50df399b568655/users/73c87612a1d14fd0a8d383fe9c103ce6/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 05:57:02.271926 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed72ab0-68d0-4b19-b61b-d83fc664c90c None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:02.273608 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed72ab0-68d0-4b19-b61b-d83fc664c90c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:02.274309 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed72ab0-68d0-4b19-b61b-d83fc664c90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:02.300430 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:02.332346 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-5ed72ab0-68d0-4b19-b61b-d83fc664c90c None None] MFA Rules not processed for user `73c87612a1d14fd0a8d383fe9c103ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:02.334110 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-5ed72ab0-68d0-4b19-b61b-d83fc664c90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:02.467717 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1040/2102] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:02 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:02.482757 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988a30a-0eca-4de5-85dd-0fc7dc157309 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:02.485229 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2988a30a-0eca-4de5-85dd-0fc7dc157309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:02.578100 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988a30a-0eca-4de5-85dd-0fc7dc157309 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:02.583916 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba6902-0077-49b5-af7b-cf329740437c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:02.584427 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba6902-0077-49b5-af7b-cf329740437c service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:02.584701 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba6902-0077-49b5-af7b-cf329740437c service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:02.585059 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba6902-0077-49b5-af7b-cf329740437c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:02.589584 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed72ab0-68d0-4b19-b61b-d83fc664c90c None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:02.592449 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-5ed72ab0-68d0-4b19-b61b-d83fc664c90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:02.596810 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba6902-0077-49b5-af7b-cf329740437c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:02.598675 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba6902-0077-49b5-af7b-cf329740437c service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:02.604726 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:02.622169 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1063/2103] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:57:02 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:57:02.688873 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed72ab0-68d0-4b19-b61b-d83fc664c90c None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:02.693964 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ae5e4-4fcb-4e60-a603-a8f2e92add5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:02.694914 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ae5e4-4fcb-4e60-a603-a8f2e92add5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:02.695293 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ae5e4-4fcb-4e60-a603-a8f2e92add5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:02.695571 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ae5e4-4fcb-4e60-a603-a8f2e92add5f admin admin] PATH_INFO: `/v3/projects/b319633e8e744c7b9d9354882553087d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:02.696773 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ae5e4-4fcb-4e60-a603-a8f2e92add5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b319633e8e744c7b9d9354882553087d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:02.698711 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ae5e4-4fcb-4e60-a603-a8f2e92add5f admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:02.757258 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba6902-0077-49b5-af7b-cf329740437c service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:02.768268 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba6902-0077-49b5-af7b-cf329740437c service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:02.768428 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-a48ae5e4-4fcb-4e60-a603-a8f2e92add5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b319633e8e744c7b9d9354882553087d', 'request_id': 'req-a48ae5e4-4fcb-4e60-a603-a8f2e92add5f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:02.777731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-a48ae5e4-4fcb-4e60-a603-a8f2e92add5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b319633e8e744c7b9d9354882553087d', 'request_id': 'req-a48ae5e4-4fcb-4e60-a603-a8f2e92add5f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:02.784637 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-a48ae5e4-4fcb-4e60-a603-a8f2e92add5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b319633e8e744c7b9d9354882553087d', 'request_id': 'req-a48ae5e4-4fcb-4e60-a603-a8f2e92add5f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:02.796562 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-a48ae5e4-4fcb-4e60-a603-a8f2e92add5f admin admin] The token cache is being invalidate because project b319633e8e744c7b9d9354882553087d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:57:02.796822 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-a48ae5e4-4fcb-4e60-a603-a8f2e92add5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:02.797488 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-a48ae5e4-4fcb-4e60-a603-a8f2e92add5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:02.799360 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1041/2104] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:57:02 2022] DELETE /identity/v3/projects/b319633e8e744c7b9d9354882553087d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:02.802759 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ae5e4-4fcb-4e60-a603-a8f2e92add5f admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:02.804183 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-a48ae5e4-4fcb-4e60-a603-a8f2e92add5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:02.831843 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:02.837010 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f05f1d-285f-46e4-afca-47a0ffbff7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:02.838140 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f05f1d-285f-46e4-afca-47a0ffbff7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:02.838461 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f05f1d-285f-46e4-afca-47a0ffbff7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:02.838764 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f05f1d-285f-46e4-afca-47a0ffbff7e7 admin admin] PATH_INFO: `/v3/users/6c260290e56d4383aee7977eb8518ac9` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:02.840181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f05f1d-285f-46e4-afca-47a0ffbff7e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c260290e56d4383aee7977eb8518ac9)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:02.842229 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f05f1d-285f-46e4-afca-47a0ffbff7e7 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:02.905895 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b4f05f1d-285f-46e4-afca-47a0ffbff7e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c260290e56d4383aee7977eb8518ac9'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:02.913403 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b4f05f1d-285f-46e4-afca-47a0ffbff7e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c260290e56d4383aee7977eb8518ac9'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:02.918665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ae5e4-4fcb-4e60-a603-a8f2e92add5f admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:02.922100 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b4f05f1d-285f-46e4-afca-47a0ffbff7e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c260290e56d4383aee7977eb8518ac9'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:02.923058 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b4f05f1d-285f-46e4-afca-47a0ffbff7e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c260290e56d4383aee7977eb8518ac9'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:02.937476 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f58cc-03db-4e79-8b1b-dcc249eba93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:02.938583 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f58cc-03db-4e79-8b1b-dcc249eba93e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:02.938966 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f58cc-03db-4e79-8b1b-dcc249eba93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:02.939394 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f58cc-03db-4e79-8b1b-dcc249eba93e admin admin] PATH_INFO: `/v3/users/d7193ccb122d422a88fa61f72cdf391f` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:02.939865 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b4f05f1d-285f-46e4-afca-47a0ffbff7e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c260290e56d4383aee7977eb8518ac9'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:02.940912 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f58cc-03db-4e79-8b1b-dcc249eba93e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7193ccb122d422a88fa61f72cdf391f)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:02.943103 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f58cc-03db-4e79-8b1b-dcc249eba93e admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:02.954845 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1064/2105] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:57:02 2022] DELETE /identity/v3/users/6c260290e56d4383aee7977eb8518ac9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 05:57:02.956260 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f05f1d-285f-46e4-afca-47a0ffbff7e7 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:02.958632 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b4f05f1d-285f-46e4-afca-47a0ffbff7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:03.009354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e61f58cc-03db-4e79-8b1b-dcc249eba93e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7193ccb122d422a88fa61f72cdf391f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:03.010143 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e61f58cc-03db-4e79-8b1b-dcc249eba93e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7193ccb122d422a88fa61f72cdf391f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:03.023082 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e61f58cc-03db-4e79-8b1b-dcc249eba93e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7193ccb122d422a88fa61f72cdf391f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:03.023923 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e61f58cc-03db-4e79-8b1b-dcc249eba93e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7193ccb122d422a88fa61f72cdf391f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:03.059378 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e61f58cc-03db-4e79-8b1b-dcc249eba93e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7193ccb122d422a88fa61f72cdf391f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:03.084968 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f05f1d-285f-46e4-afca-47a0ffbff7e7 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:03.088552 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1042/2106] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:57:02 2022] DELETE /identity/v3/users/d7193ccb122d422a88fa61f72cdf391f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 05:57:03.094516 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09aab52-588b-4808-a31b-e511c158c5da None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:03.094854 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09aab52-588b-4808-a31b-e511c158c5da None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:03.095134 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09aab52-588b-4808-a31b-e511c158c5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:03.100416 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f36b6-c25a-4f21-a0fe-6f7e5caeb66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:03.101327 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f36b6-c25a-4f21-a0fe-6f7e5caeb66a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:03.102633 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f36b6-c25a-4f21-a0fe-6f7e5caeb66a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:03.102918 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f36b6-c25a-4f21-a0fe-6f7e5caeb66a admin admin] PATH_INFO: `/v3/users/37b4819417964d7283798754f66efb1a` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:03.106900 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f36b6-c25a-4f21-a0fe-6f7e5caeb66a admin admin] RBAC: Authorizing `identity:delete_user(user_id=37b4819417964d7283798754f66efb1a)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:03.111399 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f36b6-c25a-4f21-a0fe-6f7e5caeb66a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:03.136885 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d09aab52-588b-4808-a31b-e511c158c5da None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:03.138140 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d09aab52-588b-4808-a31b-e511c158c5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:03.168599 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:03.217857 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2e6f36b6-c25a-4f21-a0fe-6f7e5caeb66a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37b4819417964d7283798754f66efb1a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:03.230653 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2e6f36b6-c25a-4f21-a0fe-6f7e5caeb66a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37b4819417964d7283798754f66efb1a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:03.243236 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2e6f36b6-c25a-4f21-a0fe-6f7e5caeb66a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37b4819417964d7283798754f66efb1a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:03.244358 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2e6f36b6-c25a-4f21-a0fe-6f7e5caeb66a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37b4819417964d7283798754f66efb1a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:03.265613 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2e6f36b6-c25a-4f21-a0fe-6f7e5caeb66a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37b4819417964d7283798754f66efb1a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:03.275854 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1065/2107] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:57:02 2022] DELETE /identity/v3/users/37b4819417964d7283798754f66efb1a => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:03.276406 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1043/2108] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:03.283195 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e1035-5549-4100-86d3-3c1a5abd1946 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:03.283682 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e1035-5549-4100-86d3-3c1a5abd1946 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:03.283961 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e1035-5549-4100-86d3-3c1a5abd1946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:03.289332 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09aab52-588b-4808-a31b-e511c158c5da None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:03.290908 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d09aab52-588b-4808-a31b-e511c158c5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:03.305205 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d51e1035-5549-4100-86d3-3c1a5abd1946 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:03.307109 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d51e1035-5549-4100-86d3-3c1a5abd1946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:03.378321 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1066/2109] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:03.388658 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e1035-5549-4100-86d3-3c1a5abd1946 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:03.390407 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d51e1035-5549-4100-86d3-3c1a5abd1946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:03.413155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:03.459302 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09aab52-588b-4808-a31b-e511c158c5da None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:03.467751 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e1035-5549-4100-86d3-3c1a5abd1946 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:03.469979 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbb7e2-3920-43b2-bc52-75959f673488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:03.470659 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbb7e2-3920-43b2-bc52-75959f673488 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:03.470961 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbb7e2-3920-43b2-bc52-75959f673488 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:03.471296 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbb7e2-3920-43b2-bc52-75959f673488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:03.472816 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2a973-a1b4-42c7-8bc7-2735665c863e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:03.473656 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2a973-a1b4-42c7-8bc7-2735665c863e service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:03.474581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2a973-a1b4-42c7-8bc7-2735665c863e service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:03.474936 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2a973-a1b4-42c7-8bc7-2735665c863e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:03.487551 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f2a973-a1b4-42c7-8bc7-2735665c863e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:03.489165 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f2a973-a1b4-42c7-8bc7-2735665c863e service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:03.493727 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedbb7e2-3920-43b2-bc52-75959f673488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:03.495492 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedbb7e2-3920-43b2-bc52-75959f673488 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:03.502312 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1067/2110] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:57:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 05:57:03.510050 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1044/2111] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:57:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 05:57:03.835777 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2a973-a1b4-42c7-8bc7-2735665c863e service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:03.837660 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-86f2a973-a1b4-42c7-8bc7-2735665c863e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:03.841428 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbb7e2-3920-43b2-bc52-75959f673488 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:03.843039 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-aedbb7e2-3920-43b2-bc52-75959f673488 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:03.856140 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbb7e2-3920-43b2-bc52-75959f673488 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:03.866767 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815c29b-85a1-4d7b-bc2b-343d566a4085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:03.867282 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815c29b-85a1-4d7b-bc2b-343d566a4085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:03.867572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815c29b-85a1-4d7b-bc2b-343d566a4085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:03.867899 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815c29b-85a1-4d7b-bc2b-343d566a4085 admin admin] PATH_INFO: `/v3/projects/c9b8ac7726e34adea1ce2511be7ea285` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:03.869141 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815c29b-85a1-4d7b-bc2b-343d566a4085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9b8ac7726e34adea1ce2511be7ea285)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:03.870963 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815c29b-85a1-4d7b-bc2b-343d566a4085 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:03.873975 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2a973-a1b4-42c7-8bc7-2735665c863e service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:03.880421 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d30be-279d-4363-a537-5127aebba60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:03.881493 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d30be-279d-4363-a537-5127aebba60a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:03.881874 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d30be-279d-4363-a537-5127aebba60a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:03.882393 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d30be-279d-4363-a537-5127aebba60a admin admin] PATH_INFO: `/v3/projects/18fa9a873e84480fbf262b14078df428` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:03.883837 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d30be-279d-4363-a537-5127aebba60a admin admin] RBAC: Authorizing `identity:delete_project(project_id=18fa9a873e84480fbf262b14078df428)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:03.886164 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d30be-279d-4363-a537-5127aebba60a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:03.954806 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:03.980150 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bd0d30be-279d-4363-a537-5127aebba60a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18fa9a873e84480fbf262b14078df428', 'request_id': 'req-bd0d30be-279d-4363-a537-5127aebba60a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:03.991797 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bd0d30be-279d-4363-a537-5127aebba60a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18fa9a873e84480fbf262b14078df428', 'request_id': 'req-bd0d30be-279d-4363-a537-5127aebba60a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:04.013097 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bd0d30be-279d-4363-a537-5127aebba60a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18fa9a873e84480fbf262b14078df428', 'request_id': 'req-bd0d30be-279d-4363-a537-5127aebba60a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:04.014894 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-8815c29b-85a1-4d7b-bc2b-343d566a4085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9b8ac7726e34adea1ce2511be7ea285', 'request_id': 'req-8815c29b-85a1-4d7b-bc2b-343d566a4085'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:04.029667 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bd0d30be-279d-4363-a537-5127aebba60a admin admin] The token cache is being invalidate because project 18fa9a873e84480fbf262b14078df428 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:57:04.029962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bd0d30be-279d-4363-a537-5127aebba60a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:04.031618 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bd0d30be-279d-4363-a537-5127aebba60a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:04.033079 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-8815c29b-85a1-4d7b-bc2b-343d566a4085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9b8ac7726e34adea1ce2511be7ea285', 'request_id': 'req-8815c29b-85a1-4d7b-bc2b-343d566a4085'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:04.036051 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1068/2112] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:57:03 2022] DELETE /identity/v3/projects/18fa9a873e84480fbf262b14078df428 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:04.038072 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d30be-279d-4363-a537-5127aebba60a admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:04.039560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-bd0d30be-279d-4363-a537-5127aebba60a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:04.046784 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-8815c29b-85a1-4d7b-bc2b-343d566a4085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9b8ac7726e34adea1ce2511be7ea285', 'request_id': 'req-8815c29b-85a1-4d7b-bc2b-343d566a4085'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:04.078408 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-8815c29b-85a1-4d7b-bc2b-343d566a4085 admin admin] The token cache is being invalidate because project c9b8ac7726e34adea1ce2511be7ea285 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:57:04.078696 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-8815c29b-85a1-4d7b-bc2b-343d566a4085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:04.079486 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-8815c29b-85a1-4d7b-bc2b-343d566a4085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:04.081359 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1045/2113] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:57:03 2022] DELETE /identity/v3/projects/c9b8ac7726e34adea1ce2511be7ea285 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 05:57:04.089840 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5d04a-ebf3-4d67-9a61-8825f883a572 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:04.092315 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5d04a-ebf3-4d67-9a61-8825f883a572 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:04.092602 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5d04a-ebf3-4d67-9a61-8825f883a572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:04.128929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-33d5d04a-ebf3-4d67-9a61-8825f883a572 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:04.130198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-33d5d04a-ebf3-4d67-9a61-8825f883a572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:04.143112 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d30be-279d-4363-a537-5127aebba60a admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:04.212893 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1046/2114] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:57:04.213870 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5d04a-ebf3-4d67-9a61-8825f883a572 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:04.215347 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-33d5d04a-ebf3-4d67-9a61-8825f883a572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:04.225779 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67fc8a-2966-461f-9e31-6f8c51845c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:04.227111 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67fc8a-2966-461f-9e31-6f8c51845c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:04.227111 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67fc8a-2966-461f-9e31-6f8c51845c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:04.227472 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67fc8a-2966-461f-9e31-6f8c51845c5a admin admin] PATH_INFO: `/v3/users/9d3a5e78939646f58bf3ca786a5f6b6b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:04.228128 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5d04a-ebf3-4d67-9a61-8825f883a572 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:04.228834 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67fc8a-2966-461f-9e31-6f8c51845c5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d3a5e78939646f58bf3ca786a5f6b6b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:04.231149 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67fc8a-2966-461f-9e31-6f8c51845c5a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:04.233294 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0ca27-2480-4dad-8ab1-019ba61bb196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:04.234489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0ca27-2480-4dad-8ab1-019ba61bb196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:04.234489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0ca27-2480-4dad-8ab1-019ba61bb196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:04.234788 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0ca27-2480-4dad-8ab1-019ba61bb196 admin admin] PATH_INFO: `/v3/projects/47f8c16227164d7bb8f90343a5d66226` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:04.236427 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0ca27-2480-4dad-8ab1-019ba61bb196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47f8c16227164d7bb8f90343a5d66226)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:04.238334 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0ca27-2480-4dad-8ab1-019ba61bb196 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:04.292791 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4db0ca27-2480-4dad-8ab1-019ba61bb196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47f8c16227164d7bb8f90343a5d66226', 'request_id': 'req-4db0ca27-2480-4dad-8ab1-019ba61bb196'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:04.295747 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ea67fc8a-2966-461f-9e31-6f8c51845c5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d3a5e78939646f58bf3ca786a5f6b6b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:04.302473 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4db0ca27-2480-4dad-8ab1-019ba61bb196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47f8c16227164d7bb8f90343a5d66226', 'request_id': 'req-4db0ca27-2480-4dad-8ab1-019ba61bb196'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:04.310363 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ea67fc8a-2966-461f-9e31-6f8c51845c5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d3a5e78939646f58bf3ca786a5f6b6b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:04.313897 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4db0ca27-2480-4dad-8ab1-019ba61bb196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47f8c16227164d7bb8f90343a5d66226', 'request_id': 'req-4db0ca27-2480-4dad-8ab1-019ba61bb196'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:04.315819 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:04.320823 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ea67fc8a-2966-461f-9e31-6f8c51845c5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d3a5e78939646f58bf3ca786a5f6b6b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:04.321888 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ea67fc8a-2966-461f-9e31-6f8c51845c5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d3a5e78939646f58bf3ca786a5f6b6b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:04.329439 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4db0ca27-2480-4dad-8ab1-019ba61bb196 admin admin] The token cache is being invalidate because project 47f8c16227164d7bb8f90343a5d66226 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:57:04.329953 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4db0ca27-2480-4dad-8ab1-019ba61bb196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:04.330897 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4db0ca27-2480-4dad-8ab1-019ba61bb196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:04.333233 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1047/2115] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:57:04 2022] DELETE /identity/v3/projects/47f8c16227164d7bb8f90343a5d66226 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:04.333400 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:04.334855 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abca930-ae72-44ac-9d4e-6625a93bc4d9 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:04.335640 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abca930-ae72-44ac-9d4e-6625a93bc4d9 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:04.335640 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abca930-ae72-44ac-9d4e-6625a93bc4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:04.342464 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-ea67fc8a-2966-461f-9e31-6f8c51845c5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d3a5e78939646f58bf3ca786a5f6b6b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:04.356965 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1069/2116] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:57:04 2022] DELETE /identity/v3/users/9d3a5e78939646f58bf3ca786a5f6b6b => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 05:57:04.356965 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67fc8a-2966-461f-9e31-6f8c51845c5a admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:04.358562 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ea67fc8a-2966-461f-9e31-6f8c51845c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:04.366120 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-5abca930-ae72-44ac-9d4e-6625a93bc4d9 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:04.367394 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-5abca930-ae72-44ac-9d4e-6625a93bc4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:04.460554 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1048/2117] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:04.466839 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abca930-ae72-44ac-9d4e-6625a93bc4d9 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:04.471323 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67fc8a-2966-461f-9e31-6f8c51845c5a admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:04.477466 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f3961-5edd-4fc5-b0b0-f70501efaa74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:04.478799 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f3961-5edd-4fc5-b0b0-f70501efaa74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:04.479437 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f3961-5edd-4fc5-b0b0-f70501efaa74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:04.479920 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f3961-5edd-4fc5-b0b0-f70501efaa74 admin admin] PATH_INFO: `/v3/users/73c87612a1d14fd0a8d383fe9c103ce6` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:04.481398 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f3961-5edd-4fc5-b0b0-f70501efaa74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73c87612a1d14fd0a8d383fe9c103ce6)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:04.483618 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f3961-5edd-4fc5-b0b0-f70501efaa74 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:04.489723 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abca930-ae72-44ac-9d4e-6625a93bc4d9 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:04.494704 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b24148-640b-4e62-b246-61b96d298b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:04.495486 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b24148-640b-4e62-b246-61b96d298b38 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:04.495771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b24148-640b-4e62-b246-61b96d298b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:04.496051 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b24148-640b-4e62-b246-61b96d298b38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:04.497284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b24148-640b-4e62-b246-61b96d298b38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:57:04.497598 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b24148-640b-4e62-b246-61b96d298b38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:04.499506 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b24148-640b-4e62-b246-61b96d298b38 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:04.520826 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1049/2118] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:57:04.522012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b24148-640b-4e62-b246-61b96d298b38 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:04.535486 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b24148-640b-4e62-b246-61b96d298b38 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:04.542854 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586909f4-efdf-48a0-825b-af887b1795e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:04.543427 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586909f4-efdf-48a0-825b-af887b1795e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:04.543928 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586909f4-efdf-48a0-825b-af887b1795e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:04.544188 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586909f4-efdf-48a0-825b-af887b1795e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:04.545114 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586909f4-efdf-48a0-825b-af887b1795e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:04.547044 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586909f4-efdf-48a0-825b-af887b1795e4 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:04.577001 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fe3f3961-5edd-4fc5-b0b0-f70501efaa74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73c87612a1d14fd0a8d383fe9c103ce6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:04.593742 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fe3f3961-5edd-4fc5-b0b0-f70501efaa74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73c87612a1d14fd0a8d383fe9c103ce6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:04.595901 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1050/2119] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:57:04 2022] POST /identity/v3/projects => generated 363 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:57:04.601379 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586909f4-efdf-48a0-825b-af887b1795e4 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:04.609788 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fe3f3961-5edd-4fc5-b0b0-f70501efaa74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73c87612a1d14fd0a8d383fe9c103ce6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:04.610687 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fe3f3961-5edd-4fc5-b0b0-f70501efaa74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73c87612a1d14fd0a8d383fe9c103ce6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:04.639687 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-fe3f3961-5edd-4fc5-b0b0-f70501efaa74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73c87612a1d14fd0a8d383fe9c103ce6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:04.650849 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1070/2120] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:57:04 2022] DELETE /identity/v3/users/73c87612a1d14fd0a8d383fe9c103ce6 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:04.697518 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586909f4-efdf-48a0-825b-af887b1795e4 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:04.764264 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f3961-5edd-4fc5-b0b0-f70501efaa74 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:04.765705 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fe3f3961-5edd-4fc5-b0b0-f70501efaa74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:04.845592 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d14eea-5942-49fd-925f-0cf741e6e6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:04.847763 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d14eea-5942-49fd-925f-0cf741e6e6ac admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:04.848282 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d14eea-5942-49fd-925f-0cf741e6e6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:04.848945 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d14eea-5942-49fd-925f-0cf741e6e6ac admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:04.849884 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d14eea-5942-49fd-925f-0cf741e6e6ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:04.853029 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d14eea-5942-49fd-925f-0cf741e6e6ac admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:04.865022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:04.909340 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1051/2121] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:57:04 2022] POST /identity/v3/users => generated 282 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 05:57:04.915293 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d14eea-5942-49fd-925f-0cf741e6e6ac admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:04.923946 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b0d14eea-5942-49fd-925f-0cf741e6e6ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:04.969018 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d14eea-5942-49fd-925f-0cf741e6e6ac admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:04.990934 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f3961-5edd-4fc5-b0b0-f70501efaa74 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:04.998371 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fca8dd-6f25-4b49-b638-dbf7e216481f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:04.999520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fca8dd-6f25-4b49-b638-dbf7e216481f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:04.999903 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fca8dd-6f25-4b49-b638-dbf7e216481f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:05.000276 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fca8dd-6f25-4b49-b638-dbf7e216481f admin admin] PATH_INFO: `/v3/projects/93c49eca8a884e5db423382bb62c94fd` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:05.001801 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fca8dd-6f25-4b49-b638-dbf7e216481f admin admin] RBAC: Authorizing `identity:delete_project(project_id=93c49eca8a884e5db423382bb62c94fd)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:05.002871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab96438-a133-4523-9ceb-65556240e3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:05.003769 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab96438-a133-4523-9ceb-65556240e3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:05.004444 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab96438-a133-4523-9ceb-65556240e3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:05.004733 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab96438-a133-4523-9ceb-65556240e3e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:05.005391 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fca8dd-6f25-4b49-b638-dbf7e216481f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:05.005497 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab96438-a133-4523-9ceb-65556240e3e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:05.007119 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab96438-a133-4523-9ceb-65556240e3e2 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:05.033001 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:05.037511 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1052/2122] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:57:05.043754 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab96438-a133-4523-9ceb-65556240e3e2 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:05.059904 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab96438-a133-4523-9ceb-65556240e3e2 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:05.066694 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b5083-ba3a-497e-86ae-3391a17dfdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:05.067695 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b5083-ba3a-497e-86ae-3391a17dfdee admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:05.068214 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b5083-ba3a-497e-86ae-3391a17dfdee admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:05.069704 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b5083-ba3a-497e-86ae-3391a17dfdee admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:05.071922 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b5083-ba3a-497e-86ae-3391a17dfdee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:05.074888 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b5083-ba3a-497e-86ae-3391a17dfdee admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:05.096865 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-82fca8dd-6f25-4b49-b638-dbf7e216481f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93c49eca8a884e5db423382bb62c94fd', 'request_id': 'req-82fca8dd-6f25-4b49-b638-dbf7e216481f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:05.105133 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1053/2123] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:57:05.109106 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-82fca8dd-6f25-4b49-b638-dbf7e216481f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93c49eca8a884e5db423382bb62c94fd', 'request_id': 'req-82fca8dd-6f25-4b49-b638-dbf7e216481f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:05.120804 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b5083-ba3a-497e-86ae-3391a17dfdee admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:05.142117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-82fca8dd-6f25-4b49-b638-dbf7e216481f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93c49eca8a884e5db423382bb62c94fd', 'request_id': 'req-82fca8dd-6f25-4b49-b638-dbf7e216481f'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:05.147071 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b5083-ba3a-497e-86ae-3391a17dfdee admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:05.177992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-82fca8dd-6f25-4b49-b638-dbf7e216481f admin admin] The token cache is being invalidate because project 93c49eca8a884e5db423382bb62c94fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:57:05.178571 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-82fca8dd-6f25-4b49-b638-dbf7e216481f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:05.180101 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-82fca8dd-6f25-4b49-b638-dbf7e216481f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:05.183170 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1071/2124] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:57:04 2022] DELETE /identity/v3/projects/93c49eca8a884e5db423382bb62c94fd => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:05.188968 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174b3ca-c126-4eff-a942-4d4a66bcb830 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:05.190191 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174b3ca-c126-4eff-a942-4d4a66bcb830 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:05.190901 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174b3ca-c126-4eff-a942-4d4a66bcb830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:05.219721 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-1174b3ca-c126-4eff-a942-4d4a66bcb830 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:05.221836 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1174b3ca-c126-4eff-a942-4d4a66bcb830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:05.223942 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b084218-a533-4693-b818-bf960ba5478f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:05.224879 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b084218-a533-4693-b818-bf960ba5478f admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:05.225139 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b084218-a533-4693-b818-bf960ba5478f admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:05.225423 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b084218-a533-4693-b818-bf960ba5478f admin admin] PATH_INFO: `/v3/projects/3642088d784e4911976ac23e23759356/users/eca334075712429792563863296ae560/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:05.248392 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b084218-a533-4693-b818-bf960ba5478f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3642088d784e4911976ac23e23759356, user_id=eca334075712429792563863296ae560, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:05.252048 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b084218-a533-4693-b818-bf960ba5478f admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:05.255225 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1072/2125] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:05.264626 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478847be-cc96-4800-a0e3-6574a219e7f3 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:05.264918 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478847be-cc96-4800-a0e3-6574a219e7f3 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:05.265183 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478847be-cc96-4800-a0e3-6574a219e7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:05.279595 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1054/2126] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:57:05 2022] PUT /identity/v3/projects/3642088d784e4911976ac23e23759356/users/eca334075712429792563863296ae560/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:05.289137 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c79c1-c35b-42f8-9e9f-9c0df8d47763 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:05.290860 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c79c1-c35b-42f8-9e9f-9c0df8d47763 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:05.292241 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c79c1-c35b-42f8-9e9f-9c0df8d47763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:05.313209 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-478847be-cc96-4800-a0e3-6574a219e7f3 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:05.314416 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-478847be-cc96-4800-a0e3-6574a219e7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:05.362018 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-564c79c1-c35b-42f8-9e9f-9c0df8d47763 None None] MFA Rules not processed for user `eca334075712429792563863296ae560`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:05.364694 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-564c79c1-c35b-42f8-9e9f-9c0df8d47763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:05.476952 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1073/2127] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:57:05.477831 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478847be-cc96-4800-a0e3-6574a219e7f3 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:05.482134 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-478847be-cc96-4800-a0e3-6574a219e7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:05.497124 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478847be-cc96-4800-a0e3-6574a219e7f3 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:05.503833 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572fc24-70be-4699-a6e2-34dcd9913ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:05.504389 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1055/2128] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:05 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:05.505111 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572fc24-70be-4699-a6e2-34dcd9913ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:05.505380 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c79c1-c35b-42f8-9e9f-9c0df8d47763 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:05.505499 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572fc24-70be-4699-a6e2-34dcd9913ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:05.505866 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572fc24-70be-4699-a6e2-34dcd9913ff6 admin admin] PATH_INFO: `/v3/projects/b7fe28e669ca4ed5ab50df399b568655` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:05.508966 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572fc24-70be-4699-a6e2-34dcd9913ff6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7fe28e669ca4ed5ab50df399b568655)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:05.511212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572fc24-70be-4699-a6e2-34dcd9913ff6 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:05.528714 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c79c1-c35b-42f8-9e9f-9c0df8d47763 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:05.539226 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904c78f-29c2-47d9-a84a-436bec711f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:05.539226 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904c78f-29c2-47d9-a84a-436bec711f3d admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:05.539226 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904c78f-29c2-47d9-a84a-436bec711f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:05.539226 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904c78f-29c2-47d9-a84a-436bec711f3d admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:05.539787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c904c78f-29c2-47d9-a84a-436bec711f3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:57:05.539787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c904c78f-29c2-47d9-a84a-436bec711f3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:05.539787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c904c78f-29c2-47d9-a84a-436bec711f3d admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:05.555011 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1056/2129] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:57:05.555970 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904c78f-29c2-47d9-a84a-436bec711f3d admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:05.560507 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c904c78f-29c2-47d9-a84a-436bec711f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:05.585096 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f572fc24-70be-4699-a6e2-34dcd9913ff6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7fe28e669ca4ed5ab50df399b568655', 'request_id': 'req-f572fc24-70be-4699-a6e2-34dcd9913ff6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:05.593747 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f572fc24-70be-4699-a6e2-34dcd9913ff6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7fe28e669ca4ed5ab50df399b568655', 'request_id': 'req-f572fc24-70be-4699-a6e2-34dcd9913ff6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:05.603118 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f572fc24-70be-4699-a6e2-34dcd9913ff6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7fe28e669ca4ed5ab50df399b568655', 'request_id': 'req-f572fc24-70be-4699-a6e2-34dcd9913ff6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:05.609886 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:05.632137 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f572fc24-70be-4699-a6e2-34dcd9913ff6 admin admin] The token cache is being invalidate because project b7fe28e669ca4ed5ab50df399b568655 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:57:05.633322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f572fc24-70be-4699-a6e2-34dcd9913ff6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:05.634198 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f572fc24-70be-4699-a6e2-34dcd9913ff6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:05.636316 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1074/2130] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:57:05 2022] DELETE /identity/v3/projects/b7fe28e669ca4ed5ab50df399b568655 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:05.637294 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572fc24-70be-4699-a6e2-34dcd9913ff6 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:05.639776 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f572fc24-70be-4699-a6e2-34dcd9913ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:05.655720 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904c78f-29c2-47d9-a84a-436bec711f3d admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:05.672113 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:05.727225 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040cbb4-8376-4b91-830e-b4494417016d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:05.728022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040cbb4-8376-4b91-830e-b4494417016d service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:05.728300 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040cbb4-8376-4b91-830e-b4494417016d service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:05.728762 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040cbb4-8376-4b91-830e-b4494417016d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:05.731378 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-7040cbb4-8376-4b91-830e-b4494417016d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:05.746656 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572fc24-70be-4699-a6e2-34dcd9913ff6 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:05.752924 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e097201-0fb8-4bf2-bfcd-40b3a0beba7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:05.754289 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e097201-0fb8-4bf2-bfcd-40b3a0beba7b admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:05.754634 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e097201-0fb8-4bf2-bfcd-40b3a0beba7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:05.754970 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e097201-0fb8-4bf2-bfcd-40b3a0beba7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:05.756154 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e097201-0fb8-4bf2-bfcd-40b3a0beba7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:05.758993 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e097201-0fb8-4bf2-bfcd-40b3a0beba7b admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:05.796395 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1075/2131] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:57:05 2022] POST /identity/v3/projects => generated 367 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:57:05.797934 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f267a0-d239-4c0f-babf-93ba9608d046 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:05.798248 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f267a0-d239-4c0f-babf-93ba9608d046 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:05.798526 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f267a0-d239-4c0f-babf-93ba9608d046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:05.810780 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040cbb4-8376-4b91-830e-b4494417016d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:05.812534 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040cbb4-8376-4b91-830e-b4494417016d service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:05.820994 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a6f267a0-d239-4c0f-babf-93ba9608d046 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:05.822175 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a6f267a0-d239-4c0f-babf-93ba9608d046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:05.823763 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1057/2132] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:57:05 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:57:05.824649 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040cbb4-8376-4b91-830e-b4494417016d service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:05.838675 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040cbb4-8376-4b91-830e-b4494417016d service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:05.899346 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7425e8-532c-4bf8-b06f-bf04635b1b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:05.900120 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7425e8-532c-4bf8-b06f-bf04635b1b5d admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:05.900474 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7425e8-532c-4bf8-b06f-bf04635b1b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:05.900825 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7425e8-532c-4bf8-b06f-bf04635b1b5d admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:05.901604 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7425e8-532c-4bf8-b06f-bf04635b1b5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:05.903663 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7425e8-532c-4bf8-b06f-bf04635b1b5d admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:05.915376 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1076/2133] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:05.916633 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f267a0-d239-4c0f-babf-93ba9608d046 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:05.918816 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a6f267a0-d239-4c0f-babf-93ba9608d046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:05.925502 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1058/2134] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:57:05 2022] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:57:05.927295 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092a777-dc96-471a-94a5-08482b225996 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:05.927840 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092a777-dc96-471a-94a5-08482b225996 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:05.928369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092a777-dc96-471a-94a5-08482b225996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:05.931063 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f267a0-d239-4c0f-babf-93ba9608d046 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:05.935934 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69851a-03fb-4495-9a84-6a27caf6a203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:05.936809 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69851a-03fb-4495-9a84-6a27caf6a203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:05.937085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69851a-03fb-4495-9a84-6a27caf6a203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:05.937360 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69851a-03fb-4495-9a84-6a27caf6a203 admin admin] PATH_INFO: `/v3/users/aab0dd125b4d481fa6a950b1d0269b38` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:05.938664 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e69851a-03fb-4495-9a84-6a27caf6a203 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aab0dd125b4d481fa6a950b1d0269b38)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:05.940672 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e69851a-03fb-4495-9a84-6a27caf6a203 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:05.946958 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-a092a777-dc96-471a-94a5-08482b225996 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:05.948205 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-a092a777-dc96-471a-94a5-08482b225996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:05.956246 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1059/2135] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:05.957166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092a777-dc96-471a-94a5-08482b225996 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:05.969087 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092a777-dc96-471a-94a5-08482b225996 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:05.975076 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe591c-cf2e-4b1b-aace-47bad8bc447e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:05.975718 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe591c-cf2e-4b1b-aace-47bad8bc447e admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:05.976057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe591c-cf2e-4b1b-aace-47bad8bc447e admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:05.976335 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe591c-cf2e-4b1b-aace-47bad8bc447e admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:05.977115 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe591c-cf2e-4b1b-aace-47bad8bc447e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:05.978926 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe591c-cf2e-4b1b-aace-47bad8bc447e admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:05.994047 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1060/2136] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:57:05.994047 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe591c-cf2e-4b1b-aace-47bad8bc447e admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:06.003307 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3e69851a-03fb-4495-9a84-6a27caf6a203 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aab0dd125b4d481fa6a950b1d0269b38'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:06.005335 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe591c-cf2e-4b1b-aace-47bad8bc447e admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:06.010419 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31197c78-2a5a-4b1c-87b4-b91380d677ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:06.011249 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3e69851a-03fb-4495-9a84-6a27caf6a203 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aab0dd125b4d481fa6a950b1d0269b38'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:06.011537 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31197c78-2a5a-4b1c-87b4-b91380d677ab admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:06.012047 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31197c78-2a5a-4b1c-87b4-b91380d677ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:06.012540 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31197c78-2a5a-4b1c-87b4-b91380d677ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:06.013650 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31197c78-2a5a-4b1c-87b4-b91380d677ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:57:06.013971 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31197c78-2a5a-4b1c-87b4-b91380d677ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:06.016129 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31197c78-2a5a-4b1c-87b4-b91380d677ab admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:06.020335 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3e69851a-03fb-4495-9a84-6a27caf6a203 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aab0dd125b4d481fa6a950b1d0269b38'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:06.021299 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3e69851a-03fb-4495-9a84-6a27caf6a203 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aab0dd125b4d481fa6a950b1d0269b38'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:06.024666 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:06.036639 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1061/2137] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:57:06.037878 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31197c78-2a5a-4b1c-87b4-b91380d677ab admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:06.040007 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3e69851a-03fb-4495-9a84-6a27caf6a203 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aab0dd125b4d481fa6a950b1d0269b38'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:06.046365 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1077/2138] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:57:05 2022] DELETE /identity/v3/users/aab0dd125b4d481fa6a950b1d0269b38 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:06.050082 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31197c78-2a5a-4b1c-87b4-b91380d677ab admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:06.050508 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69851a-03fb-4495-9a84-6a27caf6a203 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:06.052013 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3e69851a-03fb-4495-9a84-6a27caf6a203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:06.070583 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:06.140217 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69851a-03fb-4495-9a84-6a27caf6a203 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:06.142663 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5b7d4-ddca-4a5f-b3bb-1400df5cf4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:06.142663 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5b7d4-ddca-4a5f-b3bb-1400df5cf4ba admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:06.142899 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5b7d4-ddca-4a5f-b3bb-1400df5cf4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:06.143215 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5b7d4-ddca-4a5f-b3bb-1400df5cf4ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:06.144212 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b5b7d4-ddca-4a5f-b3bb-1400df5cf4ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:06.145951 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b5b7d4-ddca-4a5f-b3bb-1400df5cf4ba admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:06.158814 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e038c3-caa8-4ea0-8717-cdfb46fdeb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:06.160598 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e038c3-caa8-4ea0-8717-cdfb46fdeb7c admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:06.161468 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e038c3-caa8-4ea0-8717-cdfb46fdeb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:06.163475 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e038c3-caa8-4ea0-8717-cdfb46fdeb7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:06.164339 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e038c3-caa8-4ea0-8717-cdfb46fdeb7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:06.167122 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e038c3-caa8-4ea0-8717-cdfb46fdeb7c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:06.174241 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1062/2139] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:57:06.175160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5b7d4-ddca-4a5f-b3bb-1400df5cf4ba admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:06.181506 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d4b5b7d4-ddca-4a5f-b3bb-1400df5cf4ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:06.204790 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5b7d4-ddca-4a5f-b3bb-1400df5cf4ba admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:06.210131 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121807d-1a43-4577-8eb7-257e49f6d612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:06.211111 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121807d-1a43-4577-8eb7-257e49f6d612 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:06.213527 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121807d-1a43-4577-8eb7-257e49f6d612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:06.219173 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121807d-1a43-4577-8eb7-257e49f6d612 admin admin] PATH_INFO: `/v3/projects/3289ac0bb5d84f329ac926f4f4d87e3d/users/06d55c041b454c93a15726ccfb7b3a9a/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:06.222527 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1078/2140] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:57:06 2022] POST /identity/v3/projects => generated 399 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:57:06.226807 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e038c3-caa8-4ea0-8717-cdfb46fdeb7c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:06.259315 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121807d-1a43-4577-8eb7-257e49f6d612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3289ac0bb5d84f329ac926f4f4d87e3d, user_id=06d55c041b454c93a15726ccfb7b3a9a, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:06.262668 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121807d-1a43-4577-8eb7-257e49f6d612 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:06.300104 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1063/2141] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:57:06 2022] PUT /identity/v3/projects/3289ac0bb5d84f329ac926f4f4d87e3d/users/06d55c041b454c93a15726ccfb7b3a9a/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:06.312829 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad85ae-c6bc-4c35-a1e1-3f7a07d33539 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:06.313208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad85ae-c6bc-4c35-a1e1-3f7a07d33539 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:06.313526 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad85ae-c6bc-4c35-a1e1-3f7a07d33539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:06.320283 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e038c3-caa8-4ea0-8717-cdfb46fdeb7c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:06.349562 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-b7ad85ae-c6bc-4c35-a1e1-3f7a07d33539 None None] MFA Rules not processed for user `06d55c041b454c93a15726ccfb7b3a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:06.351658 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b7ad85ae-c6bc-4c35-a1e1-3f7a07d33539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:06.390740 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c574b98-e951-4920-b109-3fddbdc48197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:06.391750 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c574b98-e951-4920-b109-3fddbdc48197 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:06.392291 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c574b98-e951-4920-b109-3fddbdc48197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:06.392714 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c574b98-e951-4920-b109-3fddbdc48197 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:06.393531 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c574b98-e951-4920-b109-3fddbdc48197 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:06.395743 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c574b98-e951-4920-b109-3fddbdc48197 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:06.422556 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1079/2142] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:57:06 2022] POST /identity/v3/users => generated 300 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:57:06.427255 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c574b98-e951-4920-b109-3fddbdc48197 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:06.439555 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c574b98-e951-4920-b109-3fddbdc48197 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:06.451724 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1064/2143] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:06.461320 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad85ae-c6bc-4c35-a1e1-3f7a07d33539 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:06.464650 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9042cc-78d6-4725-9217-cd5ec292fa3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:06.465352 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9042cc-78d6-4725-9217-cd5ec292fa3a admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:06.465692 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9042cc-78d6-4725-9217-cd5ec292fa3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:06.466042 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9042cc-78d6-4725-9217-cd5ec292fa3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:06.467793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b7ad85ae-c6bc-4c35-a1e1-3f7a07d33539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:06.468257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9042cc-78d6-4725-9217-cd5ec292fa3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:06.470260 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9042cc-78d6-4725-9217-cd5ec292fa3a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:06.489856 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1080/2144] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:57:06.490747 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9042cc-78d6-4725-9217-cd5ec292fa3a admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:06.492515 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-bc9042cc-78d6-4725-9217-cd5ec292fa3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:06.508362 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9042cc-78d6-4725-9217-cd5ec292fa3a admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:06.513126 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43d300-5ff9-4cda-a266-f8357503ebdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:06.513998 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43d300-5ff9-4cda-a266-f8357503ebdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:06.514280 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43d300-5ff9-4cda-a266-f8357503ebdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:06.514888 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43d300-5ff9-4cda-a266-f8357503ebdb admin admin] PATH_INFO: `/v3/projects/f8958024d7994077956f35547e0a0704` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:06.516352 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43d300-5ff9-4cda-a266-f8357503ebdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8958024d7994077956f35547e0a0704)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:06.518534 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43d300-5ff9-4cda-a266-f8357503ebdb admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:06.550623 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:06.564310 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad85ae-c6bc-4c35-a1e1-3f7a07d33539 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:06.568345 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10ca30-96de-4153-a3b7-f273eccb9460 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77f0477631724d7f9c8ba752ba27866d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:06.569076 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10ca30-96de-4153-a3b7-f273eccb9460 service glance] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:06.569361 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10ca30-96de-4153-a3b7-f273eccb9460 service glance] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:06.569641 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10ca30-96de-4153-a3b7-f273eccb9460 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:06.578442 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10ca30-96de-4153-a3b7-f273eccb9460 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:06.579882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8b43d300-5ff9-4cda-a266-f8357503ebdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8958024d7994077956f35547e0a0704', 'request_id': 'req-8b43d300-5ff9-4cda-a266-f8357503ebdb'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:06.580090 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10ca30-96de-4153-a3b7-f273eccb9460 service glance] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:06.586621 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8b43d300-5ff9-4cda-a266-f8357503ebdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8958024d7994077956f35547e0a0704', 'request_id': 'req-8b43d300-5ff9-4cda-a266-f8357503ebdb'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:06.588720 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1065/2145] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:57:06 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:57:06.591349 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10ca30-96de-4153-a3b7-f273eccb9460 service glance] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:06.597436 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:06.600619 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8b43d300-5ff9-4cda-a266-f8357503ebdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8958024d7994077956f35547e0a0704', 'request_id': 'req-8b43d300-5ff9-4cda-a266-f8357503ebdb'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:06.605411 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10ca30-96de-4153-a3b7-f273eccb9460 service glance] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:06.614818 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8b43d300-5ff9-4cda-a266-f8357503ebdb admin admin] The token cache is being invalidate because project f8958024d7994077956f35547e0a0704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:57:06.615130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8b43d300-5ff9-4cda-a266-f8357503ebdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:06.615915 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8b43d300-5ff9-4cda-a266-f8357503ebdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:06.617808 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1081/2146] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:57:06 2022] DELETE /identity/v3/projects/f8958024d7994077956f35547e0a0704 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:06.620054 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43d300-5ff9-4cda-a266-f8357503ebdb admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:06.622076 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8b43d300-5ff9-4cda-a266-f8357503ebdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:06.673563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a4c05-f8cf-4ca0-8bba-d0e530565fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:06.674605 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a4c05-f8cf-4ca0-8bba-d0e530565fcc admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:06.674909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a4c05-f8cf-4ca0-8bba-d0e530565fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:06.675201 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a4c05-f8cf-4ca0-8bba-d0e530565fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:06.676070 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a4c05-f8cf-4ca0-8bba-d0e530565fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:06.677510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a4c05-f8cf-4ca0-8bba-d0e530565fcc admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:06.691019 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1066/2147] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:57:06.692227 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b0fed-3d75-4cb2-b752-ec5be87f1273 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:06.692518 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b0fed-3d75-4cb2-b752-ec5be87f1273 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:06.692611 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43d300-5ff9-4cda-a266-f8357503ebdb admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:06.692798 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b0fed-3d75-4cb2-b752-ec5be87f1273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:06.698693 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6151190-6ee7-4f22-a077-f631c2c2dc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:06.699654 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6151190-6ee7-4f22-a077-f631c2c2dc77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:06.699942 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6151190-6ee7-4f22-a077-f631c2c2dc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:06.700215 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6151190-6ee7-4f22-a077-f631c2c2dc77 admin admin] PATH_INFO: `/v3/users/f88c264468e24e43b932c4b2ac8d6829` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:06.701414 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6151190-6ee7-4f22-a077-f631c2c2dc77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f88c264468e24e43b932c4b2ac8d6829)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:06.703392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6151190-6ee7-4f22-a077-f631c2c2dc77 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:06.714268 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-391b0fed-3d75-4cb2-b752-ec5be87f1273 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:06.715510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-391b0fed-3d75-4cb2-b752-ec5be87f1273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:06.724083 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1067/2148] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:06.724907 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b0fed-3d75-4cb2-b752-ec5be87f1273 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:06.728653 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-391b0fed-3d75-4cb2-b752-ec5be87f1273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:06.742046 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b0fed-3d75-4cb2-b752-ec5be87f1273 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:06.747742 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602f72c-923f-474f-9a0c-de6a41aab6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:06.749588 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602f72c-923f-474f-9a0c-de6a41aab6f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:06.749902 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602f72c-923f-474f-9a0c-de6a41aab6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:06.750197 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602f72c-923f-474f-9a0c-de6a41aab6f5 admin admin] PATH_INFO: `/v3/projects/3c53bbbcd4c94cfdab0797bb535ee91d/users/a55099577e5349919c7bc6aec6f464f8/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:06.766207 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a6151190-6ee7-4f22-a077-f631c2c2dc77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f88c264468e24e43b932c4b2ac8d6829'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:06.767624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602f72c-923f-474f-9a0c-de6a41aab6f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c53bbbcd4c94cfdab0797bb535ee91d, user_id=a55099577e5349919c7bc6aec6f464f8, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:06.770365 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602f72c-923f-474f-9a0c-de6a41aab6f5 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:06.773380 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a6151190-6ee7-4f22-a077-f631c2c2dc77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f88c264468e24e43b932c4b2ac8d6829'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:06.788596 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a6151190-6ee7-4f22-a077-f631c2c2dc77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f88c264468e24e43b932c4b2ac8d6829'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:06.789520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a6151190-6ee7-4f22-a077-f631c2c2dc77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f88c264468e24e43b932c4b2ac8d6829'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:06.798931 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1068/2149] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:57:06 2022] PUT /identity/v3/projects/3c53bbbcd4c94cfdab0797bb535ee91d/users/a55099577e5349919c7bc6aec6f464f8/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:06.800449 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46297850-016f-4433-9eb4-3b330709e66c None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:06.800812 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46297850-016f-4433-9eb4-3b330709e66c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:06.801086 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46297850-016f-4433-9eb4-3b330709e66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:06.807551 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a6151190-6ee7-4f22-a077-f631c2c2dc77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f88c264468e24e43b932c4b2ac8d6829'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:06.814268 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1082/2150] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:57:06 2022] DELETE /identity/v3/users/f88c264468e24e43b932c4b2ac8d6829 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:06.815568 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c0a5c-6892-43e6-9eb0-a64b5cbc1f0e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:06.815852 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c0a5c-6892-43e6-9eb0-a64b5cbc1f0e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:06.816121 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c0a5c-6892-43e6-9eb0-a64b5cbc1f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:06.829080 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-46297850-016f-4433-9eb4-3b330709e66c None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:06.830506 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-46297850-016f-4433-9eb4-3b330709e66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:06.846141 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-af2c0a5c-6892-43e6-9eb0-a64b5cbc1f0e None None] MFA Rules not processed for user `a55099577e5349919c7bc6aec6f464f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:06.847397 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-af2c0a5c-6892-43e6-9eb0-a64b5cbc1f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:06.872297 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:06.897552 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1069/2151] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:06.898865 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331f76d-172f-4eef-9bcd-b1c7cfa14d23 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:06.899150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331f76d-172f-4eef-9bcd-b1c7cfa14d23 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:06.899455 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331f76d-172f-4eef-9bcd-b1c7cfa14d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:06.918094 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-1331f76d-172f-4eef-9bcd-b1c7cfa14d23 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:06.920017 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-1331f76d-172f-4eef-9bcd-b1c7cfa14d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:06.929226 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1070/2152] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:06.933148 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331f76d-172f-4eef-9bcd-b1c7cfa14d23 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:06.937854 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1083/2153] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:06 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:06.943083 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c0a5c-6892-43e6-9eb0-a64b5cbc1f0e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:06.944647 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-af2c0a5c-6892-43e6-9eb0-a64b5cbc1f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:06.946024 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331f76d-172f-4eef-9bcd-b1c7cfa14d23 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:06.952465 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d8212-0711-4fe8-9189-bc468f8166a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:06.953510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d8212-0711-4fe8-9189-bc468f8166a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:06.953884 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d8212-0711-4fe8-9189-bc468f8166a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:06.954445 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d8212-0711-4fe8-9189-bc468f8166a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:06.955338 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d8212-0711-4fe8-9189-bc468f8166a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:57:06.955625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d8212-0711-4fe8-9189-bc468f8166a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:06.957482 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d8212-0711-4fe8-9189-bc468f8166a5 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:06.970771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1071/2154] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:57:06.971864 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d8212-0711-4fe8-9189-bc468f8166a5 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:06.975631 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-698d8212-0711-4fe8-9189-bc468f8166a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:07.009768 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c0a5c-6892-43e6-9eb0-a64b5cbc1f0e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:07.014209 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a18b0-76fc-4589-ab6c-75b0537ebf03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:07.015166 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a18b0-76fc-4589-ab6c-75b0537ebf03 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:07.015166 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a18b0-76fc-4589-ab6c-75b0537ebf03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:07.015474 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a18b0-76fc-4589-ab6c-75b0537ebf03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:07.025429 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a18b0-76fc-4589-ab6c-75b0537ebf03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:07.027168 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a18b0-76fc-4589-ab6c-75b0537ebf03 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:07.043300 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:07.045088 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1084/2155] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:57:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 05:57:07.046203 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a18b0-76fc-4589-ab6c-75b0537ebf03 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:07.048593 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d8212-0711-4fe8-9189-bc468f8166a5 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:07.054179 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf626a-ca59-41d2-8cc3-6188d7b1fd28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:07.054950 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf626a-ca59-41d2-8cc3-6188d7b1fd28 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:07.055391 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf626a-ca59-41d2-8cc3-6188d7b1fd28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:07.055781 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf626a-ca59-41d2-8cc3-6188d7b1fd28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:07.057580 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a18b0-76fc-4589-ab6c-75b0537ebf03 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:07.063376 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e0a06-4966-4a11-bf12-1a5831e37625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:07.064001 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e0a06-4966-4a11-bf12-1a5831e37625 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:07.064289 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e0a06-4966-4a11-bf12-1a5831e37625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:07.064573 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e0a06-4966-4a11-bf12-1a5831e37625 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:07.065424 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e0a06-4966-4a11-bf12-1a5831e37625 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:07.067433 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf626a-ca59-41d2-8cc3-6188d7b1fd28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:07.067905 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e0a06-4966-4a11-bf12-1a5831e37625 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:07.070791 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf626a-ca59-41d2-8cc3-6188d7b1fd28 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:07.082721 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1072/2156] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:57:06 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:57:07.101957 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1085/2157] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:57:07 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:57:07.103532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf626a-ca59-41d2-8cc3-6188d7b1fd28 service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:07.116856 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf626a-ca59-41d2-8cc3-6188d7b1fd28 service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:07.206197 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d00f09-e2b6-49b3-96eb-04f8662dc721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:07.207066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d00f09-e2b6-49b3-96eb-04f8662dc721 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:07.207456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d00f09-e2b6-49b3-96eb-04f8662dc721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:07.208299 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d00f09-e2b6-49b3-96eb-04f8662dc721 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:07.209132 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d00f09-e2b6-49b3-96eb-04f8662dc721 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:07.211721 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d00f09-e2b6-49b3-96eb-04f8662dc721 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:07.238677 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1073/2158] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:57:07 2022] POST /identity/v3/users => generated 287 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 05:57:07.243895 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e0a06-4966-4a11-bf12-1a5831e37625 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:07.257192 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e0a06-4966-4a11-bf12-1a5831e37625 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:07.275786 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f733ad-d881-4185-9359-ebec8e675abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:07.278392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f733ad-d881-4185-9359-ebec8e675abb admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:07.278911 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f733ad-d881-4185-9359-ebec8e675abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:07.280258 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f733ad-d881-4185-9359-ebec8e675abb admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:07.283494 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f733ad-d881-4185-9359-ebec8e675abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:07.287013 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f733ad-d881-4185-9359-ebec8e675abb admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:07.305499 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1086/2159] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:57:07.309677 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d00f09-e2b6-49b3-96eb-04f8662dc721 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:07.322422 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d00f09-e2b6-49b3-96eb-04f8662dc721 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:07.328835 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce78f4-ce95-493a-8a02-6961f965f670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:07.329659 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce78f4-ce95-493a-8a02-6961f965f670 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:07.329988 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce78f4-ce95-493a-8a02-6961f965f670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:07.330446 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce78f4-ce95-493a-8a02-6961f965f670 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:07.331550 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce78f4-ce95-493a-8a02-6961f965f670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:07.333313 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce78f4-ce95-493a-8a02-6961f965f670 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:07.346776 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1074/2160] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:57:07.351237 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f733ad-d881-4185-9359-ebec8e675abb admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:07.367810 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f733ad-d881-4185-9359-ebec8e675abb admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:07.373555 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f87ba9-7dcf-4f32-bb2a-b9f334dce21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:07.374585 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f87ba9-7dcf-4f32-bb2a-b9f334dce21e admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:07.374841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f87ba9-7dcf-4f32-bb2a-b9f334dce21e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:07.375114 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f87ba9-7dcf-4f32-bb2a-b9f334dce21e admin admin] PATH_INFO: `/v3/projects/fa049242a1c141ab9743d3ee44205f63/users/a2e0615bc70f4555b6b89a6ca10874b8/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:07.399122 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f87ba9-7dcf-4f32-bb2a-b9f334dce21e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa049242a1c141ab9743d3ee44205f63, user_id=a2e0615bc70f4555b6b89a6ca10874b8, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:07.402475 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f87ba9-7dcf-4f32-bb2a-b9f334dce21e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:07.426171 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1087/2161] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:57:07 2022] PUT /identity/v3/projects/fa049242a1c141ab9743d3ee44205f63/users/a2e0615bc70f4555b6b89a6ca10874b8/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:07.436451 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b3256-df79-4e78-b7f4-352181fcb531 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:07.436768 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b3256-df79-4e78-b7f4-352181fcb531 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:07.437006 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b3256-df79-4e78-b7f4-352181fcb531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:07.460164 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f87ba9-7dcf-4f32-bb2a-b9f334dce21e admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:07.463867 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-37f87ba9-7dcf-4f32-bb2a-b9f334dce21e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:07.480799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-f42b3256-df79-4e78-b7f4-352181fcb531 None None] MFA Rules not processed for user `a2e0615bc70f4555b6b89a6ca10874b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:07.482047 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f42b3256-df79-4e78-b7f4-352181fcb531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:07.599127 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f87ba9-7dcf-4f32-bb2a-b9f334dce21e admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:07.608201 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d64ce8-28a3-4d34-b286-10300c3591f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:07.610296 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d64ce8-28a3-4d34-b286-10300c3591f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:07.610591 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d64ce8-28a3-4d34-b286-10300c3591f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:07.615519 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d64ce8-28a3-4d34-b286-10300c3591f1 admin admin] PATH_INFO: `/v3/projects/c10f5f8821694132b66cf135144b3d3c` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:07.619244 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d64ce8-28a3-4d34-b286-10300c3591f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c10f5f8821694132b66cf135144b3d3c)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:07.621232 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d64ce8-28a3-4d34-b286-10300c3591f1 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:07.627898 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1075/2162] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:07.633633 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b3256-df79-4e78-b7f4-352181fcb531 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:07.636425 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:07.669372 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b3256-df79-4e78-b7f4-352181fcb531 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:07.688247 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e3558-b08d-4bf7-a749-cfb7562b8c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:07.689186 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e3558-b08d-4bf7-a749-cfb7562b8c30 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:07.689576 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e3558-b08d-4bf7-a749-cfb7562b8c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:07.689932 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e3558-b08d-4bf7-a749-cfb7562b8c30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:07.690828 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e3558-b08d-4bf7-a749-cfb7562b8c30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:07.693586 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e3558-b08d-4bf7-a749-cfb7562b8c30 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:07.751508 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-83d64ce8-28a3-4d34-b286-10300c3591f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c10f5f8821694132b66cf135144b3d3c', 'request_id': 'req-83d64ce8-28a3-4d34-b286-10300c3591f1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:07.763342 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1076/2163] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:57:07 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:57:07.763516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-83d64ce8-28a3-4d34-b286-10300c3591f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c10f5f8821694132b66cf135144b3d3c', 'request_id': 'req-83d64ce8-28a3-4d34-b286-10300c3591f1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:07.764287 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e3558-b08d-4bf7-a749-cfb7562b8c30 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:07.785713 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-83d64ce8-28a3-4d34-b286-10300c3591f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c10f5f8821694132b66cf135144b3d3c', 'request_id': 'req-83d64ce8-28a3-4d34-b286-10300c3591f1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:07.803715 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-83d64ce8-28a3-4d34-b286-10300c3591f1 admin admin] The token cache is being invalidate because project c10f5f8821694132b66cf135144b3d3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:57:07.804147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-83d64ce8-28a3-4d34-b286-10300c3591f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:07.805035 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-83d64ce8-28a3-4d34-b286-10300c3591f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:07.807248 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1088/2164] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:57:07 2022] DELETE /identity/v3/projects/c10f5f8821694132b66cf135144b3d3c => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:07.812304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ca575-ecd0-489b-bdcb-d041814160cb None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:07.812702 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ca575-ecd0-489b-bdcb-d041814160cb None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:07.813290 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ca575-ecd0-489b-bdcb-d041814160cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:07.834521 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-229ca575-ecd0-489b-bdcb-d041814160cb None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:07.835909 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-229ca575-ecd0-489b-bdcb-d041814160cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:07.845438 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:07.890253 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e3558-b08d-4bf7-a749-cfb7562b8c30 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:07.898313 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb84a10-3536-40a3-aebf-6d1c6dac695a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:07.898997 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb84a10-3536-40a3-aebf-6d1c6dac695a admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:07.899316 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb84a10-3536-40a3-aebf-6d1c6dac695a admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:07.899687 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb84a10-3536-40a3-aebf-6d1c6dac695a admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:07.900388 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb84a10-3536-40a3-aebf-6d1c6dac695a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:07.902787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb84a10-3536-40a3-aebf-6d1c6dac695a admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:07.919540 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1089/2165] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:57:07.927285 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1077/2166] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:57:07 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:57:07.931041 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e44b42-17df-41f0-b211-a48f364697a7 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:07.931041 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e44b42-17df-41f0-b211-a48f364697a7 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:07.931041 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e44b42-17df-41f0-b211-a48f364697a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:07.932578 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb84a10-3536-40a3-aebf-6d1c6dac695a admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:07.934668 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ddb84a10-3536-40a3-aebf-6d1c6dac695a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:07.950051 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb84a10-3536-40a3-aebf-6d1c6dac695a admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:07.954924 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1310a8-626c-4e0c-89d8-3c45a052d87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:07.955233 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-43e44b42-17df-41f0-b211-a48f364697a7 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:07.955632 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1310a8-626c-4e0c-89d8-3c45a052d87d admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:07.955913 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1310a8-626c-4e0c-89d8-3c45a052d87d admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:07.956188 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1310a8-626c-4e0c-89d8-3c45a052d87d admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:07.956613 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-43e44b42-17df-41f0-b211-a48f364697a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:07.956962 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1310a8-626c-4e0c-89d8-3c45a052d87d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:07.958565 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1310a8-626c-4e0c-89d8-3c45a052d87d admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:07.973922 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1078/2167] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:57:07.975231 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1310a8-626c-4e0c-89d8-3c45a052d87d admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:07.988410 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1310a8-626c-4e0c-89d8-3c45a052d87d admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:07.993639 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1090/2168] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:57:07.994850 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e44b42-17df-41f0-b211-a48f364697a7 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:07.996576 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d2f34-3258-4250-9664-712dc10fdee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:07.997847 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d2f34-3258-4250-9664-712dc10fdee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:07.998134 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d2f34-3258-4250-9664-712dc10fdee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:07.998455 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d2f34-3258-4250-9664-712dc10fdee3 admin admin] PATH_INFO: `/v3/projects/d4a90ee109f14ec1bf24ddc01d614d52/users/010473b4209040ba867e90afa8059f88/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:08.007494 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e44b42-17df-41f0-b211-a48f364697a7 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:08.013573 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1d09c-572b-4392-92f2-68dc6f3a43f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:08.015161 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1d09c-572b-4392-92f2-68dc6f3a43f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:08.015960 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1d09c-572b-4392-92f2-68dc6f3a43f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:08.019012 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1d09c-572b-4392-92f2-68dc6f3a43f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:08.020694 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1d09c-572b-4392-92f2-68dc6f3a43f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:57:08.021014 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1d09c-572b-4392-92f2-68dc6f3a43f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:08.021382 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d2f34-3258-4250-9664-712dc10fdee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4a90ee109f14ec1bf24ddc01d614d52, user_id=010473b4209040ba867e90afa8059f88, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:08.024590 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d2f34-3258-4250-9664-712dc10fdee3 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:08.025181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1d09c-572b-4392-92f2-68dc6f3a43f5 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:08.042937 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1091/2169] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:57:08.046662 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1079/2170] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:57:07 2022] PUT /identity/v3/projects/d4a90ee109f14ec1bf24ddc01d614d52/users/010473b4209040ba867e90afa8059f88/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 05:57:08.048848 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d2f34-3258-4250-9664-712dc10fdee3 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:08.048963 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1d09c-572b-4392-92f2-68dc6f3a43f5 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:08.059417 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1d09c-572b-4392-92f2-68dc6f3a43f5 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:08.125044 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d2f34-3258-4250-9664-712dc10fdee3 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:08.132895 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6cdd0e-7501-43cf-81a9-f7ab56df2786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:08.133580 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cdd0e-7501-43cf-81a9-f7ab56df2786 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:08.133963 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cdd0e-7501-43cf-81a9-f7ab56df2786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:08.134346 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cdd0e-7501-43cf-81a9-f7ab56df2786 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:08.135081 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6cdd0e-7501-43cf-81a9-f7ab56df2786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:08.136326 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f4d56-ead6-4b18-a02e-f5b6243c0514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:08.136752 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6cdd0e-7501-43cf-81a9-f7ab56df2786 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:08.137004 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f4d56-ead6-4b18-a02e-f5b6243c0514 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:08.137288 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f4d56-ead6-4b18-a02e-f5b6243c0514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:08.137559 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f4d56-ead6-4b18-a02e-f5b6243c0514 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:08.138250 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f4d56-ead6-4b18-a02e-f5b6243c0514 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:08.140484 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f4d56-ead6-4b18-a02e-f5b6243c0514 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:08.147437 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1080/2171] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:57:08.152175 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6cdd0e-7501-43cf-81a9-f7ab56df2786 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:08.168958 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:08.169482 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6cdd0e-7501-43cf-81a9-f7ab56df2786 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:08.172439 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1092/2172] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:57:08 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:57:08.176907 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f4d56-ead6-4b18-a02e-f5b6243c0514 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:08.231540 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4ebc4-40c2-4796-ba18-3a78b8089ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:08.232476 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4ebc4-40c2-4796-ba18-3a78b8089ab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:08.232775 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4ebc4-40c2-4796-ba18-3a78b8089ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:08.233070 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4ebc4-40c2-4796-ba18-3a78b8089ab4 admin admin] PATH_INFO: `/v3/projects/d4a90ee109f14ec1bf24ddc01d614d52/users/010473b4209040ba867e90afa8059f88/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:08.235130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4ebc4-40c2-4796-ba18-3a78b8089ab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4a90ee109f14ec1bf24ddc01d614d52, user_id=010473b4209040ba867e90afa8059f88, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:08.237972 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f4d56-ead6-4b18-a02e-f5b6243c0514 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:08.238495 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4ebc4-40c2-4796-ba18-3a78b8089ab4 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:08.242860 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef4682-ea47-4f37-8b46-2b1eda7d3d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:08.243556 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef4682-ea47-4f37-8b46-2b1eda7d3d21 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:08.243837 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef4682-ea47-4f37-8b46-2b1eda7d3d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:08.244111 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef4682-ea47-4f37-8b46-2b1eda7d3d21 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:08.244792 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef4682-ea47-4f37-8b46-2b1eda7d3d21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:08.246712 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef4682-ea47-4f37-8b46-2b1eda7d3d21 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:08.249591 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1081/2173] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:57:08 2022] PUT /identity/v3/projects/d4a90ee109f14ec1bf24ddc01d614d52/users/010473b4209040ba867e90afa8059f88/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 05:57:08.261153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0ee8f-07c9-4db0-975c-6393e8c61379 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:08.261446 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0ee8f-07c9-4db0-975c-6393e8c61379 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:08.261737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0ee8f-07c9-4db0-975c-6393e8c61379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:08.271588 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1093/2174] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:57:08 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:57:08.272635 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef4682-ea47-4f37-8b46-2b1eda7d3d21 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:08.287478 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef4682-ea47-4f37-8b46-2b1eda7d3d21 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:08.292856 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-32b0ee8f-07c9-4db0-975c-6393e8c61379 None None] MFA Rules not processed for user `010473b4209040ba867e90afa8059f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:08.294085 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-32b0ee8f-07c9-4db0-975c-6393e8c61379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:08.303882 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:08.348363 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ff972-0abf-4a82-992b-b00341002af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:08.349170 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ff972-0abf-4a82-992b-b00341002af2 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:08.349492 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ff972-0abf-4a82-992b-b00341002af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:08.349829 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ff972-0abf-4a82-992b-b00341002af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:08.350693 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ff972-0abf-4a82-992b-b00341002af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:08.353006 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ff972-0abf-4a82-992b-b00341002af2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:08.364327 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1094/2175] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 05:57:08.368054 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1082/2176] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:08 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:57:08.368363 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ff972-0abf-4a82-992b-b00341002af2 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:08.382110 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0ee8f-07c9-4db0-975c-6393e8c61379 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:08.383641 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ff972-0abf-4a82-992b-b00341002af2 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:08.384557 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-32b0ee8f-07c9-4db0-975c-6393e8c61379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:08.389408 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a444cc9-26ff-4ee5-832f-5e0191bcb074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:08.390080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a444cc9-26ff-4ee5-832f-5e0191bcb074 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:08.390358 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a444cc9-26ff-4ee5-832f-5e0191bcb074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:08.390634 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a444cc9-26ff-4ee5-832f-5e0191bcb074 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:08.391409 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a444cc9-26ff-4ee5-832f-5e0191bcb074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:08.393130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a444cc9-26ff-4ee5-832f-5e0191bcb074 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:08.407243 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1095/2177] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 05:57:08.408219 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a444cc9-26ff-4ee5-832f-5e0191bcb074 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:08.417874 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a444cc9-26ff-4ee5-832f-5e0191bcb074 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:08.422371 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ab0d2-167c-4ce4-919e-836efbb92778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:08.423320 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ab0d2-167c-4ce4-919e-836efbb92778 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:08.423601 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ab0d2-167c-4ce4-919e-836efbb92778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:08.423872 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ab0d2-167c-4ce4-919e-836efbb92778 admin admin] PATH_INFO: `/v3/projects/5f96992e27b04e1581b1e8946973e021/users/f7a2d6212ee8450fbc6a5bf19753c3e8/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:08.439218 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ab0d2-167c-4ce4-919e-836efbb92778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f96992e27b04e1581b1e8946973e021, user_id=f7a2d6212ee8450fbc6a5bf19753c3e8, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:08.441883 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ab0d2-167c-4ce4-919e-836efbb92778 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:08.447513 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0ee8f-07c9-4db0-975c-6393e8c61379 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:08.451438 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ed9eb-780f-4596-966c-034a3f7473e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:08.452156 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ed9eb-780f-4596-966c-034a3f7473e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:08.452462 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ed9eb-780f-4596-966c-034a3f7473e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:08.452762 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ed9eb-780f-4596-966c-034a3f7473e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:08.455792 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1096/2178] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:57:08 2022] PUT /identity/v3/projects/5f96992e27b04e1581b1e8946973e021/users/f7a2d6212ee8450fbc6a5bf19753c3e8/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 05:57:08.462205 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ed9eb-780f-4596-966c-034a3f7473e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:08.463694 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ed9eb-780f-4596-966c-034a3f7473e3 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:08.466802 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde66040-5de3-42a9-8b57-100b2fc1a94a None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:08.467090 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde66040-5de3-42a9-8b57-100b2fc1a94a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:08.467428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde66040-5de3-42a9-8b57-100b2fc1a94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:08.473573 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1083/2179] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:57:08 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:57:08.498268 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-cde66040-5de3-42a9-8b57-100b2fc1a94a None None] MFA Rules not processed for user `f7a2d6212ee8450fbc6a5bf19753c3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:08.499734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-cde66040-5de3-42a9-8b57-100b2fc1a94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:08.559861 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:08.568737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ed9eb-780f-4596-966c-034a3f7473e3 service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:08.577345 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ed9eb-780f-4596-966c-034a3f7473e3 service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:08.588018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1097/2180] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:08.600819 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde66040-5de3-42a9-8b57-100b2fc1a94a None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:08.602234 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-cde66040-5de3-42a9-8b57-100b2fc1a94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:08.627927 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80417bfd-9556-409e-8e9f-94ff466c22a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:08.628497 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80417bfd-9556-409e-8e9f-94ff466c22a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:08.628778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80417bfd-9556-409e-8e9f-94ff466c22a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:08.629049 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80417bfd-9556-409e-8e9f-94ff466c22a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:08.630847 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-80417bfd-9556-409e-8e9f-94ff466c22a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:08.658971 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde66040-5de3-42a9-8b57-100b2fc1a94a None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:08.662675 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2413b-e719-488e-89fc-47b748781b1d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77f0477631724d7f9c8ba752ba27866d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:08.663366 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2413b-e719-488e-89fc-47b748781b1d service glance] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:08.663646 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2413b-e719-488e-89fc-47b748781b1d service glance] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:08.663922 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2413b-e719-488e-89fc-47b748781b1d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:08.672293 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2413b-e719-488e-89fc-47b748781b1d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:08.673953 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2413b-e719-488e-89fc-47b748781b1d service glance] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:08.683151 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1098/2181] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:57:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 05:57:08.695992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80417bfd-9556-409e-8e9f-94ff466c22a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:08.697424 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80417bfd-9556-409e-8e9f-94ff466c22a7 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:08.706590 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1084/2182] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:57:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:57:12.552182 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2413b-e719-488e-89fc-47b748781b1d service glance] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:12.553943 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-27e2413b-e719-488e-89fc-47b748781b1d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:12.625370 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2413b-e719-488e-89fc-47b748781b1d service glance] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:12.630313 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59569c-6925-4305-a912-5cdbb6d56dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:12.631211 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59569c-6925-4305-a912-5cdbb6d56dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:12.631500 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59569c-6925-4305-a912-5cdbb6d56dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:12.631771 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59569c-6925-4305-a912-5cdbb6d56dca admin admin] PATH_INFO: `/v3/users/a55099577e5349919c7bc6aec6f464f8` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:12.633003 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59569c-6925-4305-a912-5cdbb6d56dca admin admin] RBAC: Authorizing `identity:delete_user(user_id=a55099577e5349919c7bc6aec6f464f8)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:12.634945 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59569c-6925-4305-a912-5cdbb6d56dca admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:12.683251 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6e59569c-6925-4305-a912-5cdbb6d56dca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a55099577e5349919c7bc6aec6f464f8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:12.690195 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6e59569c-6925-4305-a912-5cdbb6d56dca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a55099577e5349919c7bc6aec6f464f8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:12.699760 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6e59569c-6925-4305-a912-5cdbb6d56dca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a55099577e5349919c7bc6aec6f464f8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:12.700338 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6e59569c-6925-4305-a912-5cdbb6d56dca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a55099577e5349919c7bc6aec6f464f8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:12.712822 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6e59569c-6925-4305-a912-5cdbb6d56dca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a55099577e5349919c7bc6aec6f464f8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:12.723103 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1099/2183] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:57:12 2022] DELETE /identity/v3/users/a55099577e5349919c7bc6aec6f464f8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:12.728531 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0445fe4-f9f7-49a7-b039-e2057ca3c5e4 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:12.729125 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0445fe4-f9f7-49a7-b039-e2057ca3c5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:12.729125 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0445fe4-f9f7-49a7-b039-e2057ca3c5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:12.740387 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:12.752390 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-f0445fe4-f9f7-49a7-b039-e2057ca3c5e4 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:12.753626 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f0445fe4-f9f7-49a7-b039-e2057ca3c5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:12.814662 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1085/2184] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:12.824862 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59569c-6925-4305-a912-5cdbb6d56dca admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:12.827393 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6e59569c-6925-4305-a912-5cdbb6d56dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:12.834644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:12.926999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59569c-6925-4305-a912-5cdbb6d56dca admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:12.932655 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af1dd2-4fc6-43ba-a17e-7b63ae913371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:12.933865 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af1dd2-4fc6-43ba-a17e-7b63ae913371 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:12.934156 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af1dd2-4fc6-43ba-a17e-7b63ae913371 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:12.935565 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af1dd2-4fc6-43ba-a17e-7b63ae913371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:12.948222 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af1dd2-4fc6-43ba-a17e-7b63ae913371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:12.949969 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af1dd2-4fc6-43ba-a17e-7b63ae913371 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:12.960245 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1100/2185] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:57:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 05:57:13.290532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0445fe4-f9f7-49a7-b039-e2057ca3c5e4 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:13.292087 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f0445fe4-f9f7-49a7-b039-e2057ca3c5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:13.312819 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0445fe4-f9f7-49a7-b039-e2057ca3c5e4 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:13.318544 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d01332-3f78-46ce-ae39-0ababd7deb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:13.319539 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d01332-3f78-46ce-ae39-0ababd7deb6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:13.319908 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d01332-3f78-46ce-ae39-0ababd7deb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:13.320342 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d01332-3f78-46ce-ae39-0ababd7deb6d admin admin] PATH_INFO: `/v3/projects/3c53bbbcd4c94cfdab0797bb535ee91d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:13.321769 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d01332-3f78-46ce-ae39-0ababd7deb6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c53bbbcd4c94cfdab0797bb535ee91d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:13.323798 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d01332-3f78-46ce-ae39-0ababd7deb6d admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:13.379681 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-20d01332-3f78-46ce-ae39-0ababd7deb6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c53bbbcd4c94cfdab0797bb535ee91d', 'request_id': 'req-20d01332-3f78-46ce-ae39-0ababd7deb6d'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:13.388297 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-20d01332-3f78-46ce-ae39-0ababd7deb6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c53bbbcd4c94cfdab0797bb535ee91d', 'request_id': 'req-20d01332-3f78-46ce-ae39-0ababd7deb6d'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:13.394490 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-20d01332-3f78-46ce-ae39-0ababd7deb6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c53bbbcd4c94cfdab0797bb535ee91d', 'request_id': 'req-20d01332-3f78-46ce-ae39-0ababd7deb6d'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:13.404971 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-20d01332-3f78-46ce-ae39-0ababd7deb6d admin admin] The token cache is being invalidate because project 3c53bbbcd4c94cfdab0797bb535ee91d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:57:13.405226 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-20d01332-3f78-46ce-ae39-0ababd7deb6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:13.405919 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-20d01332-3f78-46ce-ae39-0ababd7deb6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:13.407869 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1086/2186] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:57:13 2022] DELETE /identity/v3/projects/3c53bbbcd4c94cfdab0797bb535ee91d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:13.412946 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdf07f-e556-436e-9079-ff2a89d35d58 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:13.413225 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdf07f-e556-436e-9079-ff2a89d35d58 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:13.413500 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdf07f-e556-436e-9079-ff2a89d35d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:13.432544 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9acdf07f-e556-436e-9079-ff2a89d35d58 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:13.433769 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9acdf07f-e556-436e-9079-ff2a89d35d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:13.499227 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1101/2187] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:13.508150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a82e3-c6e2-48c4-a3b7-255a98bd32f4 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:13.508885 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a82e3-c6e2-48c4-a3b7-255a98bd32f4 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:13.508885 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a82e3-c6e2-48c4-a3b7-255a98bd32f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:13.530296 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-085a82e3-c6e2-48c4-a3b7-255a98bd32f4 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:13.531737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-085a82e3-c6e2-48c4-a3b7-255a98bd32f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:13.543031 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1087/2188] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:13.547548 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdf07f-e556-436e-9079-ff2a89d35d58 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:13.557109 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdf07f-e556-436e-9079-ff2a89d35d58 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:13.562841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c906284-f83a-4b51-a2ce-bdb1e270327e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:13.563615 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c906284-f83a-4b51-a2ce-bdb1e270327e admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:13.563892 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c906284-f83a-4b51-a2ce-bdb1e270327e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:13.564164 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c906284-f83a-4b51-a2ce-bdb1e270327e admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:13.564955 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c906284-f83a-4b51-a2ce-bdb1e270327e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:57:13.565256 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c906284-f83a-4b51-a2ce-bdb1e270327e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:13.566865 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c906284-f83a-4b51-a2ce-bdb1e270327e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:13.578563 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1102/2189] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:57:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:57:13.583238 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a82e3-c6e2-48c4-a3b7-255a98bd32f4 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:13.593221 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a82e3-c6e2-48c4-a3b7-255a98bd32f4 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:13.599247 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc877cf3-aa2d-4819-b26d-091b67f451e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:13.600061 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc877cf3-aa2d-4819-b26d-091b67f451e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:13.600407 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc877cf3-aa2d-4819-b26d-091b67f451e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:13.600755 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc877cf3-aa2d-4819-b26d-091b67f451e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:13.601461 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc877cf3-aa2d-4819-b26d-091b67f451e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:13.603459 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc877cf3-aa2d-4819-b26d-091b67f451e3 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:13.631392 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1088/2190] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:57:13 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:57:13.635410 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c906284-f83a-4b51-a2ce-bdb1e270327e admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:13.646453 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c906284-f83a-4b51-a2ce-bdb1e270327e admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:13.705330 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88beb44-7f38-4290-88f4-cc104f5ed90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:13.706359 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88beb44-7f38-4290-88f4-cc104f5ed90a admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:13.706654 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88beb44-7f38-4290-88f4-cc104f5ed90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:13.706924 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88beb44-7f38-4290-88f4-cc104f5ed90a admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:13.707678 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88beb44-7f38-4290-88f4-cc104f5ed90a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:13.709821 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88beb44-7f38-4290-88f4-cc104f5ed90a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:13.729722 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1103/2191] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:57:13 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:57:13.734032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc877cf3-aa2d-4819-b26d-091b67f451e3 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:13.745240 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc877cf3-aa2d-4819-b26d-091b67f451e3 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:13.750225 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef954d0-ea80-4049-ad21-25a3b0535625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:13.750888 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef954d0-ea80-4049-ad21-25a3b0535625 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:13.751169 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef954d0-ea80-4049-ad21-25a3b0535625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:13.751469 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef954d0-ea80-4049-ad21-25a3b0535625 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:13.752200 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef954d0-ea80-4049-ad21-25a3b0535625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:13.753820 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef954d0-ea80-4049-ad21-25a3b0535625 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:13.764462 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1089/2192] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:57:13.768561 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88beb44-7f38-4290-88f4-cc104f5ed90a admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:13.778691 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88beb44-7f38-4290-88f4-cc104f5ed90a admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:13.784546 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801df50e-5617-430f-b07c-b307414f1193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:13.785206 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801df50e-5617-430f-b07c-b307414f1193 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:13.785485 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801df50e-5617-430f-b07c-b307414f1193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:13.785752 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801df50e-5617-430f-b07c-b307414f1193 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:13.786469 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801df50e-5617-430f-b07c-b307414f1193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:13.788102 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801df50e-5617-430f-b07c-b307414f1193 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:13.799036 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1104/2193] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:57:13.803559 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef954d0-ea80-4049-ad21-25a3b0535625 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:13.814121 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef954d0-ea80-4049-ad21-25a3b0535625 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:13.819131 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248087f-7088-4978-8241-3477e377eb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:13.820066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248087f-7088-4978-8241-3477e377eb3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:13.820362 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248087f-7088-4978-8241-3477e377eb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:13.820624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248087f-7088-4978-8241-3477e377eb3f admin admin] PATH_INFO: `/v3/projects/e6c12d2d77e04638ab0302f8375a1f60/users/112cd592351f402dab6472657bd4835d/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:13.835993 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248087f-7088-4978-8241-3477e377eb3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6c12d2d77e04638ab0302f8375a1f60, user_id=112cd592351f402dab6472657bd4835d, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:13.840149 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248087f-7088-4978-8241-3477e377eb3f admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:13.855157 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1090/2194] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:57:13 2022] PUT /identity/v3/projects/e6c12d2d77e04638ab0302f8375a1f60/users/112cd592351f402dab6472657bd4835d/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:13.860515 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0c259-61f9-418d-89e5-2cefb1429c92 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:13.861123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0c259-61f9-418d-89e5-2cefb1429c92 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:13.861396 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0c259-61f9-418d-89e5-2cefb1429c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:13.880533 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-b4c0c259-61f9-418d-89e5-2cefb1429c92 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:13.881815 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b4c0c259-61f9-418d-89e5-2cefb1429c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:13.888044 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:13.949115 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1105/2195] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:57:13.963056 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248087f-7088-4978-8241-3477e377eb3f admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:13.964997 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-4248087f-7088-4978-8241-3477e377eb3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:13.996667 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:14.034513 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248087f-7088-4978-8241-3477e377eb3f admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:14.041211 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e7fe4-650e-4b67-8b5a-2ad588623058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:14.042029 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e7fe4-650e-4b67-8b5a-2ad588623058 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:14.042440 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e7fe4-650e-4b67-8b5a-2ad588623058 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:14.042724 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e7fe4-650e-4b67-8b5a-2ad588623058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:14.055135 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e7fe4-650e-4b67-8b5a-2ad588623058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:14.056626 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e7fe4-650e-4b67-8b5a-2ad588623058 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:14.067734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1091/2196] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:57:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 05:57:18.364365 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96662148-8d27-44e9-9886-6fcf5f2108e1 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:18.364948 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96662148-8d27-44e9-9886-6fcf5f2108e1 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:18.364948 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96662148-8d27-44e9-9886-6fcf5f2108e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:18.398179 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-96662148-8d27-44e9-9886-6fcf5f2108e1 None None] MFA Rules not processed for user `112cd592351f402dab6472657bd4835d`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:18.399704 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-96662148-8d27-44e9-9886-6fcf5f2108e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:18.467965 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1106/2197] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:18.473040 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e7fe4-650e-4b67-8b5a-2ad588623058 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:18.483699 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e7fe4-650e-4b67-8b5a-2ad588623058 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:18.489238 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa807318-d822-42e5-8296-02bff0f47ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:18.489907 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa807318-d822-42e5-8296-02bff0f47ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:18.490184 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa807318-d822-42e5-8296-02bff0f47ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:18.490455 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa807318-d822-42e5-8296-02bff0f47ed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:18.491146 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa807318-d822-42e5-8296-02bff0f47ed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:18.493474 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa807318-d822-42e5-8296-02bff0f47ed5 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:18.524598 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1092/2198] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:57:18 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:57:18.533994 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96662148-8d27-44e9-9886-6fcf5f2108e1 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:18.550542 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96662148-8d27-44e9-9886-6fcf5f2108e1 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:18.611065 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aff118-5697-45bc-81b7-41ea83fac0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:18.611798 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aff118-5697-45bc-81b7-41ea83fac0a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:18.612079 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aff118-5697-45bc-81b7-41ea83fac0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:18.612351 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aff118-5697-45bc-81b7-41ea83fac0a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:18.613054 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aff118-5697-45bc-81b7-41ea83fac0a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:18.615509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aff118-5697-45bc-81b7-41ea83fac0a3 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:18.642598 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1107/2199] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:57:18 2022] POST /identity/v3/users => generated 298 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:57:18.646337 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa807318-d822-42e5-8296-02bff0f47ed5 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:18.658047 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa807318-d822-42e5-8296-02bff0f47ed5 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:18.664245 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ea0c7-4b8b-4380-8a97-bc10cb72b358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:18.664967 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ea0c7-4b8b-4380-8a97-bc10cb72b358 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:18.665235 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ea0c7-4b8b-4380-8a97-bc10cb72b358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:18.665508 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ea0c7-4b8b-4380-8a97-bc10cb72b358 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:18.666225 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ea0c7-4b8b-4380-8a97-bc10cb72b358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:18.667854 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ea0c7-4b8b-4380-8a97-bc10cb72b358 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:18.683978 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aff118-5697-45bc-81b7-41ea83fac0a3 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:18.685284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1093/2200] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:57:18.696194 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aff118-5697-45bc-81b7-41ea83fac0a3 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:18.701256 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74bed2-c8cb-4575-8a25-ed90cffd844e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:18.702157 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74bed2-c8cb-4575-8a25-ed90cffd844e admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:18.702440 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74bed2-c8cb-4575-8a25-ed90cffd844e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:18.702711 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74bed2-c8cb-4575-8a25-ed90cffd844e admin admin] PATH_INFO: `/v3/projects/0f5ee7c846894708b86020c5d55669ee/users/0df29ca4456044cd95e0f5e55b640ba8/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:18.718861 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f74bed2-c8cb-4575-8a25-ed90cffd844e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f5ee7c846894708b86020c5d55669ee, user_id=0df29ca4456044cd95e0f5e55b640ba8, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:18.721620 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f74bed2-c8cb-4575-8a25-ed90cffd844e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:18.742869 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1108/2201] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:57:18 2022] PUT /identity/v3/projects/0f5ee7c846894708b86020c5d55669ee/users/0df29ca4456044cd95e0f5e55b640ba8/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:18.746762 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ea0c7-4b8b-4380-8a97-bc10cb72b358 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:18.757511 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ea0c7-4b8b-4380-8a97-bc10cb72b358 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:18.823567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f7d85-fe85-4e3f-9803-fec3f3c6a88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:18.824072 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f7d85-fe85-4e3f-9803-fec3f3c6a88a admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:18.824811 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f7d85-fe85-4e3f-9803-fec3f3c6a88a admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:18.824811 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f7d85-fe85-4e3f-9803-fec3f3c6a88a admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:18.825428 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f7d85-fe85-4e3f-9803-fec3f3c6a88a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:18.829499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f7d85-fe85-4e3f-9803-fec3f3c6a88a admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:18.854578 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1094/2202] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:57:18.856071 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74bed2-c8cb-4575-8a25-ed90cffd844e admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:18.873154 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74bed2-c8cb-4575-8a25-ed90cffd844e admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:18.882379 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e15ec-58ab-4abb-aa44-3452faa05104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:18.883469 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e15ec-58ab-4abb-aa44-3452faa05104 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:18.883748 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e15ec-58ab-4abb-aa44-3452faa05104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:18.884025 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e15ec-58ab-4abb-aa44-3452faa05104 admin admin] PATH_INFO: `/v3/projects/0f5ee7c846894708b86020c5d55669ee/users/0df29ca4456044cd95e0f5e55b640ba8/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:18.887443 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e15ec-58ab-4abb-aa44-3452faa05104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f5ee7c846894708b86020c5d55669ee, user_id=0df29ca4456044cd95e0f5e55b640ba8, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:18.890267 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e15ec-58ab-4abb-aa44-3452faa05104 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:18.892845 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:18.929960 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1109/2203] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:57:18 2022] PUT /identity/v3/projects/0f5ee7c846894708b86020c5d55669ee/users/0df29ca4456044cd95e0f5e55b640ba8/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:24.387464 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e7939-296b-4d02-8dc8-465735ff4f64 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:24.387967 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e7939-296b-4d02-8dc8-465735ff4f64 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:24.388058 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e7939-296b-4d02-8dc8-465735ff4f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:24.420739 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-f35e7939-296b-4d02-8dc8-465735ff4f64 None None] MFA Rules not processed for user `0df29ca4456044cd95e0f5e55b640ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:24.422900 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f35e7939-296b-4d02-8dc8-465735ff4f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:24.499958 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1095/2204] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:27.527233 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e15ec-58ab-4abb-aa44-3452faa05104 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:27.529875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-794e15ec-58ab-4abb-aa44-3452faa05104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:27.615754 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e15ec-58ab-4abb-aa44-3452faa05104 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:27.620154 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88f066-c9fc-4dad-bdf9-0b64a7160bc3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77f0477631724d7f9c8ba752ba27866d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:27.620981 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88f066-c9fc-4dad-bdf9-0b64a7160bc3 service glance] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:27.621274 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88f066-c9fc-4dad-bdf9-0b64a7160bc3 service glance] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:27.624347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88f066-c9fc-4dad-bdf9-0b64a7160bc3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:27.741766 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88f066-c9fc-4dad-bdf9-0b64a7160bc3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:27.743360 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88f066-c9fc-4dad-bdf9-0b64a7160bc3 service glance] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:27.755034 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1110/2205] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:57:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:57:27.982170 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f83c00-1605-4fa7-956b-d1e0fc81450a None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:27.982703 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f83c00-1605-4fa7-956b-d1e0fc81450a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:27.982703 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f83c00-1605-4fa7-956b-d1e0fc81450a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:28.003323 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-e1f83c00-1605-4fa7-956b-d1e0fc81450a None None] MFA Rules not processed for user `3ed779ae7e0f4c90aaed6d1f9e86a4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:28.004837 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e1f83c00-1605-4fa7-956b-d1e0fc81450a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:28.020720 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:28.078573 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1096/2206] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jul 4 05:57:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:28.139794 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88f066-c9fc-4dad-bdf9-0b64a7160bc3 service glance] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:28.141336 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1d88f066-c9fc-4dad-bdf9-0b64a7160bc3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:28.223251 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88f066-c9fc-4dad-bdf9-0b64a7160bc3 service glance] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:28.229326 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12162fc6-203f-4909-aeaa-b26645f1ee90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55a1c343c60428db2d9e5e6ed865e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:28.229979 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12162fc6-203f-4909-aeaa-b26645f1ee90 service swift] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:28.230259 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12162fc6-203f-4909-aeaa-b26645f1ee90 service swift] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:28.230534 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12162fc6-203f-4909-aeaa-b26645f1ee90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:28.239213 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12162fc6-203f-4909-aeaa-b26645f1ee90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:28.240844 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12162fc6-203f-4909-aeaa-b26645f1ee90 service swift] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:28.255968 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1111/2207] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 4 05:57:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 05:57:38.071358 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=18 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:38.250331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:INSERT=1,keystone:SELECT=82 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:38.607259 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754dd5f-222d-46d4-8607-74b93a037e1e None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:38.607601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754dd5f-222d-46d4-8607-74b93a037e1e None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:38.607881 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754dd5f-222d-46d4-8607-74b93a037e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:38.625464 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-b754dd5f-222d-46d4-8607-74b93a037e1e None None] MFA Rules not processed for user `112cd592351f402dab6472657bd4835d`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:38.626682 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b754dd5f-222d-46d4-8607-74b93a037e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:38.633465 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1097/2208] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:40.687934 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce8d56-e340-447e-9c42-351b6554b019 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:40.688420 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce8d56-e340-447e-9c42-351b6554b019 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:40.688537 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce8d56-e340-447e-9c42-351b6554b019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:40.708528 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-15ce8d56-e340-447e-9c42-351b6554b019 None None] MFA Rules not processed for user `3ed779ae7e0f4c90aaed6d1f9e86a4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:40.709913 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-15ce8d56-e340-447e-9c42-351b6554b019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:40.718641 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1112/2209] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jul 4 05:57:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:40.735413 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754dd5f-222d-46d4-8607-74b93a037e1e None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:40.752232 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754dd5f-222d-46d4-8607-74b93a037e1e None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:40.760882 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55eef2-2400-4d5b-a257-b1dd40f021e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55a1c343c60428db2d9e5e6ed865e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:40.762051 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55eef2-2400-4d5b-a257-b1dd40f021e7 service swift] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:40.762566 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55eef2-2400-4d5b-a257-b1dd40f021e7 service swift] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:40.763203 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55eef2-2400-4d5b-a257-b1dd40f021e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:40.774854 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55eef2-2400-4d5b-a257-b1dd40f021e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:40.776779 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55eef2-2400-4d5b-a257-b1dd40f021e7 service swift] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:40.790009 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1098/2210] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 4 05:57:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 05:57:41.372144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce8d56-e340-447e-9c42-351b6554b019 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:41.373983 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-15ce8d56-e340-447e-9c42-351b6554b019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:41.459163 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce8d56-e340-447e-9c42-351b6554b019 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:41.464737 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0992c4-24a2-4bd4-8925-350c62904130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:41.465898 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0992c4-24a2-4bd4-8925-350c62904130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:41.466431 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0992c4-24a2-4bd4-8925-350c62904130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:41.466825 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0992c4-24a2-4bd4-8925-350c62904130 admin admin] PATH_INFO: `/v3/users/a2e0615bc70f4555b6b89a6ca10874b8` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:41.468501 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0992c4-24a2-4bd4-8925-350c62904130 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2e0615bc70f4555b6b89a6ca10874b8)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:41.471121 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0992c4-24a2-4bd4-8925-350c62904130 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:41.573923 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6f0992c4-24a2-4bd4-8925-350c62904130 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2e0615bc70f4555b6b89a6ca10874b8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:41.590721 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6f0992c4-24a2-4bd4-8925-350c62904130 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2e0615bc70f4555b6b89a6ca10874b8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:41.626734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6f0992c4-24a2-4bd4-8925-350c62904130 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2e0615bc70f4555b6b89a6ca10874b8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:41.630354 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6f0992c4-24a2-4bd4-8925-350c62904130 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2e0615bc70f4555b6b89a6ca10874b8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:41.648035 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6f0992c4-24a2-4bd4-8925-350c62904130 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2e0615bc70f4555b6b89a6ca10874b8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:41.680706 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1113/2211] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:57:41 2022] DELETE /identity/v3/users/a2e0615bc70f4555b6b89a6ca10874b8 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 05:57:41.683012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b7334-6eec-4448-a2bb-bfbd9017c212 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:41.683493 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b7334-6eec-4448-a2bb-bfbd9017c212 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:41.684070 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b7334-6eec-4448-a2bb-bfbd9017c212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:41.731772 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-8c9b7334-6eec-4448-a2bb-bfbd9017c212 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:41.733025 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-8c9b7334-6eec-4448-a2bb-bfbd9017c212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:41.837674 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1099/2212] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:41.849777 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0992c4-24a2-4bd4-8925-350c62904130 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:41.851331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6f0992c4-24a2-4bd4-8925-350c62904130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:41.975793 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0992c4-24a2-4bd4-8925-350c62904130 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:41.980390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d181e3-6c7a-47c7-ab38-bf99ab4921f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:41.981665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d181e3-6c7a-47c7-ab38-bf99ab4921f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:41.981665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d181e3-6c7a-47c7-ab38-bf99ab4921f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:41.982319 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d181e3-6c7a-47c7-ab38-bf99ab4921f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:41.996218 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d181e3-6c7a-47c7-ab38-bf99ab4921f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:41.998467 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d181e3-6c7a-47c7-ab38-bf99ab4921f2 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:42.018503 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1114/2213] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:57:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:57:42.366880 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b7334-6eec-4448-a2bb-bfbd9017c212 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:42.370448 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-8c9b7334-6eec-4448-a2bb-bfbd9017c212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:42.391681 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b7334-6eec-4448-a2bb-bfbd9017c212 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:42.397714 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22add906-0677-4985-84b5-2c5207b691f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:42.398883 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22add906-0677-4985-84b5-2c5207b691f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:42.399172 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22add906-0677-4985-84b5-2c5207b691f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:42.399562 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22add906-0677-4985-84b5-2c5207b691f8 admin admin] PATH_INFO: `/v3/projects/fa049242a1c141ab9743d3ee44205f63` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:42.401089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22add906-0677-4985-84b5-2c5207b691f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa049242a1c141ab9743d3ee44205f63)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:42.403130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22add906-0677-4985-84b5-2c5207b691f8 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:42.464983 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-22add906-0677-4985-84b5-2c5207b691f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa049242a1c141ab9743d3ee44205f63', 'request_id': 'req-22add906-0677-4985-84b5-2c5207b691f8'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:42.478068 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-22add906-0677-4985-84b5-2c5207b691f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa049242a1c141ab9743d3ee44205f63', 'request_id': 'req-22add906-0677-4985-84b5-2c5207b691f8'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:42.486797 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-22add906-0677-4985-84b5-2c5207b691f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa049242a1c141ab9743d3ee44205f63', 'request_id': 'req-22add906-0677-4985-84b5-2c5207b691f8'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:42.502386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-22add906-0677-4985-84b5-2c5207b691f8 admin admin] The token cache is being invalidate because project fa049242a1c141ab9743d3ee44205f63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:57:42.503025 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-22add906-0677-4985-84b5-2c5207b691f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:42.503924 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-22add906-0677-4985-84b5-2c5207b691f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:42.505770 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1100/2214] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:57:42 2022] DELETE /identity/v3/projects/fa049242a1c141ab9743d3ee44205f63 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:42.509846 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d181e3-6c7a-47c7-ab38-bf99ab4921f2 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:42.520147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d181e3-6c7a-47c7-ab38-bf99ab4921f2 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:42.532766 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:42.584728 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a56ca7-4cbf-45da-a6a8-a7e9c818f5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:42.585622 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a56ca7-4cbf-45da-a6a8-a7e9c818f5ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:42.585986 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a56ca7-4cbf-45da-a6a8-a7e9c818f5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:42.586277 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a56ca7-4cbf-45da-a6a8-a7e9c818f5ba admin admin] PATH_INFO: `/v3/users/010473b4209040ba867e90afa8059f88` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:42.587546 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a56ca7-4cbf-45da-a6a8-a7e9c818f5ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=010473b4209040ba867e90afa8059f88)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:42.589572 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a56ca7-4cbf-45da-a6a8-a7e9c818f5ba admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:42.639525 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-10a56ca7-4cbf-45da-a6a8-a7e9c818f5ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '010473b4209040ba867e90afa8059f88'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:42.646831 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-10a56ca7-4cbf-45da-a6a8-a7e9c818f5ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '010473b4209040ba867e90afa8059f88'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:42.658909 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-10a56ca7-4cbf-45da-a6a8-a7e9c818f5ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '010473b4209040ba867e90afa8059f88'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:42.659817 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-10a56ca7-4cbf-45da-a6a8-a7e9c818f5ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '010473b4209040ba867e90afa8059f88'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:42.675543 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-10a56ca7-4cbf-45da-a6a8-a7e9c818f5ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '010473b4209040ba867e90afa8059f88'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:42.681888 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1115/2215] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:57:42 2022] DELETE /identity/v3/users/010473b4209040ba867e90afa8059f88 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:43.034744 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22add906-0677-4985-84b5-2c5207b691f8 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:43.037126 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-22add906-0677-4985-84b5-2c5207b691f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:43.057976 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22add906-0677-4985-84b5-2c5207b691f8 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:43.156329 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a56ca7-4cbf-45da-a6a8-a7e9c818f5ba admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:43.157887 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-10a56ca7-4cbf-45da-a6a8-a7e9c818f5ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:43.252560 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdfeb7f-c53d-4e63-83fe-2cc196e24f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:43.253954 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdfeb7f-c53d-4e63-83fe-2cc196e24f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:43.254800 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdfeb7f-c53d-4e63-83fe-2cc196e24f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:43.255339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdfeb7f-c53d-4e63-83fe-2cc196e24f12 admin admin] PATH_INFO: `/v3/projects/d4a90ee109f14ec1bf24ddc01d614d52` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:43.258534 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdfeb7f-c53d-4e63-83fe-2cc196e24f12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4a90ee109f14ec1bf24ddc01d614d52)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:43.261385 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdfeb7f-c53d-4e63-83fe-2cc196e24f12 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:43.270728 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:43.318630 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a56ca7-4cbf-45da-a6a8-a7e9c818f5ba admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:43.325259 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7e53a-de95-4eea-b473-d66d751f1593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:43.326213 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7e53a-de95-4eea-b473-d66d751f1593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:43.326491 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7e53a-de95-4eea-b473-d66d751f1593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:43.326787 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7e53a-de95-4eea-b473-d66d751f1593 admin admin] PATH_INFO: `/v3/users/06d55c041b454c93a15726ccfb7b3a9a` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:43.340633 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd7e53a-de95-4eea-b473-d66d751f1593 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06d55c041b454c93a15726ccfb7b3a9a)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:43.342836 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd7e53a-de95-4eea-b473-d66d751f1593 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:43.385752 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-2bdfeb7f-c53d-4e63-83fe-2cc196e24f12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4a90ee109f14ec1bf24ddc01d614d52', 'request_id': 'req-2bdfeb7f-c53d-4e63-83fe-2cc196e24f12'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:43.402991 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-2bdfeb7f-c53d-4e63-83fe-2cc196e24f12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4a90ee109f14ec1bf24ddc01d614d52', 'request_id': 'req-2bdfeb7f-c53d-4e63-83fe-2cc196e24f12'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:43.416892 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-2bdfeb7f-c53d-4e63-83fe-2cc196e24f12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4a90ee109f14ec1bf24ddc01d614d52', 'request_id': 'req-2bdfeb7f-c53d-4e63-83fe-2cc196e24f12'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:43.453927 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-2bdfeb7f-c53d-4e63-83fe-2cc196e24f12 admin admin] The token cache is being invalidate because project d4a90ee109f14ec1bf24ddc01d614d52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:57:43.454280 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-2bdfeb7f-c53d-4e63-83fe-2cc196e24f12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:43.456519 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-2bdfeb7f-c53d-4e63-83fe-2cc196e24f12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:43.459837 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1101/2216] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:57:43 2022] DELETE /identity/v3/projects/d4a90ee109f14ec1bf24ddc01d614d52 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:43.465600 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17badc23-54d2-4f67-b626-7f6d2c812dca None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:43.465891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17badc23-54d2-4f67-b626-7f6d2c812dca None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:43.466153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17badc23-54d2-4f67-b626-7f6d2c812dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:43.468003 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:43.504935 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dbd7e53a-de95-4eea-b473-d66d751f1593 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06d55c041b454c93a15726ccfb7b3a9a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:43.506738 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-17badc23-54d2-4f67-b626-7f6d2c812dca None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:43.508128 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-17badc23-54d2-4f67-b626-7f6d2c812dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:43.529586 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dbd7e53a-de95-4eea-b473-d66d751f1593 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06d55c041b454c93a15726ccfb7b3a9a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:43.542059 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dbd7e53a-de95-4eea-b473-d66d751f1593 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06d55c041b454c93a15726ccfb7b3a9a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:43.542906 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dbd7e53a-de95-4eea-b473-d66d751f1593 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06d55c041b454c93a15726ccfb7b3a9a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:43.576260 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dbd7e53a-de95-4eea-b473-d66d751f1593 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06d55c041b454c93a15726ccfb7b3a9a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:43.590467 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1116/2217] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:57:43 2022] DELETE /identity/v3/users/06d55c041b454c93a15726ccfb7b3a9a => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 05:57:43.595064 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d565ec1-4ef8-4be8-b56d-b34ceb6f1911 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:43.595399 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d565ec1-4ef8-4be8-b56d-b34ceb6f1911 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:43.595662 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d565ec1-4ef8-4be8-b56d-b34ceb6f1911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:43.628888 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1102/2218] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:43.643828 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeecd30-2253-42bd-b930-3d07d81e5ae5 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:43.643828 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeecd30-2253-42bd-b930-3d07d81e5ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:43.643828 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeecd30-2253-42bd-b930-3d07d81e5ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:43.655979 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9d565ec1-4ef8-4be8-b56d-b34ceb6f1911 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:43.657245 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9d565ec1-4ef8-4be8-b56d-b34ceb6f1911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:43.668160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-dfeecd30-2253-42bd-b930-3d07d81e5ae5 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:43.670262 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-dfeecd30-2253-42bd-b930-3d07d81e5ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:43.744561 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1117/2219] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:43.762630 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d565ec1-4ef8-4be8-b56d-b34ceb6f1911 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:43.765738 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9d565ec1-4ef8-4be8-b56d-b34ceb6f1911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:43.815226 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1103/2220] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:43.815481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeecd30-2253-42bd-b930-3d07d81e5ae5 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:43.828224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeecd30-2253-42bd-b930-3d07d81e5ae5 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:43.833976 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023dca2c-63fd-4f2f-b2a2-4eeeae732420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:43.843237 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023dca2c-63fd-4f2f-b2a2-4eeeae732420 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:43.843237 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023dca2c-63fd-4f2f-b2a2-4eeeae732420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:43.843237 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023dca2c-63fd-4f2f-b2a2-4eeeae732420 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:43.843237 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023dca2c-63fd-4f2f-b2a2-4eeeae732420 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:57:43.843237 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023dca2c-63fd-4f2f-b2a2-4eeeae732420 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:43.843237 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023dca2c-63fd-4f2f-b2a2-4eeeae732420 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:43.855068 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1104/2221] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:57:43.859125 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023dca2c-63fd-4f2f-b2a2-4eeeae732420 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:43.871444 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023dca2c-63fd-4f2f-b2a2-4eeeae732420 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:43.877574 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fe83e-904d-4c36-9339-d6416bcce733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:43.878349 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fe83e-904d-4c36-9339-d6416bcce733 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:43.878690 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fe83e-904d-4c36-9339-d6416bcce733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:43.879038 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fe83e-904d-4c36-9339-d6416bcce733 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:43.879861 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4fe83e-904d-4c36-9339-d6416bcce733 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:43.880732 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d565ec1-4ef8-4be8-b56d-b34ceb6f1911 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:43.882534 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4fe83e-904d-4c36-9339-d6416bcce733 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:43.885948 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0a1cf-1404-4892-9372-5ff66459da78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:43.886878 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0a1cf-1404-4892-9372-5ff66459da78 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:43.887455 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0a1cf-1404-4892-9372-5ff66459da78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:43.888039 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0a1cf-1404-4892-9372-5ff66459da78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:43.898370 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0a1cf-1404-4892-9372-5ff66459da78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:43.900111 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0a1cf-1404-4892-9372-5ff66459da78 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:43.908402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:43.915638 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1118/2222] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:57:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:57:43.923773 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1105/2223] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:57:43 2022] POST /identity/v3/projects => generated 369 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 05:57:43.927886 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0a1cf-1404-4892-9372-5ff66459da78 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:43.938291 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0a1cf-1404-4892-9372-5ff66459da78 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:43.996483 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:44.003668 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f820c-bd02-49a3-a557-bbc1675aeb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:44.004644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f820c-bd02-49a3-a557-bbc1675aeb50 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:44.004992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f820c-bd02-49a3-a557-bbc1675aeb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:44.005270 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f820c-bd02-49a3-a557-bbc1675aeb50 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:44.006630 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f820c-bd02-49a3-a557-bbc1675aeb50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:44.015209 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f820c-bd02-49a3-a557-bbc1675aeb50 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:44.078456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1119/2224] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:57:43 2022] POST /identity/v3/users => generated 285 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:57:44.082630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fe83e-904d-4c36-9339-d6416bcce733 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:44.094001 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fe83e-904d-4c36-9339-d6416bcce733 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:44.109904 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c70a7-1ca1-4204-a22d-53965cef5b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:44.111149 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c70a7-1ca1-4204-a22d-53965cef5b8c admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:44.111456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c70a7-1ca1-4204-a22d-53965cef5b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:44.111796 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c70a7-1ca1-4204-a22d-53965cef5b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:44.112608 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c70a7-1ca1-4204-a22d-53965cef5b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:44.114784 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c70a7-1ca1-4204-a22d-53965cef5b8c admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:44.155763 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1106/2225] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:57:44.159482 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f820c-bd02-49a3-a557-bbc1675aeb50 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:44.179544 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f820c-bd02-49a3-a557-bbc1675aeb50 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:44.188861 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6098a-bb14-4b05-8595-3b1f6e9522b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:44.189571 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6098a-bb14-4b05-8595-3b1f6e9522b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:44.189843 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6098a-bb14-4b05-8595-3b1f6e9522b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:44.190112 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6098a-bb14-4b05-8595-3b1f6e9522b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:44.190846 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6098a-bb14-4b05-8595-3b1f6e9522b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:44.192964 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6098a-bb14-4b05-8595-3b1f6e9522b6 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:44.203386 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1120/2226] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:57:44.208255 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c70a7-1ca1-4204-a22d-53965cef5b8c admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:44.232719 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c70a7-1ca1-4204-a22d-53965cef5b8c admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:44.240362 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7e368-ee39-4622-b75b-4cd4f2a2d77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:44.242435 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7e368-ee39-4622-b75b-4cd4f2a2d77f admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:44.243344 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7e368-ee39-4622-b75b-4cd4f2a2d77f admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:44.244016 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7e368-ee39-4622-b75b-4cd4f2a2d77f admin admin] PATH_INFO: `/v3/projects/0ffc172a91e4426a8e1bb834cc22c2a9/users/f7a40a8d456e40789c54950f7fb294c9/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:44.265640 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7e368-ee39-4622-b75b-4cd4f2a2d77f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ffc172a91e4426a8e1bb834cc22c2a9, user_id=f7a40a8d456e40789c54950f7fb294c9, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:44.268455 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7e368-ee39-4622-b75b-4cd4f2a2d77f admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:44.284912 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1107/2227] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:57:44 2022] PUT /identity/v3/projects/0ffc172a91e4426a8e1bb834cc22c2a9/users/f7a40a8d456e40789c54950f7fb294c9/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:44.295877 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fd7eb-ffa5-4d07-b9ed-83cf470c773a None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:44.296440 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fd7eb-ffa5-4d07-b9ed-83cf470c773a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:44.296863 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fd7eb-ffa5-4d07-b9ed-83cf470c773a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:44.333301 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7e368-ee39-4622-b75b-4cd4f2a2d77f admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:44.335065 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-44c7e368-ee39-4622-b75b-4cd4f2a2d77f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:44.339044 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-906fd7eb-ffa5-4d07-b9ed-83cf470c773a None None] MFA Rules not processed for user `f7a40a8d456e40789c54950f7fb294c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:44.340797 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-906fd7eb-ffa5-4d07-b9ed-83cf470c773a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:44.510177 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7e368-ee39-4622-b75b-4cd4f2a2d77f admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:44.516551 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1121/2228] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:44 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:44.518995 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1e4af-2f53-4c88-814b-17bab21d0960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:44.519701 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1e4af-2f53-4c88-814b-17bab21d0960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:44.520493 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1e4af-2f53-4c88-814b-17bab21d0960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:44.521083 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1e4af-2f53-4c88-814b-17bab21d0960 admin admin] PATH_INFO: `/v3/projects/3289ac0bb5d84f329ac926f4f4d87e3d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:44.527947 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1e4af-2f53-4c88-814b-17bab21d0960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3289ac0bb5d84f329ac926f4f4d87e3d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:44.529175 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fd7eb-ffa5-4d07-b9ed-83cf470c773a None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:44.530057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1e4af-2f53-4c88-814b-17bab21d0960 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:44.564625 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fd7eb-ffa5-4d07-b9ed-83cf470c773a None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:44.564625 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf81bc-8c7a-40a0-ab73-9c864d78f179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:44.564625 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf81bc-8c7a-40a0-ab73-9c864d78f179 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:44.564625 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf81bc-8c7a-40a0-ab73-9c864d78f179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:44.565039 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf81bc-8c7a-40a0-ab73-9c864d78f179 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:44.565039 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf81bc-8c7a-40a0-ab73-9c864d78f179 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:44.565569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf81bc-8c7a-40a0-ab73-9c864d78f179 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:44.604801 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1122/2229] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:57:44 2022] POST /identity/v3/projects => generated 367 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:57:44.608466 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf81bc-8c7a-40a0-ab73-9c864d78f179 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:44.616775 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4ad1e4af-2f53-4c88-814b-17bab21d0960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3289ac0bb5d84f329ac926f4f4d87e3d', 'request_id': 'req-4ad1e4af-2f53-4c88-814b-17bab21d0960'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:44.633976 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4ad1e4af-2f53-4c88-814b-17bab21d0960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3289ac0bb5d84f329ac926f4f4d87e3d', 'request_id': 'req-4ad1e4af-2f53-4c88-814b-17bab21d0960'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:44.644787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4ad1e4af-2f53-4c88-814b-17bab21d0960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3289ac0bb5d84f329ac926f4f4d87e3d', 'request_id': 'req-4ad1e4af-2f53-4c88-814b-17bab21d0960'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:44.657214 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4ad1e4af-2f53-4c88-814b-17bab21d0960 admin admin] The token cache is being invalidate because project 3289ac0bb5d84f329ac926f4f4d87e3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:57:44.657856 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4ad1e4af-2f53-4c88-814b-17bab21d0960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:44.658887 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4ad1e4af-2f53-4c88-814b-17bab21d0960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:44.662278 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1108/2230] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:57:44 2022] DELETE /identity/v3/projects/3289ac0bb5d84f329ac926f4f4d87e3d => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 05:57:44.667723 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f2e66-cb8f-44c7-ab7b-0584f68c0469 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:44.668023 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f2e66-cb8f-44c7-ab7b-0584f68c0469 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:44.668333 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f2e66-cb8f-44c7-ab7b-0584f68c0469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:44.688904 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf81bc-8c7a-40a0-ab73-9c864d78f179 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:44.694076 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b92396-8eae-4b69-b0f8-466592c3b9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:44.694617 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-ab9f2e66-cb8f-44c7-ab7b-0584f68c0469 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:44.694741 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b92396-8eae-4b69-b0f8-466592c3b9f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:44.695081 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b92396-8eae-4b69-b0f8-466592c3b9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:44.695396 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b92396-8eae-4b69-b0f8-466592c3b9f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:44.695957 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ab9f2e66-cb8f-44c7-ab7b-0584f68c0469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:44.696341 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b92396-8eae-4b69-b0f8-466592c3b9f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:44.698486 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b92396-8eae-4b69-b0f8-466592c3b9f8 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:44.714247 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1109/2231] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:57:44.727669 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864503a-4132-4632-a388-54b6964492ac None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:44.728012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864503a-4132-4632-a388-54b6964492ac None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:44.728214 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864503a-4132-4632-a388-54b6964492ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:44.731974 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1123/2232] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:57:44 2022] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 05:57:44.737854 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b92396-8eae-4b69-b0f8-466592c3b9f8 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:44.739954 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-91b92396-8eae-4b69-b0f8-466592c3b9f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:44.754544 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b92396-8eae-4b69-b0f8-466592c3b9f8 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:44.760418 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0136253-3e22-4d59-a67d-b5b203614b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:44.761274 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0136253-3e22-4d59-a67d-b5b203614b9d admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:44.761714 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0136253-3e22-4d59-a67d-b5b203614b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:44.762084 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d864503a-4132-4632-a388-54b6964492ac None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:44.762238 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0136253-3e22-4d59-a67d-b5b203614b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:44.763142 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0136253-3e22-4d59-a67d-b5b203614b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:44.763460 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d864503a-4132-4632-a388-54b6964492ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:44.764886 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0136253-3e22-4d59-a67d-b5b203614b9d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:44.778108 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1124/2233] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:57:44.780140 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1110/2234] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:44.781728 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0136253-3e22-4d59-a67d-b5b203614b9d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:44.787967 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864503a-4132-4632-a388-54b6964492ac None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:44.803319 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0136253-3e22-4d59-a67d-b5b203614b9d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:44.815485 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864503a-4132-4632-a388-54b6964492ac None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:44.819608 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280a96c-e2ef-41c4-b5b9-a2e32d03913e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:44.820417 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280a96c-e2ef-41c4-b5b9-a2e32d03913e admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:44.820720 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280a96c-e2ef-41c4-b5b9-a2e32d03913e admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:44.821064 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280a96c-e2ef-41c4-b5b9-a2e32d03913e admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:44.821935 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280a96c-e2ef-41c4-b5b9-a2e32d03913e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:57:44.822370 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280a96c-e2ef-41c4-b5b9-a2e32d03913e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:44.824111 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280a96c-e2ef-41c4-b5b9-a2e32d03913e admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:44.825229 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1553766-e044-409d-982f-32b5b0ec3309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:44.826604 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1553766-e044-409d-982f-32b5b0ec3309 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:44.826952 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1553766-e044-409d-982f-32b5b0ec3309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:44.827373 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1553766-e044-409d-982f-32b5b0ec3309 admin admin] PATH_INFO: `/v3/projects/b7d04b13319943e9be2fd947bcf8876f/users/1e24a8d4f027428e8e2ee34318e9d715/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:44.846786 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1553766-e044-409d-982f-32b5b0ec3309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7d04b13319943e9be2fd947bcf8876f, user_id=1e24a8d4f027428e8e2ee34318e9d715, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:44.849948 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1553766-e044-409d-982f-32b5b0ec3309 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:44.860930 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:44.862344 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1111/2235] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:57:44.863285 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280a96c-e2ef-41c4-b5b9-a2e32d03913e admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:44.867944 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1125/2236] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:57:44 2022] PUT /identity/v3/projects/b7d04b13319943e9be2fd947bcf8876f/users/1e24a8d4f027428e8e2ee34318e9d715/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:44.872784 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1553766-e044-409d-982f-32b5b0ec3309 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:44.880608 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280a96c-e2ef-41c4-b5b9-a2e32d03913e admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:44.966433 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:44.971108 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1553766-e044-409d-982f-32b5b0ec3309 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:44.976852 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e89ae-9b28-4b10-9904-068c85de1f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:44.977652 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e89ae-9b28-4b10-9904-068c85de1f54 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:44.977939 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e89ae-9b28-4b10-9904-068c85de1f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:44.978313 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e89ae-9b28-4b10-9904-068c85de1f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:44.979273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e89ae-9b28-4b10-9904-068c85de1f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:44.981001 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e89ae-9b28-4b10-9904-068c85de1f54 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:44.999846 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1126/2237] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 05:57:45.001130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e89ae-9b28-4b10-9904-068c85de1f54 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:45.013787 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e89ae-9b28-4b10-9904-068c85de1f54 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:45.018183 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4d1a9-668e-4e10-8e1d-500ffcb24c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:45.019126 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4d1a9-668e-4e10-8e1d-500ffcb24c2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:45.019490 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4d1a9-668e-4e10-8e1d-500ffcb24c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:45.020059 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4d1a9-668e-4e10-8e1d-500ffcb24c2b admin admin] PATH_INFO: `/v3/projects/b7d04b13319943e9be2fd947bcf8876f/users/1e24a8d4f027428e8e2ee34318e9d715/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:45.021992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212b3ad-2324-48bf-bcf7-1627bd859914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:45.022226 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4d1a9-668e-4e10-8e1d-500ffcb24c2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7d04b13319943e9be2fd947bcf8876f, user_id=1e24a8d4f027428e8e2ee34318e9d715, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:45.023472 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212b3ad-2324-48bf-bcf7-1627bd859914 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:45.024552 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212b3ad-2324-48bf-bcf7-1627bd859914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:45.024881 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212b3ad-2324-48bf-bcf7-1627bd859914 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:45.024995 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4d1a9-668e-4e10-8e1d-500ffcb24c2b admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:45.027206 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212b3ad-2324-48bf-bcf7-1627bd859914 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:45.031326 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212b3ad-2324-48bf-bcf7-1627bd859914 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:45.042686 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1127/2238] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:57:45 2022] PUT /identity/v3/projects/b7d04b13319943e9be2fd947bcf8876f/users/1e24a8d4f027428e8e2ee34318e9d715/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:45.055094 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341f153-2868-4034-b212-04fc0bfcd6f7 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:45.055094 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341f153-2868-4034-b212-04fc0bfcd6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:45.055094 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341f153-2868-4034-b212-04fc0bfcd6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:45.103364 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1112/2239] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:57:44 2022] POST /identity/v3/projects => generated 373 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:57:45.104865 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212b3ad-2324-48bf-bcf7-1627bd859914 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:45.120240 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-1341f153-2868-4034-b212-04fc0bfcd6f7 None None] MFA Rules not processed for user `1e24a8d4f027428e8e2ee34318e9d715`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:45.121998 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1341f153-2868-4034-b212-04fc0bfcd6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:45.201537 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1128/2240] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:45 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:57:45.210777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212b3ad-2324-48bf-bcf7-1627bd859914 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:45.214778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341f153-2868-4034-b212-04fc0bfcd6f7 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:45.216812 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3ebcf-6d81-4c16-a254-0230d5ce54ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:45.217129 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1341f153-2868-4034-b212-04fc0bfcd6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:45.217877 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3ebcf-6d81-4c16-a254-0230d5ce54ab admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:45.218239 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3ebcf-6d81-4c16-a254-0230d5ce54ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:45.218520 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3ebcf-6d81-4c16-a254-0230d5ce54ab admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:45.219377 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a3ebcf-6d81-4c16-a254-0230d5ce54ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:45.221509 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a3ebcf-6d81-4c16-a254-0230d5ce54ab admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:45.253327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1113/2241] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:57:45 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:57:45.257580 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3ebcf-6d81-4c16-a254-0230d5ce54ab admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:45.276336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3ebcf-6d81-4c16-a254-0230d5ce54ab admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:45.283098 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3e15b-532a-44a7-a646-5590d7e89b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:45.283876 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3e15b-532a-44a7-a646-5590d7e89b2b admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:45.284162 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3e15b-532a-44a7-a646-5590d7e89b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:45.284483 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3e15b-532a-44a7-a646-5590d7e89b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:45.285226 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3e15b-532a-44a7-a646-5590d7e89b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:45.287097 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3e15b-532a-44a7-a646-5590d7e89b2b admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:45.299096 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1114/2242] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 05:57:45.303336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3e15b-532a-44a7-a646-5590d7e89b2b admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:45.319203 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3e15b-532a-44a7-a646-5590d7e89b2b admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:45.323096 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341f153-2868-4034-b212-04fc0bfcd6f7 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:45.323992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f11de-7a74-4e60-ad0c-052e63f75c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:45.324889 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f11de-7a74-4e60-ad0c-052e63f75c18 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:45.325365 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f11de-7a74-4e60-ad0c-052e63f75c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:45.325870 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f11de-7a74-4e60-ad0c-052e63f75c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:45.326948 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f11de-7a74-4e60-ad0c-052e63f75c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:45.328840 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f11de-7a74-4e60-ad0c-052e63f75c18 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:45.334409 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2026d-1eec-47b7-8637-29d48ae7b4cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:45.335094 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2026d-1eec-47b7-8637-29d48ae7b4cc service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:45.335875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2026d-1eec-47b7-8637-29d48ae7b4cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:45.336157 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2026d-1eec-47b7-8637-29d48ae7b4cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:45.345063 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1115/2243] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 05:57:45.351245 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f11de-7a74-4e60-ad0c-052e63f75c18 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:45.371966 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa2026d-1eec-47b7-8637-29d48ae7b4cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:45.373354 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa2026d-1eec-47b7-8637-29d48ae7b4cc service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:45.381584 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f11de-7a74-4e60-ad0c-052e63f75c18 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:45.386690 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb7e49-b70b-42e3-9660-ef66f251f4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:45.387643 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb7e49-b70b-42e3-9660-ef66f251f4bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:45.387927 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb7e49-b70b-42e3-9660-ef66f251f4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:45.388203 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb7e49-b70b-42e3-9660-ef66f251f4bc admin admin] PATH_INFO: `/v3/projects/36e74f91cf99452a82119ecca3004230/users/578656e5025e45e3b2e4431ea6c91181/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:45.405164 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb7e49-b70b-42e3-9660-ef66f251f4bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=36e74f91cf99452a82119ecca3004230, user_id=578656e5025e45e3b2e4431ea6c91181, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:45.408008 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb7e49-b70b-42e3-9660-ef66f251f4bc admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:45.411612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1129/2244] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:57:45 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:57:45.451082 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1116/2245] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:57:45 2022] PUT /identity/v3/projects/36e74f91cf99452a82119ecca3004230/users/578656e5025e45e3b2e4431ea6c91181/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:45.464714 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e448cc8-c56d-4bf9-ab8c-8e55259be4ff None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:45.465414 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e448cc8-c56d-4bf9-ab8c-8e55259be4ff None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:45.465753 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e448cc8-c56d-4bf9-ab8c-8e55259be4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:45.508741 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:45.529723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-5e448cc8-c56d-4bf9-ab8c-8e55259be4ff None None] MFA Rules not processed for user `578656e5025e45e3b2e4431ea6c91181`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:45.531676 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5e448cc8-c56d-4bf9-ab8c-8e55259be4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:45.654624 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1130/2246] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:45.668402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb7e49-b70b-42e3-9660-ef66f251f4bc admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:45.797327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb7e49-b70b-42e3-9660-ef66f251f4bc admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:45.804574 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd214778-6627-48cb-9bd5-bcaaf4684d19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:45.805275 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd214778-6627-48cb-9bd5-bcaaf4684d19 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:45.805559 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd214778-6627-48cb-9bd5-bcaaf4684d19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:45.805836 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd214778-6627-48cb-9bd5-bcaaf4684d19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:45.820104 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd214778-6627-48cb-9bd5-bcaaf4684d19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:45.822196 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd214778-6627-48cb-9bd5-bcaaf4684d19 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:45.831054 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:45.842145 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1117/2247] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:57:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:57:47.541379 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e448cc8-c56d-4bf9-ab8c-8e55259be4ff None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:47.558727 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720280b-3a08-4cb3-ad83-fcccd184d229 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:47.559473 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720280b-3a08-4cb3-ad83-fcccd184d229 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:47.559740 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720280b-3a08-4cb3-ad83-fcccd184d229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:47.588221 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-7720280b-3a08-4cb3-ad83-fcccd184d229 None None] MFA Rules not processed for user `578656e5025e45e3b2e4431ea6c91181`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:47.591451 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-7720280b-3a08-4cb3-ad83-fcccd184d229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:47.611955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1118/2248] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:57:47.647764 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e448cc8-c56d-4bf9-ab8c-8e55259be4ff None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:47.653022 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc5256-7988-44f0-ad79-002e7b3d4dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:47.653968 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc5256-7988-44f0-ad79-002e7b3d4dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:47.654360 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc5256-7988-44f0-ad79-002e7b3d4dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:47.654713 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc5256-7988-44f0-ad79-002e7b3d4dcf admin admin] PATH_INFO: `/v3/users/f7a40a8d456e40789c54950f7fb294c9` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:47.656075 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc5256-7988-44f0-ad79-002e7b3d4dcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7a40a8d456e40789c54950f7fb294c9)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:47.666548 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc5256-7988-44f0-ad79-002e7b3d4dcf admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:47.757284 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0adc5256-7988-44f0-ad79-002e7b3d4dcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7a40a8d456e40789c54950f7fb294c9'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:47.791631 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0adc5256-7988-44f0-ad79-002e7b3d4dcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7a40a8d456e40789c54950f7fb294c9'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:47.812717 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0adc5256-7988-44f0-ad79-002e7b3d4dcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7a40a8d456e40789c54950f7fb294c9'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:47.813469 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0adc5256-7988-44f0-ad79-002e7b3d4dcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7a40a8d456e40789c54950f7fb294c9'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:47.837355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0adc5256-7988-44f0-ad79-002e7b3d4dcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7a40a8d456e40789c54950f7fb294c9'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:47.849168 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1131/2249] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:57:47 2022] DELETE /identity/v3/users/f7a40a8d456e40789c54950f7fb294c9 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:47.854461 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4595e2d-7b31-4664-aba2-a299c909b81e None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:47.854780 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4595e2d-7b31-4664-aba2-a299c909b81e None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:47.855032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4595e2d-7b31-4664-aba2-a299c909b81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:47.899339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-c4595e2d-7b31-4664-aba2-a299c909b81e None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:47.903254 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c4595e2d-7b31-4664-aba2-a299c909b81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:48.029478 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1119/2250] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:48.040830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc5256-7988-44f0-ad79-002e7b3d4dcf admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:48.043516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0adc5256-7988-44f0-ad79-002e7b3d4dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:48.077499 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:48.156952 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc5256-7988-44f0-ad79-002e7b3d4dcf admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:48.168665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fd4bd-e4a8-444e-9dd0-001c8e82a296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:48.169829 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fd4bd-e4a8-444e-9dd0-001c8e82a296 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:48.170268 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fd4bd-e4a8-444e-9dd0-001c8e82a296 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:48.170682 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fd4bd-e4a8-444e-9dd0-001c8e82a296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:48.185976 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163fd4bd-e4a8-444e-9dd0-001c8e82a296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:48.187565 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163fd4bd-e4a8-444e-9dd0-001c8e82a296 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:48.200804 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1132/2251] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:57:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:57:48.788894 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4595e2d-7b31-4664-aba2-a299c909b81e None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:48.792734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c4595e2d-7b31-4664-aba2-a299c909b81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:48.830783 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4595e2d-7b31-4664-aba2-a299c909b81e None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:48.839458 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1bac6-f567-40f5-9ccf-a68003760384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:48.840363 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1bac6-f567-40f5-9ccf-a68003760384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:48.840645 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1bac6-f567-40f5-9ccf-a68003760384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:48.841002 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1bac6-f567-40f5-9ccf-a68003760384 admin admin] PATH_INFO: `/v3/projects/0ffc172a91e4426a8e1bb834cc22c2a9` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:48.842220 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1bac6-f567-40f5-9ccf-a68003760384 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ffc172a91e4426a8e1bb834cc22c2a9)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:48.844298 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1bac6-f567-40f5-9ccf-a68003760384 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:48.901738 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c0a1bac6-f567-40f5-9ccf-a68003760384 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ffc172a91e4426a8e1bb834cc22c2a9', 'request_id': 'req-c0a1bac6-f567-40f5-9ccf-a68003760384'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:48.910221 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c0a1bac6-f567-40f5-9ccf-a68003760384 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ffc172a91e4426a8e1bb834cc22c2a9', 'request_id': 'req-c0a1bac6-f567-40f5-9ccf-a68003760384'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:48.916900 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c0a1bac6-f567-40f5-9ccf-a68003760384 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ffc172a91e4426a8e1bb834cc22c2a9', 'request_id': 'req-c0a1bac6-f567-40f5-9ccf-a68003760384'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:48.932225 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c0a1bac6-f567-40f5-9ccf-a68003760384 admin admin] The token cache is being invalidate because project 0ffc172a91e4426a8e1bb834cc22c2a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:57:48.932225 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c0a1bac6-f567-40f5-9ccf-a68003760384 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:48.932225 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-c0a1bac6-f567-40f5-9ccf-a68003760384 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:48.932836 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1120/2252] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:57:48 2022] DELETE /identity/v3/projects/0ffc172a91e4426a8e1bb834cc22c2a9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:48.936759 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fd4bd-e4a8-444e-9dd0-001c8e82a296 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:48.964914 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fd4bd-e4a8-444e-9dd0-001c8e82a296 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:49.042289 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e750c-43f5-4cc4-9038-9dd926549e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:49.043445 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e750c-43f5-4cc4-9038-9dd926549e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:49.043965 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e750c-43f5-4cc4-9038-9dd926549e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:49.044348 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e750c-43f5-4cc4-9038-9dd926549e1c admin admin] PATH_INFO: `/v3/users/1e24a8d4f027428e8e2ee34318e9d715` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:49.046163 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e750c-43f5-4cc4-9038-9dd926549e1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e24a8d4f027428e8e2ee34318e9d715)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:49.048544 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e750c-43f5-4cc4-9038-9dd926549e1c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:49.156076 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bd9e750c-43f5-4cc4-9038-9dd926549e1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e24a8d4f027428e8e2ee34318e9d715'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:49.165829 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bd9e750c-43f5-4cc4-9038-9dd926549e1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e24a8d4f027428e8e2ee34318e9d715'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:49.176683 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bd9e750c-43f5-4cc4-9038-9dd926549e1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e24a8d4f027428e8e2ee34318e9d715'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:49.177382 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bd9e750c-43f5-4cc4-9038-9dd926549e1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e24a8d4f027428e8e2ee34318e9d715'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:49.194232 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-bd9e750c-43f5-4cc4-9038-9dd926549e1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e24a8d4f027428e8e2ee34318e9d715'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:49.201965 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1133/2253] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:57:48 2022] DELETE /identity/v3/users/1e24a8d4f027428e8e2ee34318e9d715 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:49.707764 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1bac6-f567-40f5-9ccf-a68003760384 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:49.709205 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c0a1bac6-f567-40f5-9ccf-a68003760384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:49.729081 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1bac6-f567-40f5-9ccf-a68003760384 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:49.807361 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501603f-4b7b-4887-a810-6120b755a1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:49.808672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501603f-4b7b-4887-a810-6120b755a1d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:49.809669 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501603f-4b7b-4887-a810-6120b755a1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:49.810027 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501603f-4b7b-4887-a810-6120b755a1d7 admin admin] PATH_INFO: `/v3/projects/b7d04b13319943e9be2fd947bcf8876f` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:49.811405 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7501603f-4b7b-4887-a810-6120b755a1d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7d04b13319943e9be2fd947bcf8876f)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:49.813843 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7501603f-4b7b-4887-a810-6120b755a1d7 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:49.856395 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:49.914228 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7501603f-4b7b-4887-a810-6120b755a1d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7d04b13319943e9be2fd947bcf8876f', 'request_id': 'req-7501603f-4b7b-4887-a810-6120b755a1d7'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:49.928551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7501603f-4b7b-4887-a810-6120b755a1d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7d04b13319943e9be2fd947bcf8876f', 'request_id': 'req-7501603f-4b7b-4887-a810-6120b755a1d7'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:49.938130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7501603f-4b7b-4887-a810-6120b755a1d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7d04b13319943e9be2fd947bcf8876f', 'request_id': 'req-7501603f-4b7b-4887-a810-6120b755a1d7'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:49.976452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7501603f-4b7b-4887-a810-6120b755a1d7 admin admin] The token cache is being invalidate because project b7d04b13319943e9be2fd947bcf8876f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:57:49.976748 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7501603f-4b7b-4887-a810-6120b755a1d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:49.977410 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7501603f-4b7b-4887-a810-6120b755a1d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:49.979007 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1121/2254] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:57:49 2022] DELETE /identity/v3/projects/b7d04b13319943e9be2fd947bcf8876f => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:49.983908 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689af562-9464-4583-8235-243d470f4548 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:49.984457 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689af562-9464-4583-8235-243d470f4548 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:49.984457 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689af562-9464-4583-8235-243d470f4548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:50.014716 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-689af562-9464-4583-8235-243d470f4548 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:50.014716 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-689af562-9464-4583-8235-243d470f4548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:50.062535 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:50.105774 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1134/2255] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:57:50.111859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ea9e4-8760-4621-a0c8-1d40d67fb6a1 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:50.112150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ea9e4-8760-4621-a0c8-1d40d67fb6a1 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:50.112455 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ea9e4-8760-4621-a0c8-1d40d67fb6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:50.151574 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d05ea9e4-8760-4621-a0c8-1d40d67fb6a1 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:50.152867 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d05ea9e4-8760-4621-a0c8-1d40d67fb6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:50.164018 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1122/2256] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:50.168076 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689af562-9464-4583-8235-243d470f4548 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:50.179454 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689af562-9464-4583-8235-243d470f4548 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:50.184396 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18234c2-3b0a-4861-8948-00100c5cb0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:50.185060 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18234c2-3b0a-4861-8948-00100c5cb0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:50.185353 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18234c2-3b0a-4861-8948-00100c5cb0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:50.185616 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18234c2-3b0a-4861-8948-00100c5cb0c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:50.186340 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18234c2-3b0a-4861-8948-00100c5cb0c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:57:50.186698 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18234c2-3b0a-4861-8948-00100c5cb0c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:50.188397 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18234c2-3b0a-4861-8948-00100c5cb0c3 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:50.215348 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1135/2257] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:57:50.220244 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ea9e4-8760-4621-a0c8-1d40d67fb6a1 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:50.229781 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ea9e4-8760-4621-a0c8-1d40d67fb6a1 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:50.235502 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdaa1da-b443-4fc1-b6ca-43edfc38810d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:50.236250 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdaa1da-b443-4fc1-b6ca-43edfc38810d admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:50.236647 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdaa1da-b443-4fc1-b6ca-43edfc38810d admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:50.236959 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdaa1da-b443-4fc1-b6ca-43edfc38810d admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:50.237863 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdaa1da-b443-4fc1-b6ca-43edfc38810d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:50.240231 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdaa1da-b443-4fc1-b6ca-43edfc38810d admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:50.283240 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1123/2258] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:57:50 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:57:50.285330 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18234c2-3b0a-4861-8948-00100c5cb0c3 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:50.296192 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18234c2-3b0a-4861-8948-00100c5cb0c3 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:50.366655 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900f458-8e60-4b55-bbdb-c590648b9b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:50.367514 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900f458-8e60-4b55-bbdb-c590648b9b59 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:50.367833 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900f458-8e60-4b55-bbdb-c590648b9b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:50.368659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900f458-8e60-4b55-bbdb-c590648b9b59 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:50.369313 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900f458-8e60-4b55-bbdb-c590648b9b59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:50.386693 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900f458-8e60-4b55-bbdb-c590648b9b59 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:50.425656 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1136/2259] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:57:50 2022] POST /identity/v3/users => generated 291 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:57:50.429852 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdaa1da-b443-4fc1-b6ca-43edfc38810d admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:50.447774 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdaa1da-b443-4fc1-b6ca-43edfc38810d admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:50.452696 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5264a5-b48f-4ae9-bb0b-9112abf0053e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:50.453386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5264a5-b48f-4ae9-bb0b-9112abf0053e admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:50.453704 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5264a5-b48f-4ae9-bb0b-9112abf0053e admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:50.453986 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5264a5-b48f-4ae9-bb0b-9112abf0053e admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:50.454751 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5264a5-b48f-4ae9-bb0b-9112abf0053e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:50.456418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5264a5-b48f-4ae9-bb0b-9112abf0053e admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:50.471404 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1124/2260] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:57:50.472926 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900f458-8e60-4b55-bbdb-c590648b9b59 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:50.484631 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900f458-8e60-4b55-bbdb-c590648b9b59 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:50.491053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e5f69-2295-4cf5-b878-47f3e00a2d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:50.491768 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e5f69-2295-4cf5-b878-47f3e00a2d69 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:50.491996 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e5f69-2295-4cf5-b878-47f3e00a2d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:50.492326 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e5f69-2295-4cf5-b878-47f3e00a2d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:50.493020 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6e5f69-2295-4cf5-b878-47f3e00a2d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:50.494674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6e5f69-2295-4cf5-b878-47f3e00a2d69 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:50.506475 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1137/2261] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 05:57:50.510523 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5264a5-b48f-4ae9-bb0b-9112abf0053e admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:50.521198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5264a5-b48f-4ae9-bb0b-9112abf0053e admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:50.526828 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c99a0-edcf-435d-9059-30bd71786eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:50.528453 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c99a0-edcf-435d-9059-30bd71786eba admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:50.528737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c99a0-edcf-435d-9059-30bd71786eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:50.529126 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c99a0-edcf-435d-9059-30bd71786eba admin admin] PATH_INFO: `/v3/projects/2dcdd6d105014b0194c8a51a6be692dc/users/b7ed526d0a0a4519a91b400a55cf17bc/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:50.546528 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c99a0-edcf-435d-9059-30bd71786eba admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dcdd6d105014b0194c8a51a6be692dc, user_id=b7ed526d0a0a4519a91b400a55cf17bc, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:50.549341 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c99a0-edcf-435d-9059-30bd71786eba admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:50.563598 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1125/2262] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:57:50 2022] PUT /identity/v3/projects/2dcdd6d105014b0194c8a51a6be692dc/users/b7ed526d0a0a4519a91b400a55cf17bc/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:50.574723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37e7ca-58f7-4983-8175-1204e07d0930 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:50.575002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37e7ca-58f7-4983-8175-1204e07d0930 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:50.575315 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37e7ca-58f7-4983-8175-1204e07d0930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:50.601334 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-0f37e7ca-58f7-4983-8175-1204e07d0930 None None] MFA Rules not processed for user `b7ed526d0a0a4519a91b400a55cf17bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:50.602471 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0f37e7ca-58f7-4983-8175-1204e07d0930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:50.668761 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1138/2263] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:57:50.673180 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c99a0-edcf-435d-9059-30bd71786eba admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:50.744774 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c99a0-edcf-435d-9059-30bd71786eba admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:50.749684 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76257b-99b1-43ca-a0dc-6a81851f865e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:50.750353 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76257b-99b1-43ca-a0dc-6a81851f865e admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:50.750689 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76257b-99b1-43ca-a0dc-6a81851f865e admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:50.750968 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76257b-99b1-43ca-a0dc-6a81851f865e admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:50.751705 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76257b-99b1-43ca-a0dc-6a81851f865e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:50.753890 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76257b-99b1-43ca-a0dc-6a81851f865e admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:50.782560 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1126/2264] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:57:50 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 05:57:50.786695 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37e7ca-58f7-4983-8175-1204e07d0930 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:50.797231 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37e7ca-58f7-4983-8175-1204e07d0930 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:50.836479 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:50.863514 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45282465-8024-43e4-87d1-9c4a5f7d477d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:50.863514 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45282465-8024-43e4-87d1-9c4a5f7d477d admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:50.863868 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45282465-8024-43e4-87d1-9c4a5f7d477d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:50.864185 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45282465-8024-43e4-87d1-9c4a5f7d477d admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:50.865014 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45282465-8024-43e4-87d1-9c4a5f7d477d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:50.867040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45282465-8024-43e4-87d1-9c4a5f7d477d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:50.889851 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1139/2265] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:57:50 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:57:50.894223 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76257b-99b1-43ca-a0dc-6a81851f865e admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:50.905793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76257b-99b1-43ca-a0dc-6a81851f865e admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:50.910499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413aab1-75a1-4d54-b03b-087bb3c59bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:50.911172 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413aab1-75a1-4d54-b03b-087bb3c59bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:50.911486 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413aab1-75a1-4d54-b03b-087bb3c59bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:50.911765 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413aab1-75a1-4d54-b03b-087bb3c59bb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:50.912500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413aab1-75a1-4d54-b03b-087bb3c59bb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:50.914130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413aab1-75a1-4d54-b03b-087bb3c59bb2 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:50.926836 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1127/2266] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:57:50.931033 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45282465-8024-43e4-87d1-9c4a5f7d477d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:50.942292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45282465-8024-43e4-87d1-9c4a5f7d477d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:50.947990 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a736b5-962a-46bf-867a-4aa26e0d9a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:50.948885 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a736b5-962a-46bf-867a-4aa26e0d9a93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:50.949220 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a736b5-962a-46bf-867a-4aa26e0d9a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:50.949490 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a736b5-962a-46bf-867a-4aa26e0d9a93 admin admin] PATH_INFO: `/v3/projects/11997475fdbb4aa1b56149501c61bb13/users/27115dc2b8774f07984a2eaafb6538e8/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:50.964390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a736b5-962a-46bf-867a-4aa26e0d9a93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11997475fdbb4aa1b56149501c61bb13, user_id=27115dc2b8774f07984a2eaafb6538e8, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:50.967055 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a736b5-962a-46bf-867a-4aa26e0d9a93 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:50.986168 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1140/2267] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:57:50 2022] PUT /identity/v3/projects/11997475fdbb4aa1b56149501c61bb13/users/27115dc2b8774f07984a2eaafb6538e8/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:50.991349 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413aab1-75a1-4d54-b03b-087bb3c59bb2 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:51.007407 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413aab1-75a1-4d54-b03b-087bb3c59bb2 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:51.043429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:51.120433 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c069475-a29a-4700-840a-743d39840305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:51.121385 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c069475-a29a-4700-840a-743d39840305 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:51.121670 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c069475-a29a-4700-840a-743d39840305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:51.121983 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c069475-a29a-4700-840a-743d39840305 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:51.122714 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c069475-a29a-4700-840a-743d39840305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:51.124387 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c069475-a29a-4700-840a-743d39840305 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:51.139943 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1128/2268] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 05:57:51.144376 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a736b5-962a-46bf-867a-4aa26e0d9a93 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:51.156624 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a736b5-962a-46bf-867a-4aa26e0d9a93 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:51.161630 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c814ef33-d7b4-494b-9970-243b5379dbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:51.162516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814ef33-d7b4-494b-9970-243b5379dbc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:51.162792 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814ef33-d7b4-494b-9970-243b5379dbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:51.163078 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814ef33-d7b4-494b-9970-243b5379dbc8 admin admin] PATH_INFO: `/v3/projects/11997475fdbb4aa1b56149501c61bb13/users/27115dc2b8774f07984a2eaafb6538e8/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:51.165281 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c814ef33-d7b4-494b-9970-243b5379dbc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11997475fdbb4aa1b56149501c61bb13, user_id=27115dc2b8774f07984a2eaafb6538e8, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:51.167957 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c814ef33-d7b4-494b-9970-243b5379dbc8 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:51.188188 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1141/2269] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:57:51 2022] PUT /identity/v3/projects/11997475fdbb4aa1b56149501c61bb13/users/27115dc2b8774f07984a2eaafb6538e8/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:51.189713 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f22d12-58ba-4b24-b91f-dbef61a3630a None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:51.190136 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f22d12-58ba-4b24-b91f-dbef61a3630a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:51.190421 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f22d12-58ba-4b24-b91f-dbef61a3630a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:51.219262 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-90f22d12-58ba-4b24-b91f-dbef61a3630a None None] MFA Rules not processed for user `27115dc2b8774f07984a2eaafb6538e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:51.220611 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-90f22d12-58ba-4b24-b91f-dbef61a3630a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:51.307221 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1129/2270] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:51.314573 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c814ef33-d7b4-494b-9970-243b5379dbc8 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:51.316354 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c814ef33-d7b4-494b-9970-243b5379dbc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:51.325223 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f22d12-58ba-4b24-b91f-dbef61a3630a None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:51.326835 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-90f22d12-58ba-4b24-b91f-dbef61a3630a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:51.413487 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c814ef33-d7b4-494b-9970-243b5379dbc8 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:51.414378 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f22d12-58ba-4b24-b91f-dbef61a3630a None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:51.418941 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99440f-3c34-4c54-b137-0745afbc999c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:51.419391 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581c1e0-07e8-4b22-8919-948909bfb0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:51.419640 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99440f-3c34-4c54-b137-0745afbc999c service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:51.419924 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99440f-3c34-4c54-b137-0745afbc999c service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:51.420200 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99440f-3c34-4c54-b137-0745afbc999c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:51.420689 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581c1e0-07e8-4b22-8919-948909bfb0d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:51.421778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581c1e0-07e8-4b22-8919-948909bfb0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:51.421778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581c1e0-07e8-4b22-8919-948909bfb0d4 admin admin] PATH_INFO: `/v3/users/f7a2d6212ee8450fbc6a5bf19753c3e8` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:51.422735 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581c1e0-07e8-4b22-8919-948909bfb0d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7a2d6212ee8450fbc6a5bf19753c3e8)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:51.425597 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581c1e0-07e8-4b22-8919-948909bfb0d4 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:51.431162 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99440f-3c34-4c54-b137-0745afbc999c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:51.432652 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99440f-3c34-4c54-b137-0745afbc999c service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:51.455583 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1130/2271] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:57:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:57:51.505304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1581c1e0-07e8-4b22-8919-948909bfb0d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7a2d6212ee8450fbc6a5bf19753c3e8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:51.516482 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1581c1e0-07e8-4b22-8919-948909bfb0d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7a2d6212ee8450fbc6a5bf19753c3e8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:51.552015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1581c1e0-07e8-4b22-8919-948909bfb0d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7a2d6212ee8450fbc6a5bf19753c3e8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:51.553006 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1581c1e0-07e8-4b22-8919-948909bfb0d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7a2d6212ee8450fbc6a5bf19753c3e8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:51.572455 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1581c1e0-07e8-4b22-8919-948909bfb0d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7a2d6212ee8450fbc6a5bf19753c3e8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:51.588164 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1142/2272] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:57:51 2022] DELETE /identity/v3/users/f7a2d6212ee8450fbc6a5bf19753c3e8 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:51.593006 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911a34e-c509-4594-a0c9-06c45ba9c20f None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:51.593335 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911a34e-c509-4594-a0c9-06c45ba9c20f None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:51.593686 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911a34e-c509-4594-a0c9-06c45ba9c20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:51.647683 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-9911a34e-c509-4594-a0c9-06c45ba9c20f None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:51.651001 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9911a34e-c509-4594-a0c9-06c45ba9c20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:51.727620 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:51.788116 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1131/2273] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:57:51.800565 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581c1e0-07e8-4b22-8919-948909bfb0d4 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:51.802749 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1581c1e0-07e8-4b22-8919-948909bfb0d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:51.819814 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:51.951940 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581c1e0-07e8-4b22-8919-948909bfb0d4 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:51.956769 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902aabe-ea7a-447a-b0cb-8243d382e286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:51.957828 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902aabe-ea7a-447a-b0cb-8243d382e286 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:51.958219 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902aabe-ea7a-447a-b0cb-8243d382e286 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:51.958597 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902aabe-ea7a-447a-b0cb-8243d382e286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:51.979808 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902aabe-ea7a-447a-b0cb-8243d382e286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:51.981241 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902aabe-ea7a-447a-b0cb-8243d382e286 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:51.992915 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1143/2274] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:57:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:57:52.044850 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911a34e-c509-4594-a0c9-06c45ba9c20f None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:52.046522 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9911a34e-c509-4594-a0c9-06c45ba9c20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:52.132992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911a34e-c509-4594-a0c9-06c45ba9c20f None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:52.138088 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c850fa-b130-499b-9bf0-4076f915e371 tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27115dc2b8774f07984a2eaafb6538e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11997475fdbb4aa1b56149501c61bb13', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:52.138943 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c850fa-b130-499b-9bf0-4076f915e371 tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:52.139379 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c850fa-b130-499b-9bf0-4076f915e371 tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:52.139888 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c850fa-b130-499b-9bf0-4076f915e371 tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:52.140701 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c850fa-b130-499b-9bf0-4076f915e371 tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:57:52.141259 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c850fa-b130-499b-9bf0-4076f915e371 tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:52.142995 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c850fa-b130-499b-9bf0-4076f915e371 tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:52.156740 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1132/2275] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:57:52.161459 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902aabe-ea7a-447a-b0cb-8243d382e286 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:52.172791 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902aabe-ea7a-447a-b0cb-8243d382e286 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:52.181937 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94baa8cf-6a4c-49c6-9101-d31f026d4dd4 tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27115dc2b8774f07984a2eaafb6538e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11997475fdbb4aa1b56149501c61bb13', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:52.182685 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94baa8cf-6a4c-49c6-9101-d31f026d4dd4 tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:52.183036 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94baa8cf-6a4c-49c6-9101-d31f026d4dd4 tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:52.183412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94baa8cf-6a4c-49c6-9101-d31f026d4dd4 tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:52.184185 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94baa8cf-6a4c-49c6-9101-d31f026d4dd4 tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:52.186168 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94baa8cf-6a4c-49c6-9101-d31f026d4dd4 tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:52.220442 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1144/2276] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:57:52 2022] POST /identity/v3/projects => generated 353 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 05:57:52.221920 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c850fa-b130-499b-9bf0-4076f915e371 tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:52.233819 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c850fa-b130-499b-9bf0-4076f915e371 tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:52.338778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ea81a-e512-41a2-a8c9-924775f8cebf tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27115dc2b8774f07984a2eaafb6538e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11997475fdbb4aa1b56149501c61bb13', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:52.340073 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ea81a-e512-41a2-a8c9-924775f8cebf tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:52.340312 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ea81a-e512-41a2-a8c9-924775f8cebf tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:52.340588 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ea81a-e512-41a2-a8c9-924775f8cebf tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:52.341348 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ea81a-e512-41a2-a8c9-924775f8cebf tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:57:52.341763 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ea81a-e512-41a2-a8c9-924775f8cebf tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:52.343688 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ea81a-e512-41a2-a8c9-924775f8cebf tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:52.363255 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1133/2277] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:57:52.401472 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94baa8cf-6a4c-49c6-9101-d31f026d4dd4 tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:52.412528 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94baa8cf-6a4c-49c6-9101-d31f026d4dd4 tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:52.418123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9aa09-7c85-48fb-ab84-260b843f9cd7 tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27115dc2b8774f07984a2eaafb6538e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11997475fdbb4aa1b56149501c61bb13', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:52.419856 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9aa09-7c85-48fb-ab84-260b843f9cd7 tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:52.420155 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9aa09-7c85-48fb-ab84-260b843f9cd7 tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:52.420428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9aa09-7c85-48fb-ab84-260b843f9cd7 tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] PATH_INFO: `/v3/projects/2c4daa4e6a844e548ea7ba6d433b5b95` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:52.422219 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9aa09-7c85-48fb-ab84-260b843f9cd7 tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2c4daa4e6a844e548ea7ba6d433b5b95)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:52.424064 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9aa09-7c85-48fb-ab84-260b843f9cd7 tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:52.490525 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e2a9aa09-7c85-48fb-ab84-260b843f9cd7 tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c4daa4e6a844e548ea7ba6d433b5b95', 'request_id': 'req-e2a9aa09-7c85-48fb-ab84-260b843f9cd7'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:52.503731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ea81a-e512-41a2-a8c9-924775f8cebf tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:52.506370 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-446ea81a-e512-41a2-a8c9-924775f8cebf tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:52.513057 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e2a9aa09-7c85-48fb-ab84-260b843f9cd7 tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c4daa4e6a844e548ea7ba6d433b5b95', 'request_id': 'req-e2a9aa09-7c85-48fb-ab84-260b843f9cd7'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:52.527427 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e2a9aa09-7c85-48fb-ab84-260b843f9cd7 tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c4daa4e6a844e548ea7ba6d433b5b95', 'request_id': 'req-e2a9aa09-7c85-48fb-ab84-260b843f9cd7'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:52.553987 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e2a9aa09-7c85-48fb-ab84-260b843f9cd7 tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] The token cache is being invalidate because project 2c4daa4e6a844e548ea7ba6d433b5b95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:57:52.553987 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e2a9aa09-7c85-48fb-ab84-260b843f9cd7 tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:52.554679 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e2a9aa09-7c85-48fb-ab84-260b843f9cd7 tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:52.566399 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1145/2278] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:57:52 2022] DELETE /identity/v3/projects/2c4daa4e6a844e548ea7ba6d433b5b95 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:52.639813 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ea81a-e512-41a2-a8c9-924775f8cebf tempest-VolumeQuotaClassesTest-2147214151 tempest-VolumeQuotaClassesTest-2147214151-project-admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:52.664077 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:52.747535 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71387744-3d1c-4ba2-aca8-e1e5632ec8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:52.748215 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71387744-3d1c-4ba2-aca8-e1e5632ec8f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:52.748536 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71387744-3d1c-4ba2-aca8-e1e5632ec8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:52.748818 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71387744-3d1c-4ba2-aca8-e1e5632ec8f8 admin admin] PATH_INFO: `/v3/projects/5f96992e27b04e1581b1e8946973e021` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:52.750996 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71387744-3d1c-4ba2-aca8-e1e5632ec8f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f96992e27b04e1581b1e8946973e021)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:52.761916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71387744-3d1c-4ba2-aca8-e1e5632ec8f8 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:52.860851 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-71387744-3d1c-4ba2-aca8-e1e5632ec8f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f96992e27b04e1581b1e8946973e021', 'request_id': 'req-71387744-3d1c-4ba2-aca8-e1e5632ec8f8'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:52.872939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-71387744-3d1c-4ba2-aca8-e1e5632ec8f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f96992e27b04e1581b1e8946973e021', 'request_id': 'req-71387744-3d1c-4ba2-aca8-e1e5632ec8f8'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:52.884996 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-71387744-3d1c-4ba2-aca8-e1e5632ec8f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f96992e27b04e1581b1e8946973e021', 'request_id': 'req-71387744-3d1c-4ba2-aca8-e1e5632ec8f8'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:52.906407 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-71387744-3d1c-4ba2-aca8-e1e5632ec8f8 admin admin] The token cache is being invalidate because project 5f96992e27b04e1581b1e8946973e021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:57:52.906902 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-71387744-3d1c-4ba2-aca8-e1e5632ec8f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:52.907561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-71387744-3d1c-4ba2-aca8-e1e5632ec8f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:52.910475 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1134/2279] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:57:52 2022] DELETE /identity/v3/projects/5f96992e27b04e1581b1e8946973e021 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 05:57:52.914997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10dfd3-c0c2-4938-93e7-9ab6e0b630e0 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:52.915924 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10dfd3-c0c2-4938-93e7-9ab6e0b630e0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:52.916213 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10dfd3-c0c2-4938-93e7-9ab6e0b630e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:52.938527 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71387744-3d1c-4ba2-aca8-e1e5632ec8f8 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:52.940401 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-71387744-3d1c-4ba2-aca8-e1e5632ec8f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:52.987583 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-fb10dfd3-c0c2-4938-93e7-9ab6e0b630e0 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:52.991252 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fb10dfd3-c0c2-4938-93e7-9ab6e0b630e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:53.039728 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71387744-3d1c-4ba2-aca8-e1e5632ec8f8 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:53.045631 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80373a52-7746-4d93-907c-d2f6f8df4cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:53.047266 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80373a52-7746-4d93-907c-d2f6f8df4cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:53.047625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80373a52-7746-4d93-907c-d2f6f8df4cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:53.048102 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80373a52-7746-4d93-907c-d2f6f8df4cd3 admin admin] PATH_INFO: `/v3/users/b7ed526d0a0a4519a91b400a55cf17bc` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:53.050515 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80373a52-7746-4d93-907c-d2f6f8df4cd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7ed526d0a0a4519a91b400a55cf17bc)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:53.053086 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80373a52-7746-4d93-907c-d2f6f8df4cd3 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:53.154687 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-80373a52-7746-4d93-907c-d2f6f8df4cd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7ed526d0a0a4519a91b400a55cf17bc'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:53.155479 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-80373a52-7746-4d93-907c-d2f6f8df4cd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7ed526d0a0a4519a91b400a55cf17bc'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:53.159483 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1146/2280] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:53.161444 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18adc30-a9b9-461e-99fa-b00794d14371 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:53.161869 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:53.162039 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18adc30-a9b9-461e-99fa-b00794d14371 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:53.162387 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18adc30-a9b9-461e-99fa-b00794d14371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:53.175345 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-80373a52-7746-4d93-907c-d2f6f8df4cd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7ed526d0a0a4519a91b400a55cf17bc'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:53.175970 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-80373a52-7746-4d93-907c-d2f6f8df4cd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7ed526d0a0a4519a91b400a55cf17bc'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:53.183062 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-e18adc30-a9b9-461e-99fa-b00794d14371 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:53.184542 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e18adc30-a9b9-461e-99fa-b00794d14371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:53.211354 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1147/2281] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:53.214029 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-80373a52-7746-4d93-907c-d2f6f8df4cd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7ed526d0a0a4519a91b400a55cf17bc'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:53.214195 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18adc30-a9b9-461e-99fa-b00794d14371 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:53.225395 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:53.231637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18adc30-a9b9-461e-99fa-b00794d14371 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:53.235797 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1135/2282] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:57:52 2022] DELETE /identity/v3/users/b7ed526d0a0a4519a91b400a55cf17bc => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:53.238238 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181d5c9-c5b4-475b-803e-8fd1d9eaad24 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:53.239267 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181d5c9-c5b4-475b-803e-8fd1d9eaad24 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:53.239690 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181d5c9-c5b4-475b-803e-8fd1d9eaad24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:53.266538 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-4181d5c9-c5b4-475b-803e-8fd1d9eaad24 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:53.268352 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-4181d5c9-c5b4-475b-803e-8fd1d9eaad24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:53.341686 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0721a9-25d1-4247-b0fb-684a0f1d26db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:53.342856 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0721a9-25d1-4247-b0fb-684a0f1d26db admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:53.343453 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0721a9-25d1-4247-b0fb-684a0f1d26db admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:53.344251 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0721a9-25d1-4247-b0fb-684a0f1d26db admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:53.345973 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0721a9-25d1-4247-b0fb-684a0f1d26db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:57:53.346358 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0721a9-25d1-4247-b0fb-684a0f1d26db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:53.349261 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0721a9-25d1-4247-b0fb-684a0f1d26db admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:53.372445 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1136/2283] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:53.381716 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1148/2284] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:57:53.383361 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181d5c9-c5b4-475b-803e-8fd1d9eaad24 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:53.384934 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-4181d5c9-c5b4-475b-803e-8fd1d9eaad24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:53.387035 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0721a9-25d1-4247-b0fb-684a0f1d26db admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:53.397592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0721a9-25d1-4247-b0fb-684a0f1d26db admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:53.403143 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494b877-43a8-444a-8a1b-89daaa7dd09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:53.405015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494b877-43a8-444a-8a1b-89daaa7dd09c admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:53.406034 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494b877-43a8-444a-8a1b-89daaa7dd09c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:53.409451 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494b877-43a8-444a-8a1b-89daaa7dd09c admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:53.409750 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5494b877-43a8-444a-8a1b-89daaa7dd09c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:53.412740 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5494b877-43a8-444a-8a1b-89daaa7dd09c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:53.445241 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1149/2285] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:57:53 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:57:53.449236 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494b877-43a8-444a-8a1b-89daaa7dd09c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:53.456636 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181d5c9-c5b4-475b-803e-8fd1d9eaad24 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:53.519141 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a12c3-d6a0-4be0-97fa-d944b96b7a17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:53.519952 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a12c3-d6a0-4be0-97fa-d944b96b7a17 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:53.520259 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a12c3-d6a0-4be0-97fa-d944b96b7a17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:53.520497 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a12c3-d6a0-4be0-97fa-d944b96b7a17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:53.526704 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494b877-43a8-444a-8a1b-89daaa7dd09c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:53.547623 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b9f03-37c0-4483-afd3-b1819bb09e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:53.547798 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a12c3-d6a0-4be0-97fa-d944b96b7a17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:53.548812 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b9f03-37c0-4483-afd3-b1819bb09e34 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:53.549284 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b9f03-37c0-4483-afd3-b1819bb09e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:53.549798 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b9f03-37c0-4483-afd3-b1819bb09e34 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:53.550806 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b9f03-37c0-4483-afd3-b1819bb09e34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:53.554207 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b9f03-37c0-4483-afd3-b1819bb09e34 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:53.560467 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a12c3-d6a0-4be0-97fa-d944b96b7a17 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:53.585516 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1137/2286] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:57:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 05:57:53.587226 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1150/2287] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:57:53 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:57:53.591114 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a12c3-d6a0-4be0-97fa-d944b96b7a17 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:53.602585 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a12c3-d6a0-4be0-97fa-d944b96b7a17 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:53.608599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63ab46-41c8-41c6-b15a-a027dbf10542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:53.609555 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63ab46-41c8-41c6-b15a-a027dbf10542 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:53.610270 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63ab46-41c8-41c6-b15a-a027dbf10542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:53.610637 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63ab46-41c8-41c6-b15a-a027dbf10542 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:53.611955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63ab46-41c8-41c6-b15a-a027dbf10542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:53.613497 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63ab46-41c8-41c6-b15a-a027dbf10542 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:53.633900 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1138/2288] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:57:53.634430 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b9f03-37c0-4483-afd3-b1819bb09e34 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:53.647241 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b9f03-37c0-4483-afd3-b1819bb09e34 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:53.652477 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1645498-e7da-4fb2-98a3-16362a18a55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:53.653461 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1645498-e7da-4fb2-98a3-16362a18a55d admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:53.653940 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1645498-e7da-4fb2-98a3-16362a18a55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:53.654214 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1645498-e7da-4fb2-98a3-16362a18a55d admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:53.654952 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1645498-e7da-4fb2-98a3-16362a18a55d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:53.656643 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1645498-e7da-4fb2-98a3-16362a18a55d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:53.671614 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1151/2289] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:57:53.675351 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63ab46-41c8-41c6-b15a-a027dbf10542 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:53.690432 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63ab46-41c8-41c6-b15a-a027dbf10542 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:53.696778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603b50f-f853-4295-bcd1-d84fbfe487fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:53.697690 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603b50f-f853-4295-bcd1-d84fbfe487fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:53.697972 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603b50f-f853-4295-bcd1-d84fbfe487fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:53.698298 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603b50f-f853-4295-bcd1-d84fbfe487fe admin admin] PATH_INFO: `/v3/projects/bae9ff3418f34cdc9ab33323ef92e09b/users/e89c079feccd49618b4ae1b779ba04fa/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:53.716402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:53.720220 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603b50f-f853-4295-bcd1-d84fbfe487fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=bae9ff3418f34cdc9ab33323ef92e09b, user_id=e89c079feccd49618b4ae1b779ba04fa, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:53.723110 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603b50f-f853-4295-bcd1-d84fbfe487fe admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:53.745167 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1139/2290] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:57:53 2022] PUT /identity/v3/projects/bae9ff3418f34cdc9ab33323ef92e09b/users/e89c079feccd49618b4ae1b779ba04fa/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:53.747285 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59667529-f6e4-4603-befc-9b357eb30604 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:53.748717 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59667529-f6e4-4603-befc-9b357eb30604 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:53.749072 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59667529-f6e4-4603-befc-9b357eb30604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:53.772898 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-59667529-f6e4-4603-befc-9b357eb30604 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:53.774124 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-59667529-f6e4-4603-befc-9b357eb30604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:53.860129 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:53.875558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1152/2291] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:53.885690 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603b50f-f853-4295-bcd1-d84fbfe487fe admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:53.887770 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-5603b50f-f853-4295-bcd1-d84fbfe487fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:53.963079 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603b50f-f853-4295-bcd1-d84fbfe487fe admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:53.967242 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf401ae2-d444-4fbd-a5c0-5fb5675301e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:53.967961 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf401ae2-d444-4fbd-a5c0-5fb5675301e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:53.968243 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf401ae2-d444-4fbd-a5c0-5fb5675301e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:53.968520 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf401ae2-d444-4fbd-a5c0-5fb5675301e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:53.980077 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf401ae2-d444-4fbd-a5c0-5fb5675301e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:53.981739 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf401ae2-d444-4fbd-a5c0-5fb5675301e7 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:53.994349 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1140/2292] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:57:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:57:54.203147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59667529-f6e4-4603-befc-9b357eb30604 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:54.204834 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-59667529-f6e4-4603-befc-9b357eb30604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:54.230350 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59667529-f6e4-4603-befc-9b357eb30604 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:54.247467 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb9e14-19ed-498a-a6df-2e764bb0c347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:54.259273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb9e14-19ed-498a-a6df-2e764bb0c347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:54.259564 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb9e14-19ed-498a-a6df-2e764bb0c347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:54.259844 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb9e14-19ed-498a-a6df-2e764bb0c347 admin admin] PATH_INFO: `/v3/projects/2dcdd6d105014b0194c8a51a6be692dc` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:54.263562 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb9e14-19ed-498a-a6df-2e764bb0c347 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dcdd6d105014b0194c8a51a6be692dc)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:54.268154 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb9e14-19ed-498a-a6df-2e764bb0c347 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:54.377565 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-7fbb9e14-19ed-498a-a6df-2e764bb0c347 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dcdd6d105014b0194c8a51a6be692dc', 'request_id': 'req-7fbb9e14-19ed-498a-a6df-2e764bb0c347'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:54.406127 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-7fbb9e14-19ed-498a-a6df-2e764bb0c347 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dcdd6d105014b0194c8a51a6be692dc', 'request_id': 'req-7fbb9e14-19ed-498a-a6df-2e764bb0c347'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:54.421277 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-7fbb9e14-19ed-498a-a6df-2e764bb0c347 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dcdd6d105014b0194c8a51a6be692dc', 'request_id': 'req-7fbb9e14-19ed-498a-a6df-2e764bb0c347'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:54.440857 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-7fbb9e14-19ed-498a-a6df-2e764bb0c347 admin admin] The token cache is being invalidate because project 2dcdd6d105014b0194c8a51a6be692dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:57:54.441193 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-7fbb9e14-19ed-498a-a6df-2e764bb0c347 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:54.442293 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-7fbb9e14-19ed-498a-a6df-2e764bb0c347 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:54.444420 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1153/2293] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:57:54 2022] DELETE /identity/v3/projects/2dcdd6d105014b0194c8a51a6be692dc => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:54.448969 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf401ae2-d444-4fbd-a5c0-5fb5675301e7 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:54.465848 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf401ae2-d444-4fbd-a5c0-5fb5675301e7 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:54.647332 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b99080-3703-4e33-aeab-261d2f670279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:54.650782 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b99080-3703-4e33-aeab-261d2f670279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:54.651081 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b99080-3703-4e33-aeab-261d2f670279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:54.651392 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b99080-3703-4e33-aeab-261d2f670279 admin admin] PATH_INFO: `/v3/users/27115dc2b8774f07984a2eaafb6538e8` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:54.653796 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b99080-3703-4e33-aeab-261d2f670279 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27115dc2b8774f07984a2eaafb6538e8)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:54.667752 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b99080-3703-4e33-aeab-261d2f670279 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:54.746210 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f2b99080-3703-4e33-aeab-261d2f670279 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27115dc2b8774f07984a2eaafb6538e8'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:54.747098 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f2b99080-3703-4e33-aeab-261d2f670279 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27115dc2b8774f07984a2eaafb6538e8'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:54.761070 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f2b99080-3703-4e33-aeab-261d2f670279 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27115dc2b8774f07984a2eaafb6538e8'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:54.761844 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f2b99080-3703-4e33-aeab-261d2f670279 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27115dc2b8774f07984a2eaafb6538e8'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:54.794763 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f2b99080-3703-4e33-aeab-261d2f670279 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27115dc2b8774f07984a2eaafb6538e8'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:54.821968 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1141/2294] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:57:54 2022] DELETE /identity/v3/users/27115dc2b8774f07984a2eaafb6538e8 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:55.321534 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0390d-bcae-4957-9e4f-24bf4277bbc6 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:55.322307 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0390d-bcae-4957-9e4f-24bf4277bbc6 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:55.322545 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0390d-bcae-4957-9e4f-24bf4277bbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:55.389782 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-35f0390d-bcae-4957-9e4f-24bf4277bbc6 None None] MFA Rules not processed for user `e89c079feccd49618b4ae1b779ba04fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:55.391031 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-35f0390d-bcae-4957-9e4f-24bf4277bbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:55.431281 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b99080-3703-4e33-aeab-261d2f670279 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:55.435956 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f2b99080-3703-4e33-aeab-261d2f670279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:55.467613 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:55.544837 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1154/2295] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:55.546231 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0390d-bcae-4957-9e4f-24bf4277bbc6 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:55.568233 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-35f0390d-bcae-4957-9e4f-24bf4277bbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:55.602514 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b99080-3703-4e33-aeab-261d2f670279 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:55.606976 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5fdbf-9491-4775-b120-abd9b26f4ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:55.607924 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5fdbf-9491-4775-b120-abd9b26f4ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:55.608272 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5fdbf-9491-4775-b120-abd9b26f4ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:55.608993 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5fdbf-9491-4775-b120-abd9b26f4ae6 admin admin] PATH_INFO: `/v3/users/eca334075712429792563863296ae560` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:55.610074 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5fdbf-9491-4775-b120-abd9b26f4ae6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eca334075712429792563863296ae560)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:55.612671 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5fdbf-9491-4775-b120-abd9b26f4ae6 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:55.672712 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-6bb5fdbf-9491-4775-b120-abd9b26f4ae6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eca334075712429792563863296ae560'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:55.673245 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0390d-bcae-4957-9e4f-24bf4277bbc6 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:55.674111 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-6bb5fdbf-9491-4775-b120-abd9b26f4ae6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eca334075712429792563863296ae560'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:55.679290 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6101f3f-2204-47a2-a8e7-8d59e26028a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:55.680173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6101f3f-2204-47a2-a8e7-8d59e26028a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:55.680491 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6101f3f-2204-47a2-a8e7-8d59e26028a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:55.680829 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6101f3f-2204-47a2-a8e7-8d59e26028a1 admin admin] PATH_INFO: `/v3/projects/11997475fdbb4aa1b56149501c61bb13` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:55.682650 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6101f3f-2204-47a2-a8e7-8d59e26028a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11997475fdbb4aa1b56149501c61bb13)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:55.684874 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6101f3f-2204-47a2-a8e7-8d59e26028a1 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:55.687216 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-6bb5fdbf-9491-4775-b120-abd9b26f4ae6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eca334075712429792563863296ae560'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:55.689587 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-6bb5fdbf-9491-4775-b120-abd9b26f4ae6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eca334075712429792563863296ae560'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:55.705343 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:55.709910 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-6bb5fdbf-9491-4775-b120-abd9b26f4ae6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eca334075712429792563863296ae560'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:55.728584 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1142/2296] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:57:55 2022] DELETE /identity/v3/users/eca334075712429792563863296ae560 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:55.728584 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5fdbf-9491-4775-b120-abd9b26f4ae6 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:55.728933 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-6bb5fdbf-9491-4775-b120-abd9b26f4ae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:55.775805 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d6101f3f-2204-47a2-a8e7-8d59e26028a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11997475fdbb4aa1b56149501c61bb13', 'request_id': 'req-d6101f3f-2204-47a2-a8e7-8d59e26028a1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:55.785066 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d6101f3f-2204-47a2-a8e7-8d59e26028a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11997475fdbb4aa1b56149501c61bb13', 'request_id': 'req-d6101f3f-2204-47a2-a8e7-8d59e26028a1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:55.798792 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d6101f3f-2204-47a2-a8e7-8d59e26028a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11997475fdbb4aa1b56149501c61bb13', 'request_id': 'req-d6101f3f-2204-47a2-a8e7-8d59e26028a1'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:55.814774 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d6101f3f-2204-47a2-a8e7-8d59e26028a1 admin admin] The token cache is being invalidate because project 11997475fdbb4aa1b56149501c61bb13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:57:55.815169 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d6101f3f-2204-47a2-a8e7-8d59e26028a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:55.816208 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d6101f3f-2204-47a2-a8e7-8d59e26028a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:55.825648 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5fdbf-9491-4775-b120-abd9b26f4ae6 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:55.825765 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1155/2297] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:57:55 2022] DELETE /identity/v3/projects/11997475fdbb4aa1b56149501c61bb13 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:55.825765 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40c5cc-be44-40ef-9a2b-a7a144cb8f42 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:55.825765 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40c5cc-be44-40ef-9a2b-a7a144cb8f42 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:55.825765 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40c5cc-be44-40ef-9a2b-a7a144cb8f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:55.850814 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-df40c5cc-be44-40ef-9a2b-a7a144cb8f42 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:55.852199 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-df40c5cc-be44-40ef-9a2b-a7a144cb8f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:55.878525 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:55.884021 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230750a8-5774-4b1b-94cb-1da68c2c0044 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:55.884901 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230750a8-5774-4b1b-94cb-1da68c2c0044 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:55.885353 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230750a8-5774-4b1b-94cb-1da68c2c0044 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:55.885979 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230750a8-5774-4b1b-94cb-1da68c2c0044 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:55.888588 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-230750a8-5774-4b1b-94cb-1da68c2c0044 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:55.960911 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1156/2298] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:55.960911 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a760e-c6f5-4322-ac40-752a2c59d38e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:55.961442 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a760e-c6f5-4322-ac40-752a2c59d38e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:55.961829 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a760e-c6f5-4322-ac40-752a2c59d38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:55.986113 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-687a760e-c6f5-4322-ac40-752a2c59d38e None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:55.988807 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-687a760e-c6f5-4322-ac40-752a2c59d38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:56.001533 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1157/2299] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:56.002426 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a760e-c6f5-4322-ac40-752a2c59d38e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:56.006882 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230750a8-5774-4b1b-94cb-1da68c2c0044 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:56.008597 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230750a8-5774-4b1b-94cb-1da68c2c0044 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:56.009111 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-687a760e-c6f5-4322-ac40-752a2c59d38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:56.018844 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1143/2300] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:57:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:57:56.020314 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99c585-c281-446f-9d4b-2ab27383b1b1 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:56.020539 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99c585-c281-446f-9d4b-2ab27383b1b1 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:56.020813 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99c585-c281-446f-9d4b-2ab27383b1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:56.061132 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-bc99c585-c281-446f-9d4b-2ab27383b1b1 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:56.063731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-bc99c585-c281-446f-9d4b-2ab27383b1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:56.088429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1144/2301] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:56.093084 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99c585-c281-446f-9d4b-2ab27383b1b1 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:56.114475 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99c585-c281-446f-9d4b-2ab27383b1b1 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:56.128311 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f30106-8802-4d7b-9a19-3f4eb6e685b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:56.129208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f30106-8802-4d7b-9a19-3f4eb6e685b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:56.129830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f30106-8802-4d7b-9a19-3f4eb6e685b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:56.130277 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f30106-8802-4d7b-9a19-3f4eb6e685b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:56.132429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f30106-8802-4d7b-9a19-3f4eb6e685b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:57:56.134365 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f30106-8802-4d7b-9a19-3f4eb6e685b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:56.136231 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f30106-8802-4d7b-9a19-3f4eb6e685b3 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:56.136579 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a760e-c6f5-4322-ac40-752a2c59d38e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:56.148329 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2fbde-19d5-4fcc-af62-519f2a2450b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:56.149383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2fbde-19d5-4fcc-af62-519f2a2450b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:56.149671 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2fbde-19d5-4fcc-af62-519f2a2450b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:56.149952 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2fbde-19d5-4fcc-af62-519f2a2450b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:56.161438 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1145/2302] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:57:56.167076 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f30106-8802-4d7b-9a19-3f4eb6e685b3 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:56.169823 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2fbde-19d5-4fcc-af62-519f2a2450b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:56.171660 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2fbde-19d5-4fcc-af62-519f2a2450b0 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:56.188122 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1158/2303] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:57:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:57:56.188996 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f30106-8802-4d7b-9a19-3f4eb6e685b3 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:56.193894 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4f053-24a9-4960-8793-596db0186423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:56.194992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4f053-24a9-4960-8793-596db0186423 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:56.196716 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4f053-24a9-4960-8793-596db0186423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:56.196716 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4f053-24a9-4960-8793-596db0186423 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:56.197148 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff4f053-24a9-4960-8793-596db0186423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:56.199028 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff4f053-24a9-4960-8793-596db0186423 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:56.250801 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1146/2304] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:57:56 2022] POST /identity/v3/projects => generated 361 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:57:56.254499 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2fbde-19d5-4fcc-af62-519f2a2450b0 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:56.269558 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2fbde-19d5-4fcc-af62-519f2a2450b0 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:56.324248 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:56.366840 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f05bc-05e0-47b9-861c-7671e0229416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:56.368105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f05bc-05e0-47b9-861c-7671e0229416 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:56.368627 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f05bc-05e0-47b9-861c-7671e0229416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:56.369057 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f05bc-05e0-47b9-861c-7671e0229416 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:56.369857 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f05bc-05e0-47b9-861c-7671e0229416 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:56.372587 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f05bc-05e0-47b9-861c-7671e0229416 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:56.440510 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1159/2305] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:57:56 2022] POST /identity/v3/users => generated 281 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:57:56.440736 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4f053-24a9-4960-8793-596db0186423 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:56.463339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4f053-24a9-4960-8793-596db0186423 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:56.463339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29cc5a7-2153-42b8-9f00-11d7af4739e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:56.463339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29cc5a7-2153-42b8-9f00-11d7af4739e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:56.463339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29cc5a7-2153-42b8-9f00-11d7af4739e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:56.465374 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29cc5a7-2153-42b8-9f00-11d7af4739e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:56.466156 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29cc5a7-2153-42b8-9f00-11d7af4739e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:56.468175 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29cc5a7-2153-42b8-9f00-11d7af4739e9 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:56.491997 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1147/2306] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 05:57:56.500092 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f05bc-05e0-47b9-861c-7671e0229416 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:56.520593 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f05bc-05e0-47b9-861c-7671e0229416 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:56.539057 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c15200-0157-420d-93c1-1a3fbaf27c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:56.539784 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c15200-0157-420d-93c1-1a3fbaf27c41 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:56.540067 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c15200-0157-420d-93c1-1a3fbaf27c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:56.540343 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c15200-0157-420d-93c1-1a3fbaf27c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:56.541173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c15200-0157-420d-93c1-1a3fbaf27c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:56.542803 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c15200-0157-420d-93c1-1a3fbaf27c41 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:56.574228 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1160/2307] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:57:56.576358 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29cc5a7-2153-42b8-9f00-11d7af4739e9 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:56.593054 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29cc5a7-2153-42b8-9f00-11d7af4739e9 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:56.614520 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee93e6d-c664-4510-8fdf-def2ee7acb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:56.615479 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee93e6d-c664-4510-8fdf-def2ee7acb1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:56.615757 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee93e6d-c664-4510-8fdf-def2ee7acb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:56.616034 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee93e6d-c664-4510-8fdf-def2ee7acb1a admin admin] PATH_INFO: `/v3/projects/f8a47d9227c64e0fab300a7bd4e47037/users/83dd7dbeccb54169b3c3aa857bb3595b/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:56.641175 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee93e6d-c664-4510-8fdf-def2ee7acb1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8a47d9227c64e0fab300a7bd4e47037, user_id=83dd7dbeccb54169b3c3aa857bb3595b, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:56.644152 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee93e6d-c664-4510-8fdf-def2ee7acb1a admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:56.660140 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1148/2308] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:57:56 2022] PUT /identity/v3/projects/f8a47d9227c64e0fab300a7bd4e47037/users/83dd7dbeccb54169b3c3aa857bb3595b/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:56.671827 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e945a22-36c8-4177-932c-79f6d33d804a None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:56.672113 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e945a22-36c8-4177-932c-79f6d33d804a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:56.672394 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e945a22-36c8-4177-932c-79f6d33d804a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:56.705402 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6e945a22-36c8-4177-932c-79f6d33d804a None None] MFA Rules not processed for user `83dd7dbeccb54169b3c3aa857bb3595b`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:56.706983 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6e945a22-36c8-4177-932c-79f6d33d804a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:56.735159 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee93e6d-c664-4510-8fdf-def2ee7acb1a admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:56.737000 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-eee93e6d-c664-4510-8fdf-def2ee7acb1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:56.810863 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1161/2309] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:56.828361 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee93e6d-c664-4510-8fdf-def2ee7acb1a admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:56.833708 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f258f3f-43ed-4600-b020-88d8c96917d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:56.834484 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f258f3f-43ed-4600-b020-88d8c96917d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:56.834741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f258f3f-43ed-4600-b020-88d8c96917d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:56.835006 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f258f3f-43ed-4600-b020-88d8c96917d1 admin admin] PATH_INFO: `/v3/projects/3642088d784e4911976ac23e23759356` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:56.836510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f258f3f-43ed-4600-b020-88d8c96917d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3642088d784e4911976ac23e23759356)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:56.838790 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f258f3f-43ed-4600-b020-88d8c96917d1 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:56.843562 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e945a22-36c8-4177-932c-79f6d33d804a None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:56.844917 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6e945a22-36c8-4177-932c-79f6d33d804a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:56.888615 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:56.929334 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-5f258f3f-43ed-4600-b020-88d8c96917d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3642088d784e4911976ac23e23759356', 'request_id': 'req-5f258f3f-43ed-4600-b020-88d8c96917d1'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:56.943378 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-5f258f3f-43ed-4600-b020-88d8c96917d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3642088d784e4911976ac23e23759356', 'request_id': 'req-5f258f3f-43ed-4600-b020-88d8c96917d1'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:56.946288 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e945a22-36c8-4177-932c-79f6d33d804a None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:56.957249 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-5f258f3f-43ed-4600-b020-88d8c96917d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3642088d784e4911976ac23e23759356', 'request_id': 'req-5f258f3f-43ed-4600-b020-88d8c96917d1'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:56.975129 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-5f258f3f-43ed-4600-b020-88d8c96917d1 admin admin] The token cache is being invalidate because project 3642088d784e4911976ac23e23759356 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:57:56.975976 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-5f258f3f-43ed-4600-b020-88d8c96917d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:56.977213 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-5f258f3f-43ed-4600-b020-88d8c96917d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:56.979491 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1149/2310] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:57:56 2022] DELETE /identity/v3/projects/3642088d784e4911976ac23e23759356 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 05:57:57.137412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a2b96-2154-4297-a2fe-8b725e2d824e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:57.139912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a2b96-2154-4297-a2fe-8b725e2d824e service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:57.140204 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a2b96-2154-4297-a2fe-8b725e2d824e service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:57.140481 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a2b96-2154-4297-a2fe-8b725e2d824e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:57.145364 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-540a2b96-2154-4297-a2fe-8b725e2d824e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:57.183045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:57.284870 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a2b96-2154-4297-a2fe-8b725e2d824e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:57.286332 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a2b96-2154-4297-a2fe-8b725e2d824e service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:57.297943 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1162/2311] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:57:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 05:57:57.312980 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f258f3f-43ed-4600-b020-88d8c96917d1 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:57.314503 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-5f258f3f-43ed-4600-b020-88d8c96917d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:57.434013 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f258f3f-43ed-4600-b020-88d8c96917d1 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:57.442025 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f9cea-73e2-4488-ab95-4be8454dfa04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:57.443679 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f9cea-73e2-4488-ab95-4be8454dfa04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:57.444238 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f9cea-73e2-4488-ab95-4be8454dfa04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:57.444529 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f9cea-73e2-4488-ab95-4be8454dfa04 admin admin] PATH_INFO: `/v3/users/83dd7dbeccb54169b3c3aa857bb3595b` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:57.447578 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f9cea-73e2-4488-ab95-4be8454dfa04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83dd7dbeccb54169b3c3aa857bb3595b)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:57.449852 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f9cea-73e2-4488-ab95-4be8454dfa04 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:57.539057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e63f9cea-73e2-4488-ab95-4be8454dfa04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83dd7dbeccb54169b3c3aa857bb3595b'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:57.541715 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e63f9cea-73e2-4488-ab95-4be8454dfa04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83dd7dbeccb54169b3c3aa857bb3595b'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:57.560968 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e63f9cea-73e2-4488-ab95-4be8454dfa04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83dd7dbeccb54169b3c3aa857bb3595b'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:57.562241 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e63f9cea-73e2-4488-ab95-4be8454dfa04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83dd7dbeccb54169b3c3aa857bb3595b'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:57.578856 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342df44-740f-4eb6-a447-bea16c6e41c8 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:57.579751 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342df44-740f-4eb6-a447-bea16c6e41c8 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:57.580248 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342df44-740f-4eb6-a447-bea16c6e41c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:57.597099 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e63f9cea-73e2-4488-ab95-4be8454dfa04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83dd7dbeccb54169b3c3aa857bb3595b'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:57.602705 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-f342df44-740f-4eb6-a447-bea16c6e41c8 None None] MFA Rules not processed for user `e89c079feccd49618b4ae1b779ba04fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:57.604767 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f342df44-740f-4eb6-a447-bea16c6e41c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:57.616033 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1150/2312] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:57:57 2022] DELETE /identity/v3/users/83dd7dbeccb54169b3c3aa857bb3595b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:57.635558 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8506f-9156-4257-ae64-f2cb68718f9f None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:57.636137 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8506f-9156-4257-ae64-f2cb68718f9f None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:57.636426 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8506f-9156-4257-ae64-f2cb68718f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:57.684181 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-29e8506f-9156-4257-ae64-f2cb68718f9f None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:57.688934 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1163/2313] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:57.689576 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-29e8506f-9156-4257-ae64-f2cb68718f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:57.736047 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:57.782136 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1151/2314] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:57.799966 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342df44-740f-4eb6-a447-bea16c6e41c8 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:57.801438 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f342df44-740f-4eb6-a447-bea16c6e41c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:57.889609 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342df44-740f-4eb6-a447-bea16c6e41c8 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:57.945528 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de933c8-8cb9-4614-a1fc-7e3a92e5ddfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:57.946330 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de933c8-8cb9-4614-a1fc-7e3a92e5ddfe service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:57.946671 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de933c8-8cb9-4614-a1fc-7e3a92e5ddfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:57.947014 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de933c8-8cb9-4614-a1fc-7e3a92e5ddfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:57.957483 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de933c8-8cb9-4614-a1fc-7e3a92e5ddfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:57.959074 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de933c8-8cb9-4614-a1fc-7e3a92e5ddfe service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:57.970083 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1164/2315] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:57:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 05:57:58.513007 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8506f-9156-4257-ae64-f2cb68718f9f None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:58.514520 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-29e8506f-9156-4257-ae64-f2cb68718f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:58.527949 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8506f-9156-4257-ae64-f2cb68718f9f None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:58.534246 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa367b02-28f5-43d0-a16e-e023ab978dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:58.535223 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa367b02-28f5-43d0-a16e-e023ab978dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:58.535543 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa367b02-28f5-43d0-a16e-e023ab978dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:58.535829 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa367b02-28f5-43d0-a16e-e023ab978dcb admin admin] PATH_INFO: `/v3/projects/f8a47d9227c64e0fab300a7bd4e47037` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:58.537136 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa367b02-28f5-43d0-a16e-e023ab978dcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8a47d9227c64e0fab300a7bd4e47037)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:58.539220 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa367b02-28f5-43d0-a16e-e023ab978dcb admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:58.594802 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fa367b02-28f5-43d0-a16e-e023ab978dcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8a47d9227c64e0fab300a7bd4e47037', 'request_id': 'req-fa367b02-28f5-43d0-a16e-e023ab978dcb'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:58.603970 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fa367b02-28f5-43d0-a16e-e023ab978dcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8a47d9227c64e0fab300a7bd4e47037', 'request_id': 'req-fa367b02-28f5-43d0-a16e-e023ab978dcb'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:58.612812 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fa367b02-28f5-43d0-a16e-e023ab978dcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8a47d9227c64e0fab300a7bd4e47037', 'request_id': 'req-fa367b02-28f5-43d0-a16e-e023ab978dcb'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:58.623163 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fa367b02-28f5-43d0-a16e-e023ab978dcb admin admin] The token cache is being invalidate because project f8a47d9227c64e0fab300a7bd4e47037 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:57:58.623472 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fa367b02-28f5-43d0-a16e-e023ab978dcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:58.624147 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fa367b02-28f5-43d0-a16e-e023ab978dcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:57:58.625693 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1152/2316] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:57:58 2022] DELETE /identity/v3/projects/f8a47d9227c64e0fab300a7bd4e47037 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:58.630641 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c7eee-f9d2-4de6-98c5-95e42da442b7 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:58.631135 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c7eee-f9d2-4de6-98c5-95e42da442b7 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:58.631273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c7eee-f9d2-4de6-98c5-95e42da442b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:58.653290 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6a3c7eee-f9d2-4de6-98c5-95e42da442b7 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:58.654881 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6a3c7eee-f9d2-4de6-98c5-95e42da442b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:58.680394 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:58.734269 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1165/2317] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:58.742117 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdeffe-b1ee-463e-8c63-c90813da8484 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:58.742403 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdeffe-b1ee-463e-8c63-c90813da8484 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:58.742680 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdeffe-b1ee-463e-8c63-c90813da8484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:58.763342 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-96cdeffe-b1ee-463e-8c63-c90813da8484 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:58.764612 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-96cdeffe-b1ee-463e-8c63-c90813da8484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:58.773480 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1153/2318] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:57:58.778150 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c7eee-f9d2-4de6-98c5-95e42da442b7 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:58.791512 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c7eee-f9d2-4de6-98c5-95e42da442b7 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:58.797762 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953f3c0-7e06-4ec3-8f57-1c353eecc5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:58.799027 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953f3c0-7e06-4ec3-8f57-1c353eecc5dc admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:58.799357 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953f3c0-7e06-4ec3-8f57-1c353eecc5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:58.799817 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953f3c0-7e06-4ec3-8f57-1c353eecc5dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:58.800842 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953f3c0-7e06-4ec3-8f57-1c353eecc5dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:57:58.801350 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953f3c0-7e06-4ec3-8f57-1c353eecc5dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:58.803390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953f3c0-7e06-4ec3-8f57-1c353eecc5dc admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:58.821978 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1166/2319] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 05:57:58.823635 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdeffe-b1ee-463e-8c63-c90813da8484 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:58.836892 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdeffe-b1ee-463e-8c63-c90813da8484 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:58.846915 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d0422-fc1b-4606-b258-17bf94c8f3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:58.848222 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d0422-fc1b-4606-b258-17bf94c8f3e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:58.848684 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d0422-fc1b-4606-b258-17bf94c8f3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:58.849161 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d0422-fc1b-4606-b258-17bf94c8f3e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:58.850013 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110d0422-fc1b-4606-b258-17bf94c8f3e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:58.852103 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110d0422-fc1b-4606-b258-17bf94c8f3e7 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:58.881360 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1154/2320] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:57:58 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:57:58.885774 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953f3c0-7e06-4ec3-8f57-1c353eecc5dc admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:58.899305 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953f3c0-7e06-4ec3-8f57-1c353eecc5dc admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:58.999446 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fcf67-3100-4d35-bed1-4b8d3e0d30ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:58.999446 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fcf67-3100-4d35-bed1-4b8d3e0d30ef admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:58.999446 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fcf67-3100-4d35-bed1-4b8d3e0d30ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:58.999446 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fcf67-3100-4d35-bed1-4b8d3e0d30ef admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:59.028949 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62fcf67-3100-4d35-bed1-4b8d3e0d30ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:59.028949 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62fcf67-3100-4d35-bed1-4b8d3e0d30ef admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:59.053103 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1167/2321] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:57:58 2022] POST /identity/v3/users => generated 288 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:57:59.054785 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d0422-fc1b-4606-b258-17bf94c8f3e7 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:59.068074 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d0422-fc1b-4606-b258-17bf94c8f3e7 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:59.074614 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd7233-0329-499c-9561-6ae718283054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:59.075698 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd7233-0329-499c-9561-6ae718283054 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:59.076049 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd7233-0329-499c-9561-6ae718283054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:59.076391 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd7233-0329-499c-9561-6ae718283054 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:59.077271 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd7233-0329-499c-9561-6ae718283054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:59.079016 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd7233-0329-499c-9561-6ae718283054 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:59.091413 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1155/2322] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:57:59.095649 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fcf67-3100-4d35-bed1-4b8d3e0d30ef admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:59.105932 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fcf67-3100-4d35-bed1-4b8d3e0d30ef admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:59.111640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e90b6e-7981-4817-b2e5-bba0b42718b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:59.112318 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e90b6e-7981-4817-b2e5-bba0b42718b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:59.112620 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e90b6e-7981-4817-b2e5-bba0b42718b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:59.113403 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e90b6e-7981-4817-b2e5-bba0b42718b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:59.113622 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e90b6e-7981-4817-b2e5-bba0b42718b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:59.115417 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e90b6e-7981-4817-b2e5-bba0b42718b7 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:59.133066 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1168/2323] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:57:59.136650 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd7233-0329-499c-9561-6ae718283054 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:59.150001 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd7233-0329-499c-9561-6ae718283054 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:59.156132 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66726e-08f3-4bd3-b4ea-3fd1885479f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:59.156848 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66726e-08f3-4bd3-b4ea-3fd1885479f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:59.157155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66726e-08f3-4bd3-b4ea-3fd1885479f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:59.157541 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66726e-08f3-4bd3-b4ea-3fd1885479f2 admin admin] PATH_INFO: `/v3/projects/7f4e2a2ad16a4c6ba8f0b782eed4997a/users/dc1d0f49740547e8b4ae860ecf3c287b/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:59.174887 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c66726e-08f3-4bd3-b4ea-3fd1885479f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4e2a2ad16a4c6ba8f0b782eed4997a, user_id=dc1d0f49740547e8b4ae860ecf3c287b, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:59.177811 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c66726e-08f3-4bd3-b4ea-3fd1885479f2 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:59.193899 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1156/2324] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:57:59 2022] PUT /identity/v3/projects/7f4e2a2ad16a4c6ba8f0b782eed4997a/users/dc1d0f49740547e8b4ae860ecf3c287b/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:57:59.204421 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165e0ca-c568-49e2-8fd4-c31e3ad157f4 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:59.204707 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165e0ca-c568-49e2-8fd4-c31e3ad157f4 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:59.204982 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165e0ca-c568-49e2-8fd4-c31e3ad157f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:59.239671 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-5165e0ca-c568-49e2-8fd4-c31e3ad157f4 None None] MFA Rules not processed for user `dc1d0f49740547e8b4ae860ecf3c287b`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:57:59.240939 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5165e0ca-c568-49e2-8fd4-c31e3ad157f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:59.306468 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1169/2325] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:57:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:57:59.317308 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66726e-08f3-4bd3-b4ea-3fd1885479f2 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:57:59.319229 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-7c66726e-08f3-4bd3-b4ea-3fd1885479f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:57:59.376976 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66726e-08f3-4bd3-b4ea-3fd1885479f2 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:57:59.380819 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d1eee-1009-4024-a888-f5087f040a72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:57:59.381475 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d1eee-1009-4024-a888-f5087f040a72 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:57:59.381757 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d1eee-1009-4024-a888-f5087f040a72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:57:59.382034 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d1eee-1009-4024-a888-f5087f040a72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:57:59.390539 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d1eee-1009-4024-a888-f5087f040a72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:57:59.392010 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d1eee-1009-4024-a888-f5087f040a72 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:57:59.395514 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:57:59.405113 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1157/2326] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:57:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:58:02.600222 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165e0ca-c568-49e2-8fd4-c31e3ad157f4 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:58:02.622640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:58:02.689629 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165e0ca-c568-49e2-8fd4-c31e3ad157f4 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:58:02.694535 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c72855-fe11-46ef-90ad-1e0bfc7f9e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:58:02.695736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c72855-fe11-46ef-90ad-1e0bfc7f9e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:02.696172 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c72855-fe11-46ef-90ad-1e0bfc7f9e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:02.696484 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c72855-fe11-46ef-90ad-1e0bfc7f9e03 admin admin] PATH_INFO: `/v3/users/dc1d0f49740547e8b4ae860ecf3c287b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:02.697923 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c72855-fe11-46ef-90ad-1e0bfc7f9e03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc1d0f49740547e8b4ae860ecf3c287b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:58:02.699921 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c72855-fe11-46ef-90ad-1e0bfc7f9e03 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:58:02.762095 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-19c72855-fe11-46ef-90ad-1e0bfc7f9e03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc1d0f49740547e8b4ae860ecf3c287b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:58:02.771589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-19c72855-fe11-46ef-90ad-1e0bfc7f9e03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc1d0f49740547e8b4ae860ecf3c287b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:58:02.784617 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-19c72855-fe11-46ef-90ad-1e0bfc7f9e03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc1d0f49740547e8b4ae860ecf3c287b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:58:02.785470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-19c72855-fe11-46ef-90ad-1e0bfc7f9e03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc1d0f49740547e8b4ae860ecf3c287b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:58:02.804499 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-19c72855-fe11-46ef-90ad-1e0bfc7f9e03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc1d0f49740547e8b4ae860ecf3c287b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:58:02.817423 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1170/2327] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:58:02 2022] DELETE /identity/v3/users/dc1d0f49740547e8b4ae860ecf3c287b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:58:02.821831 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8585e-81d5-4a2c-b466-3683499bb847 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:02.822758 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8585e-81d5-4a2c-b466-3683499bb847 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:02.823235 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8585e-81d5-4a2c-b466-3683499bb847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:02.844086 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-03d8585e-81d5-4a2c-b466-3683499bb847 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:58:02.846144 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-03d8585e-81d5-4a2c-b466-3683499bb847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:02.925792 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1158/2328] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:58:02.946705 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c72855-fe11-46ef-90ad-1e0bfc7f9e03 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:58:02.948366 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-19c72855-fe11-46ef-90ad-1e0bfc7f9e03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:03.013554 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c72855-fe11-46ef-90ad-1e0bfc7f9e03 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:58:03.017619 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60af92e-086e-4251-9bce-c05f4578e025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:58:03.018416 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60af92e-086e-4251-9bce-c05f4578e025 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:03.018704 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60af92e-086e-4251-9bce-c05f4578e025 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:03.018982 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60af92e-086e-4251-9bce-c05f4578e025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:03.030437 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60af92e-086e-4251-9bce-c05f4578e025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:58:03.031908 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60af92e-086e-4251-9bce-c05f4578e025 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:58:03.044595 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1171/2329] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:58:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:58:03.796267 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85ebae-0c01-4dd9-aefb-c73b1e375cb2 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:03.796489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85ebae-0c01-4dd9-aefb-c73b1e375cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:03.797025 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85ebae-0c01-4dd9-aefb-c73b1e375cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:03.834743 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-aa85ebae-0c01-4dd9-aefb-c73b1e375cb2 None None] MFA Rules not processed for user `bd06f1f3ff124acbaede2c9fb1f116a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:58:03.837162 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-aa85ebae-0c01-4dd9-aefb-c73b1e375cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:03.900083 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60af92e-086e-4251-9bce-c05f4578e025 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:58:03.901697 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e60af92e-086e-4251-9bce-c05f4578e025 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:03.917641 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60af92e-086e-4251-9bce-c05f4578e025 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:58:03.928557 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6238e36-3501-4e3d-b1ba-8285cceeb1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:58:03.929496 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6238e36-3501-4e3d-b1ba-8285cceeb1d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:03.929785 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6238e36-3501-4e3d-b1ba-8285cceeb1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:03.930572 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6238e36-3501-4e3d-b1ba-8285cceeb1d8 admin admin] PATH_INFO: `/v3/projects/7f4e2a2ad16a4c6ba8f0b782eed4997a` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:03.931866 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6238e36-3501-4e3d-b1ba-8285cceeb1d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f4e2a2ad16a4c6ba8f0b782eed4997a)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:58:03.934546 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6238e36-3501-4e3d-b1ba-8285cceeb1d8 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:58:03.951917 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1159/2330] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:58:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:58:04.000359 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:58:04.010193 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c6238e36-3501-4e3d-b1ba-8285cceeb1d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f4e2a2ad16a4c6ba8f0b782eed4997a', 'request_id': 'req-c6238e36-3501-4e3d-b1ba-8285cceeb1d8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:58:04.017144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c6238e36-3501-4e3d-b1ba-8285cceeb1d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f4e2a2ad16a4c6ba8f0b782eed4997a', 'request_id': 'req-c6238e36-3501-4e3d-b1ba-8285cceeb1d8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:58:04.025515 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c6238e36-3501-4e3d-b1ba-8285cceeb1d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f4e2a2ad16a4c6ba8f0b782eed4997a', 'request_id': 'req-c6238e36-3501-4e3d-b1ba-8285cceeb1d8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:58:04.036090 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c6238e36-3501-4e3d-b1ba-8285cceeb1d8 admin admin] The token cache is being invalidate because project 7f4e2a2ad16a4c6ba8f0b782eed4997a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:58:04.036375 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c6238e36-3501-4e3d-b1ba-8285cceeb1d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:58:04.037011 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c6238e36-3501-4e3d-b1ba-8285cceeb1d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:58:04.038719 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1172/2331] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:58:03 2022] DELETE /identity/v3/projects/7f4e2a2ad16a4c6ba8f0b782eed4997a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 05:58:04.043799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae2115-6146-4619-91dc-8dd3c001c1a0 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:04.044108 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae2115-6146-4619-91dc-8dd3c001c1a0 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:04.044404 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae2115-6146-4619-91dc-8dd3c001c1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:04.065688 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-92ae2115-6146-4619-91dc-8dd3c001c1a0 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:58:04.067702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-92ae2115-6146-4619-91dc-8dd3c001c1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:04.159399 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1160/2332] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:58:04.168517 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87656363-f078-4d55-967d-0fec880fb869 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:04.168870 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87656363-f078-4d55-967d-0fec880fb869 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:04.169225 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87656363-f078-4d55-967d-0fec880fb869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:04.189740 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-87656363-f078-4d55-967d-0fec880fb869 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:58:04.190952 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-87656363-f078-4d55-967d-0fec880fb869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:04.199076 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1173/2333] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:58:04.203840 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae2115-6146-4619-91dc-8dd3c001c1a0 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:58:04.219829 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae2115-6146-4619-91dc-8dd3c001c1a0 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:58:04.227228 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42988ab-4566-4c26-94c8-626081fae599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:58:04.228756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42988ab-4566-4c26-94c8-626081fae599 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:04.229292 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42988ab-4566-4c26-94c8-626081fae599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:04.229785 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42988ab-4566-4c26-94c8-626081fae599 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:04.230703 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42988ab-4566-4c26-94c8-626081fae599 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 05:58:04.231210 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42988ab-4566-4c26-94c8-626081fae599 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:58:04.233634 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42988ab-4566-4c26-94c8-626081fae599 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:58:04.254830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1161/2334] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 05:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 05:58:04.256395 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87656363-f078-4d55-967d-0fec880fb869 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:58:04.266892 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87656363-f078-4d55-967d-0fec880fb869 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:58:04.272804 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e909d-43a4-4cf0-9ac2-34b42e493b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:58:04.272804 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e909d-43a4-4cf0-9ac2-34b42e493b9d admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:04.272804 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e909d-43a4-4cf0-9ac2-34b42e493b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:04.273344 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e909d-43a4-4cf0-9ac2-34b42e493b9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:04.274136 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e909d-43a4-4cf0-9ac2-34b42e493b9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:58:04.276368 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e909d-43a4-4cf0-9ac2-34b42e493b9d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:58:04.335403 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1174/2335] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 05:58:04 2022] POST /identity/v3/projects => generated 389 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 05:58:04.337891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42988ab-4566-4c26-94c8-626081fae599 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:58:04.351621 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42988ab-4566-4c26-94c8-626081fae599 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:58:04.407810 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:58:04.473504 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7f4e5-ae26-43a8-84f6-604982076152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:58:04.474581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7f4e5-ae26-43a8-84f6-604982076152 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:04.475017 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7f4e5-ae26-43a8-84f6-604982076152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:04.476167 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7f4e5-ae26-43a8-84f6-604982076152 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:04.477046 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7f4e5-ae26-43a8-84f6-604982076152 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:58:04.479765 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7f4e5-ae26-43a8-84f6-604982076152 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:58:04.520811 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1162/2336] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 05:58:04 2022] POST /identity/v3/users => generated 295 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 05:58:04.522023 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e909d-43a4-4cf0-9ac2-34b42e493b9d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:58:04.548100 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e909d-43a4-4cf0-9ac2-34b42e493b9d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:58:04.554215 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ed807-6170-446b-9303-a5f0d166f268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:58:04.554988 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ed807-6170-446b-9303-a5f0d166f268 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:04.555804 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ed807-6170-446b-9303-a5f0d166f268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:04.556181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ed807-6170-446b-9303-a5f0d166f268 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:04.557118 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790ed807-6170-446b-9303-a5f0d166f268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:58:04.558930 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790ed807-6170-446b-9303-a5f0d166f268 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:58:04.575281 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1175/2337] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:58:04.579326 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7f4e5-ae26-43a8-84f6-604982076152 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:58:04.592443 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7f4e5-ae26-43a8-84f6-604982076152 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:58:04.597883 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec2f8e-3221-4b37-9593-3d496da2b156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:58:04.598903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec2f8e-3221-4b37-9593-3d496da2b156 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:04.599317 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec2f8e-3221-4b37-9593-3d496da2b156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:04.599723 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec2f8e-3221-4b37-9593-3d496da2b156 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:04.600616 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec2f8e-3221-4b37-9593-3d496da2b156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:58:04.602358 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec2f8e-3221-4b37-9593-3d496da2b156 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:58:04.614548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1163/2338] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 05:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 05:58:04.619208 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ed807-6170-446b-9303-a5f0d166f268 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:58:04.631554 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ed807-6170-446b-9303-a5f0d166f268 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:58:04.637594 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450e107-4536-4e47-96a1-a13682cfe269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:58:04.638875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450e107-4536-4e47-96a1-a13682cfe269 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:04.639751 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450e107-4536-4e47-96a1-a13682cfe269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:04.640337 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450e107-4536-4e47-96a1-a13682cfe269 admin admin] PATH_INFO: `/v3/projects/5751190217b344a9bfc14f4ed3ee595b/users/43378a1e4b5f40d1a11a9526f977a7a5/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:04.660779 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450e107-4536-4e47-96a1-a13682cfe269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5751190217b344a9bfc14f4ed3ee595b, user_id=43378a1e4b5f40d1a11a9526f977a7a5, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:58:04.664034 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450e107-4536-4e47-96a1-a13682cfe269 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:58:04.683228 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1176/2339] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 05:58:04 2022] PUT /identity/v3/projects/5751190217b344a9bfc14f4ed3ee595b/users/43378a1e4b5f40d1a11a9526f977a7a5/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:58:04.692804 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7020032-41fe-444a-be0a-cea0b6bdf4c1 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:04.693129 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7020032-41fe-444a-be0a-cea0b6bdf4c1 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:04.693414 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7020032-41fe-444a-be0a-cea0b6bdf4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:04.726120 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-a7020032-41fe-444a-be0a-cea0b6bdf4c1 None None] MFA Rules not processed for user `43378a1e4b5f40d1a11a9526f977a7a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:58:04.727941 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-a7020032-41fe-444a-be0a-cea0b6bdf4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:04.818788 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1164/2340] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:58:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:58:04.830052 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450e107-4536-4e47-96a1-a13682cfe269 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:58:04.832815 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b450e107-4536-4e47-96a1-a13682cfe269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:04.908856 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450e107-4536-4e47-96a1-a13682cfe269 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:58:04.918219 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742db36-9a55-4242-8342-c6ba4b005be9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:58:04.919463 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742db36-9a55-4242-8342-c6ba4b005be9 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:04.919985 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742db36-9a55-4242-8342-c6ba4b005be9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:04.920580 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742db36-9a55-4242-8342-c6ba4b005be9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:04.938719 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742db36-9a55-4242-8342-c6ba4b005be9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:58:04.940251 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742db36-9a55-4242-8342-c6ba4b005be9 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:58:04.950484 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1177/2341] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:58:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 05:58:11.844756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed32ab1-6a54-41b8-bb6d-8a0d3b810be8 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:11.845316 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed32ab1-6a54-41b8-bb6d-8a0d3b810be8 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:11.845584 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed32ab1-6a54-41b8-bb6d-8a0d3b810be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:11.866597 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-1ed32ab1-6a54-41b8-bb6d-8a0d3b810be8 None None] MFA Rules not processed for user `3ed779ae7e0f4c90aaed6d1f9e86a4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:58:11.867861 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-1ed32ab1-6a54-41b8-bb6d-8a0d3b810be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:11.880128 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742db36-9a55-4242-8342-c6ba4b005be9 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:58:11.881826 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5742db36-9a55-4242-8342-c6ba4b005be9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:11.937029 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1165/2342] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jul 4 05:58:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:58:11.951892 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed32ab1-6a54-41b8-bb6d-8a0d3b810be8 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:58:11.953409 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-1ed32ab1-6a54-41b8-bb6d-8a0d3b810be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:11.978511 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742db36-9a55-4242-8342-c6ba4b005be9 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:58:11.982360 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47e5b4-df6f-4a3f-9b39-d10602f2b187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:58:11.983407 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47e5b4-df6f-4a3f-9b39-d10602f2b187 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:11.983831 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47e5b4-df6f-4a3f-9b39-d10602f2b187 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:11.984260 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47e5b4-df6f-4a3f-9b39-d10602f2b187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:11.986860 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4c47e5b4-df6f-4a3f-9b39-d10602f2b187 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:12.000136 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:58:12.030211 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:58:12.056011 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed32ab1-6a54-41b8-bb6d-8a0d3b810be8 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:58:12.061485 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e211f-e506-4777-8966-545e2f508c7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55a1c343c60428db2d9e5e6ed865e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:58:12.062160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e211f-e506-4777-8966-545e2f508c7e service swift] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:12.062440 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e211f-e506-4777-8966-545e2f508c7e service swift] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:12.062717 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e211f-e506-4777-8966-545e2f508c7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:12.072320 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e211f-e506-4777-8966-545e2f508c7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:58:12.074025 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e211f-e506-4777-8966-545e2f508c7e service swift] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:58:12.083268 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1166/2343] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 4 05:58:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 04 05:58:12.178592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47e5b4-df6f-4a3f-9b39-d10602f2b187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:58:12.181169 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47e5b4-df6f-4a3f-9b39-d10602f2b187 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:58:12.222088 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1178/2344] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:58:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:58:12.494028 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a498853-71f1-4de8-ba3c-9c4aae2c5f12 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:12.494332 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a498853-71f1-4de8-ba3c-9c4aae2c5f12 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:12.494743 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a498853-71f1-4de8-ba3c-9c4aae2c5f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:12.540204 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-5a498853-71f1-4de8-ba3c-9c4aae2c5f12 None None] MFA Rules not processed for user `3ed779ae7e0f4c90aaed6d1f9e86a4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:58:12.541704 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-5a498853-71f1-4de8-ba3c-9c4aae2c5f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:12.564492 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1167/2345] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jul 4 05:58:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:58:12.588938 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47e5b4-df6f-4a3f-9b39-d10602f2b187 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:58:12.603435 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47e5b4-df6f-4a3f-9b39-d10602f2b187 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:58:12.609930 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f06f24-b31e-4644-8191-130d3d3f3cdb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55a1c343c60428db2d9e5e6ed865e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:58:12.610789 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f06f24-b31e-4644-8191-130d3d3f3cdb service swift] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:12.611139 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f06f24-b31e-4644-8191-130d3d3f3cdb service swift] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:12.611516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f06f24-b31e-4644-8191-130d3d3f3cdb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:12.622850 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f06f24-b31e-4644-8191-130d3d3f3cdb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:58:12.625647 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f06f24-b31e-4644-8191-130d3d3f3cdb service swift] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:58:12.645417 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1179/2346] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 4 05:58:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 05:58:12.998652 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d623a0-447c-47ab-937f-a3def9365b80 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:12.999670 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d623a0-447c-47ab-937f-a3def9365b80 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:13.000106 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d623a0-447c-47ab-937f-a3def9365b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:13.018622 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-a4d623a0-447c-47ab-937f-a3def9365b80 None None] MFA Rules not processed for user `3ed779ae7e0f4c90aaed6d1f9e86a4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:58:13.019885 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-a4d623a0-447c-47ab-937f-a3def9365b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:13.035504 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1168/2347] 10.222.0.16 () {58 vars in 967 bytes} [Mon Jul 4 05:58:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:58:13.056598 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f06f24-b31e-4644-8191-130d3d3f3cdb service swift] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:58:13.067254 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f06f24-b31e-4644-8191-130d3d3f3cdb service swift] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:58:13.080172 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332cb6b-c0a6-48ac-aa27-5ae27a8b4f4b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55a1c343c60428db2d9e5e6ed865e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:58:13.080845 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332cb6b-c0a6-48ac-aa27-5ae27a8b4f4b service swift] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:13.081295 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332cb6b-c0a6-48ac-aa27-5ae27a8b4f4b service swift] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:13.082026 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332cb6b-c0a6-48ac-aa27-5ae27a8b4f4b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:13.093413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332cb6b-c0a6-48ac-aa27-5ae27a8b4f4b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:58:13.095356 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332cb6b-c0a6-48ac-aa27-5ae27a8b4f4b service swift] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:58:13.105921 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1180/2348] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 4 05:58:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 05:58:13.425718 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf6dee-da56-4b01-85a7-a9785ad34161 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:13.426378 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf6dee-da56-4b01-85a7-a9785ad34161 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:13.426863 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf6dee-da56-4b01-85a7-a9785ad34161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:13.463376 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d4bf6dee-da56-4b01-85a7-a9785ad34161 None None] MFA Rules not processed for user `3ed779ae7e0f4c90aaed6d1f9e86a4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:58:13.465411 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d4bf6dee-da56-4b01-85a7-a9785ad34161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:13.509685 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1169/2349] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jul 4 05:58:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:58:13.545547 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332cb6b-c0a6-48ac-aa27-5ae27a8b4f4b service swift] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:58:13.564387 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332cb6b-c0a6-48ac-aa27-5ae27a8b4f4b service swift] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:58:13.594872 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e633de-6e7e-4ed6-9b34-9ff9804294fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55a1c343c60428db2d9e5e6ed865e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:58:13.600151 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e633de-6e7e-4ed6-9b34-9ff9804294fd service swift] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:13.600614 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e633de-6e7e-4ed6-9b34-9ff9804294fd service swift] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:13.601043 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e633de-6e7e-4ed6-9b34-9ff9804294fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:13.675731 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e633de-6e7e-4ed6-9b34-9ff9804294fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:58:13.675731 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e633de-6e7e-4ed6-9b34-9ff9804294fd service swift] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:58:13.675731 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1181/2350] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 4 05:58:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 05:58:14.225043 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e42d7a-1586-44a0-9ef5-a59ed1be21b6 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:14.225629 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e42d7a-1586-44a0-9ef5-a59ed1be21b6 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:14.225629 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e42d7a-1586-44a0-9ef5-a59ed1be21b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:14.254853 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-28e42d7a-1586-44a0-9ef5-a59ed1be21b6 None None] MFA Rules not processed for user `3ed779ae7e0f4c90aaed6d1f9e86a4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:58:14.268603 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-28e42d7a-1586-44a0-9ef5-a59ed1be21b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:14.278647 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1170/2351] 10.222.0.16 () {58 vars in 967 bytes} [Mon Jul 4 05:58:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:58:14.299420 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e633de-6e7e-4ed6-9b34-9ff9804294fd service swift] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:58:14.311880 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e633de-6e7e-4ed6-9b34-9ff9804294fd service swift] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:58:14.319077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad4e8b-a4ba-44f3-b03b-2003afde9ce4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55a1c343c60428db2d9e5e6ed865e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:58:14.320116 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad4e8b-a4ba-44f3-b03b-2003afde9ce4 service swift] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:14.320599 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad4e8b-a4ba-44f3-b03b-2003afde9ce4 service swift] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:14.321069 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad4e8b-a4ba-44f3-b03b-2003afde9ce4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:14.333716 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad4e8b-a4ba-44f3-b03b-2003afde9ce4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:58:14.336225 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad4e8b-a4ba-44f3-b03b-2003afde9ce4 service swift] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:58:14.350178 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1182/2352] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 4 05:58:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 05:58:15.808943 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e42d7a-1586-44a0-9ef5-a59ed1be21b6 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:58:15.916450 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e42d7a-1586-44a0-9ef5-a59ed1be21b6 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:58:15.923155 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07399cfa-f2c4-4929-9274-e8e58f93430b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:58:15.924472 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07399cfa-f2c4-4929-9274-e8e58f93430b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:15.924951 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07399cfa-f2c4-4929-9274-e8e58f93430b admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:15.925389 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07399cfa-f2c4-4929-9274-e8e58f93430b admin admin] PATH_INFO: `/v3/users/43378a1e4b5f40d1a11a9526f977a7a5` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:15.927500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07399cfa-f2c4-4929-9274-e8e58f93430b admin admin] RBAC: Authorizing `identity:delete_user(user_id=43378a1e4b5f40d1a11a9526f977a7a5)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:58:15.930686 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07399cfa-f2c4-4929-9274-e8e58f93430b admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:58:16.020353 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-07399cfa-f2c4-4929-9274-e8e58f93430b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43378a1e4b5f40d1a11a9526f977a7a5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:58:16.022010 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-07399cfa-f2c4-4929-9274-e8e58f93430b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43378a1e4b5f40d1a11a9526f977a7a5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:58:16.032381 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-07399cfa-f2c4-4929-9274-e8e58f93430b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43378a1e4b5f40d1a11a9526f977a7a5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:58:16.033002 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-07399cfa-f2c4-4929-9274-e8e58f93430b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43378a1e4b5f40d1a11a9526f977a7a5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:58:16.052904 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-07399cfa-f2c4-4929-9274-e8e58f93430b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43378a1e4b5f40d1a11a9526f977a7a5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:58:16.071742 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1171/2353] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:58:15 2022] DELETE /identity/v3/users/43378a1e4b5f40d1a11a9526f977a7a5 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:58:16.076742 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7200f5a-4660-4aae-9da6-1dcc15cc166b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:16.077993 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7200f5a-4660-4aae-9da6-1dcc15cc166b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:16.078602 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7200f5a-4660-4aae-9da6-1dcc15cc166b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:16.113805 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-f7200f5a-4660-4aae-9da6-1dcc15cc166b None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:58:16.115506 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f7200f5a-4660-4aae-9da6-1dcc15cc166b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:16.222455 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1183/2354] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:58:16.232847 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07399cfa-f2c4-4929-9274-e8e58f93430b admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:58:16.245412 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-07399cfa-f2c4-4929-9274-e8e58f93430b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:16.369392 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:58:16.425299 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07399cfa-f2c4-4929-9274-e8e58f93430b admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:58:16.434558 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636d87d-7ac2-46f1-97c7-1de918126139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:58:16.435337 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636d87d-7ac2-46f1-97c7-1de918126139 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:16.435699 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636d87d-7ac2-46f1-97c7-1de918126139 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:16.435972 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636d87d-7ac2-46f1-97c7-1de918126139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:16.448707 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0636d87d-7ac2-46f1-97c7-1de918126139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:58:16.450308 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0636d87d-7ac2-46f1-97c7-1de918126139 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:58:16.464361 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1172/2355] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:58:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:58:17.215159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7200f5a-4660-4aae-9da6-1dcc15cc166b None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:58:17.217864 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f7200f5a-4660-4aae-9da6-1dcc15cc166b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:17.225171 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636d87d-7ac2-46f1-97c7-1de918126139 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:58:17.226794 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-0636d87d-7ac2-46f1-97c7-1de918126139 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:17.239944 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7200f5a-4660-4aae-9da6-1dcc15cc166b None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:58:17.252178 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636d87d-7ac2-46f1-97c7-1de918126139 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:58:17.253240 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff773d-5cae-45a7-b4a4-3315f42fb2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:58:17.258304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff773d-5cae-45a7-b4a4-3315f42fb2e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:17.258626 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff773d-5cae-45a7-b4a4-3315f42fb2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:17.258915 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff773d-5cae-45a7-b4a4-3315f42fb2e2 admin admin] PATH_INFO: `/v3/users/578656e5025e45e3b2e4431ea6c91181` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:17.261703 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff773d-5cae-45a7-b4a4-3315f42fb2e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=578656e5025e45e3b2e4431ea6c91181)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:58:17.264361 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff773d-5cae-45a7-b4a4-3315f42fb2e2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:58:17.284065 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47c2bb-739b-4b23-9754-25a7f5686bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:58:17.294730 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47c2bb-739b-4b23-9754-25a7f5686bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:17.296631 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47c2bb-739b-4b23-9754-25a7f5686bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:17.296631 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47c2bb-739b-4b23-9754-25a7f5686bc0 admin admin] PATH_INFO: `/v3/projects/5751190217b344a9bfc14f4ed3ee595b` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:17.301216 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c47c2bb-739b-4b23-9754-25a7f5686bc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5751190217b344a9bfc14f4ed3ee595b)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:58:17.303942 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c47c2bb-739b-4b23-9754-25a7f5686bc0 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:58:17.395552 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-feff773d-5cae-45a7-b4a4-3315f42fb2e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '578656e5025e45e3b2e4431ea6c91181'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:58:17.399868 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:58:17.412417 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-feff773d-5cae-45a7-b4a4-3315f42fb2e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '578656e5025e45e3b2e4431ea6c91181'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:58:17.431702 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-feff773d-5cae-45a7-b4a4-3315f42fb2e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '578656e5025e45e3b2e4431ea6c91181'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:58:17.432635 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-feff773d-5cae-45a7-b4a4-3315f42fb2e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '578656e5025e45e3b2e4431ea6c91181'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:58:17.456685 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-5c47c2bb-739b-4b23-9754-25a7f5686bc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5751190217b344a9bfc14f4ed3ee595b', 'request_id': 'req-5c47c2bb-739b-4b23-9754-25a7f5686bc0'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:58:17.467957 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-feff773d-5cae-45a7-b4a4-3315f42fb2e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '578656e5025e45e3b2e4431ea6c91181'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:58:17.474858 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-5c47c2bb-739b-4b23-9754-25a7f5686bc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5751190217b344a9bfc14f4ed3ee595b', 'request_id': 'req-5c47c2bb-739b-4b23-9754-25a7f5686bc0'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:58:17.484580 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-5c47c2bb-739b-4b23-9754-25a7f5686bc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5751190217b344a9bfc14f4ed3ee595b', 'request_id': 'req-5c47c2bb-739b-4b23-9754-25a7f5686bc0'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:58:17.499885 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1184/2356] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 05:58:17 2022] DELETE /identity/v3/users/578656e5025e45e3b2e4431ea6c91181 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:58:17.505089 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eab088-25b3-4833-a405-9d40a2999195 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:17.507117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eab088-25b3-4833-a405-9d40a2999195 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:17.508559 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eab088-25b3-4833-a405-9d40a2999195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:17.510854 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-5c47c2bb-739b-4b23-9754-25a7f5686bc0 admin admin] The token cache is being invalidate because project 5751190217b344a9bfc14f4ed3ee595b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:58:17.511154 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-5c47c2bb-739b-4b23-9754-25a7f5686bc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:58:17.518687 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-5c47c2bb-739b-4b23-9754-25a7f5686bc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:58:17.520650 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1173/2357] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:58:17 2022] DELETE /identity/v3/projects/5751190217b344a9bfc14f4ed3ee595b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 05:58:17.590419 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-84eab088-25b3-4833-a405-9d40a2999195 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:58:17.602859 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-84eab088-25b3-4833-a405-9d40a2999195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:17.846283 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1185/2358] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:58:17.863500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47c2bb-739b-4b23-9754-25a7f5686bc0 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:58:17.865161 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-5c47c2bb-739b-4b23-9754-25a7f5686bc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:18.021498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47c2bb-739b-4b23-9754-25a7f5686bc0 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:58:18.136225 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b430231-df5f-44bb-8e49-34e860178b5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:58:18.137176 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b430231-df5f-44bb-8e49-34e860178b5f service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:18.137576 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b430231-df5f-44bb-8e49-34e860178b5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:18.138472 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b430231-df5f-44bb-8e49-34e860178b5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:18.152227 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b430231-df5f-44bb-8e49-34e860178b5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:58:18.153846 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b430231-df5f-44bb-8e49-34e860178b5f service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:58:18.169207 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1174/2359] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:58:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:58:19.268041 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eab088-25b3-4833-a405-9d40a2999195 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:58:19.271249 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-84eab088-25b3-4833-a405-9d40a2999195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:19.324369 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eab088-25b3-4833-a405-9d40a2999195 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:58:19.339631 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c720d-d00d-4a5a-9fb6-6319dbb05bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:58:19.340724 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c720d-d00d-4a5a-9fb6-6319dbb05bf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:19.341012 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c720d-d00d-4a5a-9fb6-6319dbb05bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:19.341291 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c720d-d00d-4a5a-9fb6-6319dbb05bf5 admin admin] PATH_INFO: `/v3/projects/36e74f91cf99452a82119ecca3004230` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:19.343589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c720d-d00d-4a5a-9fb6-6319dbb05bf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36e74f91cf99452a82119ecca3004230)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:58:19.345780 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c720d-d00d-4a5a-9fb6-6319dbb05bf5 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:58:19.473031 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-366c720d-d00d-4a5a-9fb6-6319dbb05bf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36e74f91cf99452a82119ecca3004230', 'request_id': 'req-366c720d-d00d-4a5a-9fb6-6319dbb05bf5'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:58:19.491934 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-366c720d-d00d-4a5a-9fb6-6319dbb05bf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36e74f91cf99452a82119ecca3004230', 'request_id': 'req-366c720d-d00d-4a5a-9fb6-6319dbb05bf5'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:58:19.519445 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-366c720d-d00d-4a5a-9fb6-6319dbb05bf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36e74f91cf99452a82119ecca3004230', 'request_id': 'req-366c720d-d00d-4a5a-9fb6-6319dbb05bf5'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:58:19.535105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-366c720d-d00d-4a5a-9fb6-6319dbb05bf5 admin admin] The token cache is being invalidate because project 36e74f91cf99452a82119ecca3004230 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 05:58:19.535362 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-366c720d-d00d-4a5a-9fb6-6319dbb05bf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:58:19.536196 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-366c720d-d00d-4a5a-9fb6-6319dbb05bf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 05:58:19.537885 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1186/2360] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 05:58:19 2022] DELETE /identity/v3/projects/36e74f91cf99452a82119ecca3004230 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 05:58:28.169039 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:58:29.529430 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=65,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:58:30.633851 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5264a0-3367-45f8-a866-e2ac8e36c6a3 None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:30.634393 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5264a0-3367-45f8-a866-e2ac8e36c6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:30.634506 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5264a0-3367-45f8-a866-e2ac8e36c6a3 None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:30.635846 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1175/2361] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jul 4 05:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:58:30.644123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3100c63-51b7-47af-b86d-9970af57e266 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:30.644693 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3100c63-51b7-47af-b86d-9970af57e266 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:30.644693 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3100c63-51b7-47af-b86d-9970af57e266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:30.673330 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-b3100c63-51b7-47af-b86d-9970af57e266 None None] MFA Rules not processed for user `6f638cc70c994a529a48cb2c92b70384`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:58:30.674571 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b3100c63-51b7-47af-b86d-9970af57e266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:30.794898 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1187/2362] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jul 4 05:58:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:58:30.806576 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5264a0-3367-45f8-a866-e2ac8e36c6a3 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:58:30.808590 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-2e5264a0-3367-45f8-a866-e2ac8e36c6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:30.872683 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5264a0-3367-45f8-a866-e2ac8e36c6a3 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:58:30.877617 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec598688-8c5b-4f78-a39c-781a2ca0181e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77f0477631724d7f9c8ba752ba27866d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:58:30.877915 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec598688-8c5b-4f78-a39c-781a2ca0181e service glance] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:30.878203 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec598688-8c5b-4f78-a39c-781a2ca0181e service glance] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:30.878643 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec598688-8c5b-4f78-a39c-781a2ca0181e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:30.892162 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec598688-8c5b-4f78-a39c-781a2ca0181e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:58:30.893836 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec598688-8c5b-4f78-a39c-781a2ca0181e service glance] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:58:30.906061 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1176/2363] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:58:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:58:30.975997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa5f37-df46-4b87-a39f-0913977e4df6 None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:30.975997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa5f37-df46-4b87-a39f-0913977e4df6 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:30.976213 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa5f37-df46-4b87-a39f-0913977e4df6 None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:30.977462 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1188/2364] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jul 4 05:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:58:30.982480 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c0558-9892-4934-9792-c1ff02cfbf9c None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:30.982800 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c0558-9892-4934-9792-c1ff02cfbf9c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:30.983170 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c0558-9892-4934-9792-c1ff02cfbf9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:31.014831 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-2e5c0558-9892-4934-9792-c1ff02cfbf9c None None] MFA Rules not processed for user `5e5be3de52e945d3af1b2cad1c84c755`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:58:31.015953 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-2e5c0558-9892-4934-9792-c1ff02cfbf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:31.083540 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1177/2365] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jul 4 05:58:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:58:31.096014 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa5f37-df46-4b87-a39f-0913977e4df6 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:58:31.097779 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c5aa5f37-df46-4b87-a39f-0913977e4df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:31.114350 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa5f37-df46-4b87-a39f-0913977e4df6 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:58:31.117885 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ca617-cf6c-4f91-8317-7b9b338d63dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:58:31.118521 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ca617-cf6c-4f91-8317-7b9b338d63dd service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:31.118798 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ca617-cf6c-4f91-8317-7b9b338d63dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:31.119069 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ca617-cf6c-4f91-8317-7b9b338d63dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:31.126441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ca617-cf6c-4f91-8317-7b9b338d63dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:58:31.127906 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ca617-cf6c-4f91-8317-7b9b338d63dd service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:58:31.135489 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1189/2366] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:58:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:58:31.224079 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45185248-68cb-45d6-85fd-7482bda174fb None None] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:31.224339 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45185248-68cb-45d6-85fd-7482bda174fb None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:31.224682 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45185248-68cb-45d6-85fd-7482bda174fb None None] PATH_INFO: `/` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:31.226205 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1178/2367] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jul 4 05:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 05:58:31.231559 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714ce60-0bc2-4d19-80c4-07055dcabd8b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:31.231852 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714ce60-0bc2-4d19-80c4-07055dcabd8b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:31.232123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714ce60-0bc2-4d19-80c4-07055dcabd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:31.252368 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6714ce60-0bc2-4d19-80c4-07055dcabd8b None None] MFA Rules not processed for user `6f638cc70c994a529a48cb2c92b70384`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:58:31.253732 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6714ce60-0bc2-4d19-80c4-07055dcabd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:31.268607 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1190/2368] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jul 4 05:58:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:58:31.279314 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45185248-68cb-45d6-85fd-7482bda174fb None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:58:31.281328 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-45185248-68cb-45d6-85fd-7482bda174fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:31.295859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45185248-68cb-45d6-85fd-7482bda174fb None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:58:31.299492 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3145d3-465d-4751-abb2-1b78c5b77352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:58:31.300209 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3145d3-465d-4751-abb2-1b78c5b77352 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:31.300654 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3145d3-465d-4751-abb2-1b78c5b77352 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:31.300902 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3145d3-465d-4751-abb2-1b78c5b77352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:31.312270 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3145d3-465d-4751-abb2-1b78c5b77352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:58:31.313930 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3145d3-465d-4751-abb2-1b78c5b77352 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:58:31.325473 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1179/2369] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:58:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:58:33.770673 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30042d-60b4-4783-ab29-7911a162ef79 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:33.771137 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30042d-60b4-4783-ab29-7911a162ef79 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:33.771265 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30042d-60b4-4783-ab29-7911a162ef79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:33.790316 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6a30042d-60b4-4783-ab29-7911a162ef79 None None] MFA Rules not processed for user `3ed779ae7e0f4c90aaed6d1f9e86a4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:58:33.791569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6a30042d-60b4-4783-ab29-7911a162ef79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:33.858789 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1191/2370] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jul 4 05:58:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:58:33.880127 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3145d3-465d-4751-abb2-1b78c5b77352 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:58:33.881568 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-1b3145d3-465d-4751-abb2-1b78c5b77352 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:33.957149 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3145d3-465d-4751-abb2-1b78c5b77352 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:58:33.962534 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386f766-3309-463f-9fe7-faf8d43c0d42 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55a1c343c60428db2d9e5e6ed865e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:58:33.963204 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386f766-3309-463f-9fe7-faf8d43c0d42 service swift] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:33.963501 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386f766-3309-463f-9fe7-faf8d43c0d42 service swift] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:33.963783 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386f766-3309-463f-9fe7-faf8d43c0d42 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:33.972115 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386f766-3309-463f-9fe7-faf8d43c0d42 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:58:33.973731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386f766-3309-463f-9fe7-faf8d43c0d42 service swift] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:58:33.982473 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1180/2371] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 4 05:58:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 05:58:43.850653 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=87 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:58:43.978899 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=96 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:58:50.283731 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eeb385-f14e-4a79-b1df-c4abf964bfbd None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:50.284679 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eeb385-f14e-4a79-b1df-c4abf964bfbd None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:50.284953 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eeb385-f14e-4a79-b1df-c4abf964bfbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:50.365022 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-96eeb385-f14e-4a79-b1df-c4abf964bfbd None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:58:50.366223 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-96eeb385-f14e-4a79-b1df-c4abf964bfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:50.444757 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1192/2372] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Jul 4 05:58:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:58:50.459629 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386f766-3309-463f-9fe7-faf8d43c0d42 service swift] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:58:50.461303 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d386f766-3309-463f-9fe7-faf8d43c0d42 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:50.511256 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386f766-3309-463f-9fe7-faf8d43c0d42 service swift] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:58:50.517256 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d4e1a-2e88-4a3f-a9c0-9f8796a6eac7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:58:50.517958 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d4e1a-2e88-4a3f-a9c0-9f8796a6eac7 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:50.518212 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d4e1a-2e88-4a3f-a9c0-9f8796a6eac7 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:50.518491 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d4e1a-2e88-4a3f-a9c0-9f8796a6eac7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:50.534119 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d4e1a-2e88-4a3f-a9c0-9f8796a6eac7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:58:50.535871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d4e1a-2e88-4a3f-a9c0-9f8796a6eac7 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:58:50.547469 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1181/2373] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:58:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:58:53.323630 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dedd78-ed89-4740-a6b0-9952259e9b80 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:53.324219 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dedd78-ed89-4740-a6b0-9952259e9b80 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:53.324219 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dedd78-ed89-4740-a6b0-9952259e9b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:53.343815 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d6dedd78-ed89-4740-a6b0-9952259e9b80 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:58:53.346902 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d6dedd78-ed89-4740-a6b0-9952259e9b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:53.355814 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1193/2374] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Jul 4 05:58:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:58:53.372743 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d4e1a-2e88-4a3f-a9c0-9f8796a6eac7 service nova] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:58:53.374268 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-5e1d4e1a-2e88-4a3f-a9c0-9f8796a6eac7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:53.389000 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d4e1a-2e88-4a3f-a9c0-9f8796a6eac7 service nova] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:58:53.395795 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0fed8-e4cf-455a-b107-bce7f834f675 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:58:53.396448 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0fed8-e4cf-455a-b107-bce7f834f675 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:53.396724 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0fed8-e4cf-455a-b107-bce7f834f675 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:53.396993 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0fed8-e4cf-455a-b107-bce7f834f675 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:53.405939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da0fed8-e4cf-455a-b107-bce7f834f675 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:58:53.407556 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da0fed8-e4cf-455a-b107-bce7f834f675 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:58:53.417192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1182/2375] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:58:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:58:54.828372 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceea5d4-93ef-43b1-9317-e24ab5278233 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:54.828892 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceea5d4-93ef-43b1-9317-e24ab5278233 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:54.829000 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceea5d4-93ef-43b1-9317-e24ab5278233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:54.858131 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-0ceea5d4-93ef-43b1-9317-e24ab5278233 None None] MFA Rules not processed for user `3ed779ae7e0f4c90aaed6d1f9e86a4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:58:54.859693 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0ceea5d4-93ef-43b1-9317-e24ab5278233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:54.867629 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1194/2376] 10.222.0.16 () {58 vars in 967 bytes} [Mon Jul 4 05:58:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:58:54.880725 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0fed8-e4cf-455a-b107-bce7f834f675 service nova] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:58:54.892230 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0fed8-e4cf-455a-b107-bce7f834f675 service nova] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:58:54.897977 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f355bb-1e72-478e-9e47-cec499d604c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55a1c343c60428db2d9e5e6ed865e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:58:54.898633 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f355bb-1e72-478e-9e47-cec499d604c2 service swift] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:54.898923 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f355bb-1e72-478e-9e47-cec499d604c2 service swift] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:54.899227 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f355bb-1e72-478e-9e47-cec499d604c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:54.908706 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f355bb-1e72-478e-9e47-cec499d604c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:58:54.910315 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f355bb-1e72-478e-9e47-cec499d604c2 service swift] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:58:54.918801 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1183/2377] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 4 05:58:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 05:58:57.652166 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527855c-8c28-435a-a20a-f1df2cb2d1a0 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:57.652769 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527855c-8c28-435a-a20a-f1df2cb2d1a0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:57.652769 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527855c-8c28-435a-a20a-f1df2cb2d1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:57.671691 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-8527855c-8c28-435a-a20a-f1df2cb2d1a0 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:58:57.672997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8527855c-8c28-435a-a20a-f1df2cb2d1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:58:57.681621 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1195/2378] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Jul 4 05:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:58:57.697748 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f355bb-1e72-478e-9e47-cec499d604c2 service swift] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:58:57.710444 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f355bb-1e72-478e-9e47-cec499d604c2 service swift] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:58:57.716089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13605ae2-412d-421b-ac74-3b6507910f38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:58:57.716761 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13605ae2-412d-421b-ac74-3b6507910f38 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:58:57.717039 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13605ae2-412d-421b-ac74-3b6507910f38 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:58:57.717316 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13605ae2-412d-421b-ac74-3b6507910f38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:58:57.726316 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13605ae2-412d-421b-ac74-3b6507910f38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:58:57.728021 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13605ae2-412d-421b-ac74-3b6507910f38 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:58:57.738405 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1184/2379] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:58:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:59:00.727712 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366b1fd-9732-4052-b0bb-619775b43310 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:59:00.728238 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366b1fd-9732-4052-b0bb-619775b43310 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:59:00.728238 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366b1fd-9732-4052-b0bb-619775b43310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:59:00.748422 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d366b1fd-9732-4052-b0bb-619775b43310 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:59:00.749630 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d366b1fd-9732-4052-b0bb-619775b43310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:59:00.758747 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1196/2380] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Jul 4 05:59:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:59:00.776798 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13605ae2-412d-421b-ac74-3b6507910f38 service nova] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:59:00.789037 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13605ae2-412d-421b-ac74-3b6507910f38 service nova] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:59:00.795212 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc190388-fbce-4505-bbba-776102588370 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:59:00.795807 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc190388-fbce-4505-bbba-776102588370 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:59:00.796087 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc190388-fbce-4505-bbba-776102588370 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:59:00.796358 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc190388-fbce-4505-bbba-776102588370 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:59:00.804537 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc190388-fbce-4505-bbba-776102588370 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:59:00.806120 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc190388-fbce-4505-bbba-776102588370 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:59:00.815455 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1185/2381] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:59:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:59:02.339791 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366b1fd-9732-4052-b0bb-619775b43310 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:59:02.342290 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d366b1fd-9732-4052-b0bb-619775b43310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:59:02.411848 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:59:02.436776 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366b1fd-9732-4052-b0bb-619775b43310 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:59:02.442230 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b031b-a42a-4f24-b171-8c2d09e53bb6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260f58535f4e46a197d00276d37fd515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:59:02.442880 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b031b-a42a-4f24-b171-8c2d09e53bb6 service placement] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:59:02.443163 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b031b-a42a-4f24-b171-8c2d09e53bb6 service placement] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:59:02.443468 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b031b-a42a-4f24-b171-8c2d09e53bb6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:59:02.445383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1e1b031b-a42a-4f24-b171-8c2d09e53bb6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:59:02.456781 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b031b-a42a-4f24-b171-8c2d09e53bb6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:59:02.458377 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b031b-a42a-4f24-b171-8c2d09e53bb6 service placement] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:59:02.468586 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1197/2382] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:59:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:59:04.948414 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87572b2-aeb6-4857-bfe8-248797a3ac2d None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:59:04.948932 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87572b2-aeb6-4857-bfe8-248797a3ac2d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:59:04.948932 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87572b2-aeb6-4857-bfe8-248797a3ac2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:59:04.968281 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-f87572b2-aeb6-4857-bfe8-248797a3ac2d None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:59:04.969530 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f87572b2-aeb6-4857-bfe8-248797a3ac2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:59:04.978273 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1186/2383] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Jul 4 05:59:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:59:05.001087 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b031b-a42a-4f24-b171-8c2d09e53bb6 service placement] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:59:05.013842 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b031b-a42a-4f24-b171-8c2d09e53bb6 service placement] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:59:05.020478 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d356db-08f7-4840-add4-a89fe1a778b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:59:05.021171 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d356db-08f7-4840-add4-a89fe1a778b9 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:59:05.021435 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d356db-08f7-4840-add4-a89fe1a778b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:59:05.021709 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d356db-08f7-4840-add4-a89fe1a778b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:59:05.030565 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d356db-08f7-4840-add4-a89fe1a778b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:59:05.032244 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d356db-08f7-4840-add4-a89fe1a778b9 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:59:05.041986 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1198/2384] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:59:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:59:08.148848 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453951a-fdd3-4c52-9cf2-92b8fc8dcd01 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:59:08.149676 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453951a-fdd3-4c52-9cf2-92b8fc8dcd01 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:59:08.149836 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453951a-fdd3-4c52-9cf2-92b8fc8dcd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:59:08.179968 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-9453951a-fdd3-4c52-9cf2-92b8fc8dcd01 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:59:08.181202 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9453951a-fdd3-4c52-9cf2-92b8fc8dcd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:59:08.194458 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1187/2385] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Jul 4 05:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:59:08.223770 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d356db-08f7-4840-add4-a89fe1a778b9 service nova] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:59:08.236264 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d356db-08f7-4840-add4-a89fe1a778b9 service nova] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:59:08.243530 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e9b2d-6354-4c81-98b4-54465b760ea6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:59:08.244199 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e9b2d-6354-4c81-98b4-54465b760ea6 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:59:08.244480 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e9b2d-6354-4c81-98b4-54465b760ea6 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:59:08.244748 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e9b2d-6354-4c81-98b4-54465b760ea6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:59:08.254128 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e9b2d-6354-4c81-98b4-54465b760ea6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:59:08.255765 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e9b2d-6354-4c81-98b4-54465b760ea6 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:59:08.265653 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1199/2386] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:59:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:59:18.173065 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=48 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:59:18.261072 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=23 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:59:24.675585 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a653339-ea64-41fa-a143-766a11e8933a None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:59:24.676198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a653339-ea64-41fa-a143-766a11e8933a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:59:24.676198 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a653339-ea64-41fa-a143-766a11e8933a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:59:24.694700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-3a653339-ea64-41fa-a143-766a11e8933a None None] MFA Rules not processed for user `e89c079feccd49618b4ae1b779ba04fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:59:24.696078 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-3a653339-ea64-41fa-a143-766a11e8933a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:59:24.753526 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1188/2387] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:59:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:59:34.746158 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=25 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 05:59:40.000304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25abc7-e477-4c5d-b64d-3f34912f776f None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:59:40.000800 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25abc7-e477-4c5d-b64d-3f34912f776f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:59:40.001602 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25abc7-e477-4c5d-b64d-3f34912f776f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:59:40.022759 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-5a25abc7-e477-4c5d-b64d-3f34912f776f None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:59:40.024575 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5a25abc7-e477-4c5d-b64d-3f34912f776f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:59:40.041227 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1200/2388] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Jul 4 05:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:59:40.065715 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a653339-ea64-41fa-a143-766a11e8933a None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:59:40.084505 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a653339-ea64-41fa-a143-766a11e8933a None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:59:40.090822 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf22e80-ab09-4ac5-b0f8-dc845aefcd60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:59:40.091824 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf22e80-ab09-4ac5-b0f8-dc845aefcd60 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:59:40.092238 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf22e80-ab09-4ac5-b0f8-dc845aefcd60 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:59:40.092745 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf22e80-ab09-4ac5-b0f8-dc845aefcd60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:59:40.102064 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf22e80-ab09-4ac5-b0f8-dc845aefcd60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:59:40.103939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf22e80-ab09-4ac5-b0f8-dc845aefcd60 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:59:40.119830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1189/2389] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:59:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:59:44.329301 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cbf6d-ded2-42e2-8122-4aed3b8cc911 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:59:44.329773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cbf6d-ded2-42e2-8122-4aed3b8cc911 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:59:44.329773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cbf6d-ded2-42e2-8122-4aed3b8cc911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:59:44.349665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-c15cbf6d-ded2-42e2-8122-4aed3b8cc911 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:59:44.350870 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c15cbf6d-ded2-42e2-8122-4aed3b8cc911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:59:44.359865 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1201/2390] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Jul 4 05:59:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:59:44.374265 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf22e80-ab09-4ac5-b0f8-dc845aefcd60 service nova] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:59:44.387340 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf22e80-ab09-4ac5-b0f8-dc845aefcd60 service nova] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:59:44.394959 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d3b96-c29e-45fa-ba02-3e73d44b44bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:59:44.396482 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d3b96-c29e-45fa-ba02-3e73d44b44bd service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:59:44.397096 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d3b96-c29e-45fa-ba02-3e73d44b44bd service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:59:44.397978 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d3b96-c29e-45fa-ba02-3e73d44b44bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:59:44.410522 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d3b96-c29e-45fa-ba02-3e73d44b44bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:59:44.412287 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d3b96-c29e-45fa-ba02-3e73d44b44bd service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:59:44.427456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1190/2391] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:59:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:59:48.411026 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192b228-a6bc-4deb-a452-9a5d6a929215 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:59:48.411567 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192b228-a6bc-4deb-a452-9a5d6a929215 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:59:48.411567 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192b228-a6bc-4deb-a452-9a5d6a929215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:59:48.430089 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6192b228-a6bc-4deb-a452-9a5d6a929215 None None] MFA Rules not processed for user `1c4799b3a1a046aba74e9a6117d4d532`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:59:48.437599 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6192b228-a6bc-4deb-a452-9a5d6a929215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:59:48.471615 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82de14f-a1f6-44ab-9427-15951d2c7cd2 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:59:48.472159 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82de14f-a1f6-44ab-9427-15951d2c7cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:59:48.472159 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82de14f-a1f6-44ab-9427-15951d2c7cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:59:48.492307 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d82de14f-a1f6-44ab-9427-15951d2c7cd2 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:59:48.493533 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d82de14f-a1f6-44ab-9427-15951d2c7cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:59:48.495510 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1202/2392] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:59:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:59:48.504997 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1191/2393] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Jul 4 05:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:59:48.664563 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192b228-a6bc-4deb-a452-9a5d6a929215 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:59:48.675493 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50a60f-1b69-4bd2-bc31-93bc25dc930c None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:59:48.675786 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50a60f-1b69-4bd2-bc31-93bc25dc930c None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:59:48.676065 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50a60f-1b69-4bd2-bc31-93bc25dc930c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:59:48.677508 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192b228-a6bc-4deb-a452-9a5d6a929215 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:59:48.684157 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4908348-0fbd-4dae-a658-9f2241a3a9ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:59:48.684961 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4908348-0fbd-4dae-a658-9f2241a3a9ed service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:59:48.685439 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4908348-0fbd-4dae-a658-9f2241a3a9ed service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:59:48.685811 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4908348-0fbd-4dae-a658-9f2241a3a9ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:59:48.694615 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-ce50a60f-1b69-4bd2-bc31-93bc25dc930c None None] MFA Rules not processed for user `bd06f1f3ff124acbaede2c9fb1f116a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:59:48.695851 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ce50a60f-1b69-4bd2-bc31-93bc25dc930c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:59:48.696696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4908348-0fbd-4dae-a658-9f2241a3a9ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:59:48.698599 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4908348-0fbd-4dae-a658-9f2241a3a9ed service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:59:48.710410 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1203/2394] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:59:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:59:48.767863 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1192/2395] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 05:59:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 05:59:51.620563 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d26bf-f6c6-430e-a4e9-d40cfacf1f6f None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:59:51.621089 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d26bf-f6c6-430e-a4e9-d40cfacf1f6f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:59:51.621220 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d26bf-f6c6-430e-a4e9-d40cfacf1f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:59:51.640250 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-f20d26bf-f6c6-430e-a4e9-d40cfacf1f6f None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:59:51.641455 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f20d26bf-f6c6-430e-a4e9-d40cfacf1f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:59:51.649414 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1204/2396] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Jul 4 05:59:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:59:51.667682 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50a60f-1b69-4bd2-bc31-93bc25dc930c None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:59:51.680874 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50a60f-1b69-4bd2-bc31-93bc25dc930c None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:59:51.686780 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3254b7-9e93-4dfe-a568-b5699353008b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:59:51.687482 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3254b7-9e93-4dfe-a568-b5699353008b service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:59:51.687762 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3254b7-9e93-4dfe-a568-b5699353008b service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:59:51.688035 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3254b7-9e93-4dfe-a568-b5699353008b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:59:51.697246 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3254b7-9e93-4dfe-a568-b5699353008b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:59:51.698854 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3254b7-9e93-4dfe-a568-b5699353008b service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:59:51.708841 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1193/2397] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:59:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 05:59:56.845692 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31182b-9379-4229-8912-f9c9e1b16d64 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:59:56.846263 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31182b-9379-4229-8912-f9c9e1b16d64 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:59:56.846387 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31182b-9379-4229-8912-f9c9e1b16d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:59:56.865349 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-1c31182b-9379-4229-8912-f9c9e1b16d64 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 05:59:56.866710 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1c31182b-9379-4229-8912-f9c9e1b16d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 05:59:56.874920 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1205/2398] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Jul 4 05:59:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 05:59:56.896528 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3254b7-9e93-4dfe-a568-b5699353008b service nova] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 05:59:56.908220 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3254b7-9e93-4dfe-a568-b5699353008b service nova] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 05:59:56.914889 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40367dad-a5a0-42f5-9604-9ba7f8e1f747 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 05:59:56.915594 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40367dad-a5a0-42f5-9604-9ba7f8e1f747 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 05:59:56.915879 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40367dad-a5a0-42f5-9604-9ba7f8e1f747 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 05:59:56.916159 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40367dad-a5a0-42f5-9604-9ba7f8e1f747 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 05:59:56.925428 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40367dad-a5a0-42f5-9604-9ba7f8e1f747 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 05:59:56.927039 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40367dad-a5a0-42f5-9604-9ba7f8e1f747 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 05:59:56.936777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1194/2399] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 05:59:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:00:06.860432 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=43 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:00:06.932399 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=52 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:00:15.851073 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf311ceb-f02b-4bcc-8baa-2f07ab584df0 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:15.851622 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf311ceb-f02b-4bcc-8baa-2f07ab584df0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:15.851622 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf311ceb-f02b-4bcc-8baa-2f07ab584df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:15.901327 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-cf311ceb-f02b-4bcc-8baa-2f07ab584df0 None None] MFA Rules not processed for user `3ed779ae7e0f4c90aaed6d1f9e86a4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:00:15.902617 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-cf311ceb-f02b-4bcc-8baa-2f07ab584df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:00:15.921279 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1206/2400] 10.222.0.16 () {58 vars in 967 bytes} [Mon Jul 4 06:00:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:00:15.970052 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40367dad-a5a0-42f5-9604-9ba7f8e1f747 service nova] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:00:15.991819 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40367dad-a5a0-42f5-9604-9ba7f8e1f747 service nova] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:00:15.997434 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3aaa2-45f3-4da9-bb41-ff9c84f22e35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55a1c343c60428db2d9e5e6ed865e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:00:15.998263 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3aaa2-45f3-4da9-bb41-ff9c84f22e35 service swift] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:15.998611 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3aaa2-45f3-4da9-bb41-ff9c84f22e35 service swift] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:15.998951 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3aaa2-45f3-4da9-bb41-ff9c84f22e35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:16.007599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3aaa2-45f3-4da9-bb41-ff9c84f22e35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:00:16.009312 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3aaa2-45f3-4da9-bb41-ff9c84f22e35 service swift] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:00:16.017545 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1195/2401] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 4 06:00:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 04 06:00:23.890480 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf311ceb-f02b-4bcc-8baa-2f07ab584df0 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:00:23.892625 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-cf311ceb-f02b-4bcc-8baa-2f07ab584df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:00:23.909944 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf311ceb-f02b-4bcc-8baa-2f07ab584df0 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:00:23.914945 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a027b6-03ef-484d-b9e4-337fc07cc25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:00:23.921965 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a027b6-03ef-484d-b9e4-337fc07cc25c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:23.921965 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a027b6-03ef-484d-b9e4-337fc07cc25c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:23.921965 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a027b6-03ef-484d-b9e4-337fc07cc25c admin admin] PATH_INFO: `/v3/users/112cd592351f402dab6472657bd4835d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:23.921965 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a027b6-03ef-484d-b9e4-337fc07cc25c admin admin] RBAC: Authorizing `identity:delete_user(user_id=112cd592351f402dab6472657bd4835d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:00:23.921965 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a027b6-03ef-484d-b9e4-337fc07cc25c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:00:23.939937 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749870b-6b38-43a2-94d4-60fcbe826a33 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:23.940516 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749870b-6b38-43a2-94d4-60fcbe826a33 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:23.940516 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749870b-6b38-43a2-94d4-60fcbe826a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:23.960273 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-5749870b-6b38-43a2-94d4-60fcbe826a33 None None] MFA Rules not processed for user `75f4eab7b971447bbe964e79fa6bf3c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:00:23.961719 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-5749870b-6b38-43a2-94d4-60fcbe826a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:00:23.980822 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-31a027b6-03ef-484d-b9e4-337fc07cc25c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '112cd592351f402dab6472657bd4835d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:23.989898 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-31a027b6-03ef-484d-b9e4-337fc07cc25c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '112cd592351f402dab6472657bd4835d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:24.000617 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-31a027b6-03ef-484d-b9e4-337fc07cc25c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '112cd592351f402dab6472657bd4835d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:24.001677 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-31a027b6-03ef-484d-b9e4-337fc07cc25c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '112cd592351f402dab6472657bd4835d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:24.016108 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-31a027b6-03ef-484d-b9e4-337fc07cc25c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '112cd592351f402dab6472657bd4835d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:24.021222 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1196/2402] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:00:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 06:00:24.022364 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1207/2403] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:00:23 2022] DELETE /identity/v3/users/112cd592351f402dab6472657bd4835d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:00:24.324636 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749870b-6b38-43a2-94d4-60fcbe826a33 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:00:24.326185 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-5749870b-6b38-43a2-94d4-60fcbe826a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:00:24.341560 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749870b-6b38-43a2-94d4-60fcbe826a33 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:00:24.405953 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8a159-fd9e-402e-b615-66e6feac03fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:00:24.406859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8a159-fd9e-402e-b615-66e6feac03fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:24.407134 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8a159-fd9e-402e-b615-66e6feac03fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:24.407431 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8a159-fd9e-402e-b615-66e6feac03fd admin admin] PATH_INFO: `/v3/projects/e6c12d2d77e04638ab0302f8375a1f60` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:24.408610 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8a159-fd9e-402e-b615-66e6feac03fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6c12d2d77e04638ab0302f8375a1f60)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:00:24.410513 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8a159-fd9e-402e-b615-66e6feac03fd admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:00:24.457742 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0bd8a159-fd9e-402e-b615-66e6feac03fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6c12d2d77e04638ab0302f8375a1f60', 'request_id': 'req-0bd8a159-fd9e-402e-b615-66e6feac03fd'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:24.465746 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0bd8a159-fd9e-402e-b615-66e6feac03fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6c12d2d77e04638ab0302f8375a1f60', 'request_id': 'req-0bd8a159-fd9e-402e-b615-66e6feac03fd'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:24.472538 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0bd8a159-fd9e-402e-b615-66e6feac03fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6c12d2d77e04638ab0302f8375a1f60', 'request_id': 'req-0bd8a159-fd9e-402e-b615-66e6feac03fd'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:24.483497 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0bd8a159-fd9e-402e-b615-66e6feac03fd admin admin] The token cache is being invalidate because project e6c12d2d77e04638ab0302f8375a1f60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:00:24.483782 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0bd8a159-fd9e-402e-b615-66e6feac03fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:24.484437 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0bd8a159-fd9e-402e-b615-66e6feac03fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:24.486029 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1197/2404] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:00:24 2022] DELETE /identity/v3/projects/e6c12d2d77e04638ab0302f8375a1f60 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:00:24.490146 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a027b6-03ef-484d-b9e4-337fc07cc25c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:00:24.501532 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a027b6-03ef-484d-b9e4-337fc07cc25c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:00:24.567916 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6c49f-2a85-42a3-a071-5883571f230e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:00:24.568799 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6c49f-2a85-42a3-a071-5883571f230e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:24.569074 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6c49f-2a85-42a3-a071-5883571f230e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:24.569423 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6c49f-2a85-42a3-a071-5883571f230e admin admin] PATH_INFO: `/v3/users/0df29ca4456044cd95e0f5e55b640ba8` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:24.570659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6c49f-2a85-42a3-a071-5883571f230e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0df29ca4456044cd95e0f5e55b640ba8)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:00:24.572918 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6c49f-2a85-42a3-a071-5883571f230e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:00:24.619568 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:00:24.631702 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0ff6c49f-2a85-42a3-a071-5883571f230e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0df29ca4456044cd95e0f5e55b640ba8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:24.638799 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0ff6c49f-2a85-42a3-a071-5883571f230e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0df29ca4456044cd95e0f5e55b640ba8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:24.646486 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0ff6c49f-2a85-42a3-a071-5883571f230e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0df29ca4456044cd95e0f5e55b640ba8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:24.647258 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0ff6c49f-2a85-42a3-a071-5883571f230e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0df29ca4456044cd95e0f5e55b640ba8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:24.659924 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-0ff6c49f-2a85-42a3-a071-5883571f230e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0df29ca4456044cd95e0f5e55b640ba8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:24.666416 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1208/2405] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:00:24 2022] DELETE /identity/v3/users/0df29ca4456044cd95e0f5e55b640ba8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:00:24.847145 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8a159-fd9e-402e-b615-66e6feac03fd admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:00:24.848691 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-0bd8a159-fd9e-402e-b615-66e6feac03fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:00:24.878993 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8a159-fd9e-402e-b615-66e6feac03fd admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:00:24.899247 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:00:24.965700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a86cdc-67c2-4b21-b02b-b133fe8901f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:00:24.966592 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a86cdc-67c2-4b21-b02b-b133fe8901f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:24.966871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a86cdc-67c2-4b21-b02b-b133fe8901f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:24.967445 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a86cdc-67c2-4b21-b02b-b133fe8901f2 admin admin] PATH_INFO: `/v3/projects/0f5ee7c846894708b86020c5d55669ee` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:24.969351 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a86cdc-67c2-4b21-b02b-b133fe8901f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f5ee7c846894708b86020c5d55669ee)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:00:24.972001 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a86cdc-67c2-4b21-b02b-b133fe8901f2 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:00:25.025087 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-91a86cdc-67c2-4b21-b02b-b133fe8901f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f5ee7c846894708b86020c5d55669ee', 'request_id': 'req-91a86cdc-67c2-4b21-b02b-b133fe8901f2'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:25.034068 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-91a86cdc-67c2-4b21-b02b-b133fe8901f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f5ee7c846894708b86020c5d55669ee', 'request_id': 'req-91a86cdc-67c2-4b21-b02b-b133fe8901f2'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:25.040505 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-91a86cdc-67c2-4b21-b02b-b133fe8901f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f5ee7c846894708b86020c5d55669ee', 'request_id': 'req-91a86cdc-67c2-4b21-b02b-b133fe8901f2'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:25.051197 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-91a86cdc-67c2-4b21-b02b-b133fe8901f2 admin admin] The token cache is being invalidate because project 0f5ee7c846894708b86020c5d55669ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:00:25.051569 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-91a86cdc-67c2-4b21-b02b-b133fe8901f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:25.052181 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-91a86cdc-67c2-4b21-b02b-b133fe8901f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:25.053776 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1198/2406] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:00:24 2022] DELETE /identity/v3/projects/0f5ee7c846894708b86020c5d55669ee => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:00:25.059013 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc168f-3b4c-45ac-8a61-f67c988a545b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:25.059522 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc168f-3b4c-45ac-8a61-f67c988a545b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:25.059522 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc168f-3b4c-45ac-8a61-f67c988a545b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:25.078338 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-15bc168f-3b4c-45ac-8a61-f67c988a545b None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:00:25.079601 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-15bc168f-3b4c-45ac-8a61-f67c988a545b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:00:25.145552 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1209/2407] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:00:25.153755 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed17758-53ae-47be-9fd3-0e7b3f98ea90 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:25.154039 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed17758-53ae-47be-9fd3-0e7b3f98ea90 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:25.154307 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed17758-53ae-47be-9fd3-0e7b3f98ea90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:25.174117 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-2ed17758-53ae-47be-9fd3-0e7b3f98ea90 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:00:25.175355 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-2ed17758-53ae-47be-9fd3-0e7b3f98ea90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:00:25.183301 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1199/2408] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:00:25.187690 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc168f-3b4c-45ac-8a61-f67c988a545b None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:00:25.200869 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc168f-3b4c-45ac-8a61-f67c988a545b None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:00:25.206138 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe37ba-1e05-447f-a62f-18d777707bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:00:25.206811 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe37ba-1e05-447f-a62f-18d777707bbc admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:25.207099 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe37ba-1e05-447f-a62f-18d777707bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:25.207412 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe37ba-1e05-447f-a62f-18d777707bbc admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:25.208174 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe37ba-1e05-447f-a62f-18d777707bbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 06:00:25.208483 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe37ba-1e05-447f-a62f-18d777707bbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:00:25.210188 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe37ba-1e05-447f-a62f-18d777707bbc admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:00:25.222405 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1210/2409] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 06:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 06:00:25.226782 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed17758-53ae-47be-9fd3-0e7b3f98ea90 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:00:25.236357 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed17758-53ae-47be-9fd3-0e7b3f98ea90 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:00:25.241329 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257da79c-4cc5-47de-9ddc-dcd692ca8bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:00:25.241989 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257da79c-4cc5-47de-9ddc-dcd692ca8bcf admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:25.242271 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257da79c-4cc5-47de-9ddc-dcd692ca8bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:25.242549 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257da79c-4cc5-47de-9ddc-dcd692ca8bcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:25.243273 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257da79c-4cc5-47de-9ddc-dcd692ca8bcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:00:25.245183 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257da79c-4cc5-47de-9ddc-dcd692ca8bcf admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:00:25.271910 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1200/2410] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:00:25 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 06:00:25.276382 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe37ba-1e05-447f-a62f-18d777707bbc admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:00:25.286962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe37ba-1e05-447f-a62f-18d777707bbc admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:00:25.348770 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d1835-cbe4-4cc2-a12b-0cdd53af5187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:00:25.349455 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d1835-cbe4-4cc2-a12b-0cdd53af5187 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:25.349740 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d1835-cbe4-4cc2-a12b-0cdd53af5187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:25.350033 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d1835-cbe4-4cc2-a12b-0cdd53af5187 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:25.350745 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d1835-cbe4-4cc2-a12b-0cdd53af5187 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:00:25.352720 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d1835-cbe4-4cc2-a12b-0cdd53af5187 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:00:25.376222 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1211/2411] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:00:25 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:00:25.380557 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257da79c-4cc5-47de-9ddc-dcd692ca8bcf admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:00:25.391314 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257da79c-4cc5-47de-9ddc-dcd692ca8bcf admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:00:25.396525 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd367d-2f8b-400b-9d9f-be49e7b71fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:00:25.397307 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd367d-2f8b-400b-9d9f-be49e7b71fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:25.397599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd367d-2f8b-400b-9d9f-be49e7b71fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:25.397857 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd367d-2f8b-400b-9d9f-be49e7b71fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:25.398610 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd367d-2f8b-400b-9d9f-be49e7b71fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:00:25.400284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd367d-2f8b-400b-9d9f-be49e7b71fd7 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:00:25.414826 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1201/2412] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 06:00:25.420474 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d1835-cbe4-4cc2-a12b-0cdd53af5187 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:00:25.431001 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d1835-cbe4-4cc2-a12b-0cdd53af5187 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:00:25.436567 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774fa459-c13b-44cd-a60a-166511f57bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:00:25.437187 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fa459-c13b-44cd-a60a-166511f57bbb admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:25.437503 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fa459-c13b-44cd-a60a-166511f57bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:25.437774 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fa459-c13b-44cd-a60a-166511f57bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:25.438534 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774fa459-c13b-44cd-a60a-166511f57bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:00:25.440150 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774fa459-c13b-44cd-a60a-166511f57bbb admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:00:25.450560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1212/2413] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 06:00:25.457091 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd367d-2f8b-400b-9d9f-be49e7b71fd7 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:00:25.468472 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd367d-2f8b-400b-9d9f-be49e7b71fd7 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:00:25.473975 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339226a-64bc-40a4-971c-d3117ff55302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:00:25.474896 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339226a-64bc-40a4-971c-d3117ff55302 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:25.475247 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339226a-64bc-40a4-971c-d3117ff55302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:25.475522 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339226a-64bc-40a4-971c-d3117ff55302 admin admin] PATH_INFO: `/v3/projects/8c6f85dcc05643bd875994a6635a2aeb/users/48f8e070f93240119ac3ba6f20edf1e6/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:25.491367 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6339226a-64bc-40a4-971c-d3117ff55302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c6f85dcc05643bd875994a6635a2aeb, user_id=48f8e070f93240119ac3ba6f20edf1e6, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:00:25.494030 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6339226a-64bc-40a4-971c-d3117ff55302 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:00:25.509022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1202/2414] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:00:25 2022] PUT /identity/v3/projects/8c6f85dcc05643bd875994a6635a2aeb/users/48f8e070f93240119ac3ba6f20edf1e6/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:00:25.515983 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40050dc5-5a0f-4f82-ac30-a699c909d886 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:25.516273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40050dc5-5a0f-4f82-ac30-a699c909d886 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:25.516551 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40050dc5-5a0f-4f82-ac30-a699c909d886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:25.536813 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-40050dc5-5a0f-4f82-ac30-a699c909d886 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:00:25.538108 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-40050dc5-5a0f-4f82-ac30-a699c909d886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:00:25.551393 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:00:25.608774 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1213/2415] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:00:25.620249 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339226a-64bc-40a4-971c-d3117ff55302 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:00:25.622186 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-6339226a-64bc-40a4-971c-d3117ff55302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:00:25.673606 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:00:25.692359 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339226a-64bc-40a4-971c-d3117ff55302 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:00:25.696673 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7141a0b-9c65-4776-9d80-66c3333033b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:00:25.697305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7141a0b-9c65-4776-9d80-66c3333033b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:25.697588 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7141a0b-9c65-4776-9d80-66c3333033b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:25.697870 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7141a0b-9c65-4776-9d80-66c3333033b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:25.709457 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7141a0b-9c65-4776-9d80-66c3333033b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:00:25.711001 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7141a0b-9c65-4776-9d80-66c3333033b2 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:00:25.721529 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1203/2416] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:00:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:00:27.329446 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40050dc5-5a0f-4f82-ac30-a699c909d886 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:00:27.330980 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-40050dc5-5a0f-4f82-ac30-a699c909d886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:00:27.351415 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40050dc5-5a0f-4f82-ac30-a699c909d886 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:00:27.368579 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94143899-4313-47e2-bab5-4c9fd1033658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:00:27.369552 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94143899-4313-47e2-bab5-4c9fd1033658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:27.370000 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94143899-4313-47e2-bab5-4c9fd1033658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:27.371144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94143899-4313-47e2-bab5-4c9fd1033658 admin admin] PATH_INFO: `/v3/users/e89c079feccd49618b4ae1b779ba04fa` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:27.379474 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94143899-4313-47e2-bab5-4c9fd1033658 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e89c079feccd49618b4ae1b779ba04fa)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:00:27.381983 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94143899-4313-47e2-bab5-4c9fd1033658 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:00:27.502405 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-94143899-4313-47e2-bab5-4c9fd1033658 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e89c079feccd49618b4ae1b779ba04fa'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:27.517708 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-94143899-4313-47e2-bab5-4c9fd1033658 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e89c079feccd49618b4ae1b779ba04fa'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:27.543617 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-94143899-4313-47e2-bab5-4c9fd1033658 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e89c079feccd49618b4ae1b779ba04fa'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:27.544501 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-94143899-4313-47e2-bab5-4c9fd1033658 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e89c079feccd49618b4ae1b779ba04fa'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:27.591226 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-94143899-4313-47e2-bab5-4c9fd1033658 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e89c079feccd49618b4ae1b779ba04fa'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:27.608551 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1214/2417] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:00:27 2022] DELETE /identity/v3/users/e89c079feccd49618b4ae1b779ba04fa => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:00:28.071720 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7141a0b-9c65-4776-9d80-66c3333033b2 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:00:28.096881 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7141a0b-9c65-4776-9d80-66c3333033b2 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:00:28.184907 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2489ec9-d816-46a8-9171-df4783278637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:00:28.186072 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2489ec9-d816-46a8-9171-df4783278637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:28.186433 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2489ec9-d816-46a8-9171-df4783278637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:28.186779 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2489ec9-d816-46a8-9171-df4783278637 admin admin] PATH_INFO: `/v3/projects/bae9ff3418f34cdc9ab33323ef92e09b` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:28.188547 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2489ec9-d816-46a8-9171-df4783278637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bae9ff3418f34cdc9ab33323ef92e09b)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:00:28.190852 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2489ec9-d816-46a8-9171-df4783278637 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:00:28.253168 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f2489ec9-d816-46a8-9171-df4783278637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bae9ff3418f34cdc9ab33323ef92e09b', 'request_id': 'req-f2489ec9-d816-46a8-9171-df4783278637'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:28.268087 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f2489ec9-d816-46a8-9171-df4783278637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bae9ff3418f34cdc9ab33323ef92e09b', 'request_id': 'req-f2489ec9-d816-46a8-9171-df4783278637'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:28.280269 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f2489ec9-d816-46a8-9171-df4783278637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bae9ff3418f34cdc9ab33323ef92e09b', 'request_id': 'req-f2489ec9-d816-46a8-9171-df4783278637'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:28.296037 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f2489ec9-d816-46a8-9171-df4783278637 admin admin] The token cache is being invalidate because project bae9ff3418f34cdc9ab33323ef92e09b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:00:28.296450 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f2489ec9-d816-46a8-9171-df4783278637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:28.297166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f2489ec9-d816-46a8-9171-df4783278637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:28.298977 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1204/2418] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:00:28 2022] DELETE /identity/v3/projects/bae9ff3418f34cdc9ab33323ef92e09b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:00:31.103432 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fdd59-1e0a-488e-b293-d9056dcacf6c None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:31.104001 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fdd59-1e0a-488e-b293-d9056dcacf6c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:31.104131 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fdd59-1e0a-488e-b293-d9056dcacf6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:31.134585 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-500fdd59-1e0a-488e-b293-d9056dcacf6c None None] MFA Rules not processed for user `48f8e070f93240119ac3ba6f20edf1e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:00:31.136008 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-500fdd59-1e0a-488e-b293-d9056dcacf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:00:31.207644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1215/2419] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:00:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:00:31.212393 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2489ec9-d816-46a8-9171-df4783278637 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:00:31.213939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f2489ec9-d816-46a8-9171-df4783278637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:00:31.286133 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2489ec9-d816-46a8-9171-df4783278637 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:00:31.292881 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c37afa-a3b9-4b71-b5aa-557817dd1ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:00:31.293777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c37afa-a3b9-4b71-b5aa-557817dd1ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:31.294185 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c37afa-a3b9-4b71-b5aa-557817dd1ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:31.294599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c37afa-a3b9-4b71-b5aa-557817dd1ff7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:31.295772 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c37afa-a3b9-4b71-b5aa-557817dd1ff7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:00:31.298092 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c37afa-a3b9-4b71-b5aa-557817dd1ff7 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:00:31.320418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:00:31.329121 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1205/2420] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:00:31 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:00:31.333175 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500fdd59-1e0a-488e-b293-d9056dcacf6c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:00:31.344671 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500fdd59-1e0a-488e-b293-d9056dcacf6c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:00:31.362055 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:00:31.416733 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b28dc-95a7-4dc0-983b-8aefb75f8fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:00:31.417455 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b28dc-95a7-4dc0-983b-8aefb75f8fea admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:31.417734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b28dc-95a7-4dc0-983b-8aefb75f8fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:31.418010 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b28dc-95a7-4dc0-983b-8aefb75f8fea admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:31.418708 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b28dc-95a7-4dc0-983b-8aefb75f8fea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:00:31.420796 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b28dc-95a7-4dc0-983b-8aefb75f8fea admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:00:31.444021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1216/2421] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:00:31 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:00:31.448228 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c37afa-a3b9-4b71-b5aa-557817dd1ff7 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:00:31.458454 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c37afa-a3b9-4b71-b5aa-557817dd1ff7 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:00:31.463087 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71c629-2b3c-49e9-9ed2-611def05e096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:00:31.463799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71c629-2b3c-49e9-9ed2-611def05e096 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:31.464083 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71c629-2b3c-49e9-9ed2-611def05e096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:31.464360 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71c629-2b3c-49e9-9ed2-611def05e096 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:31.465087 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71c629-2b3c-49e9-9ed2-611def05e096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:00:31.466719 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71c629-2b3c-49e9-9ed2-611def05e096 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:00:31.485712 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1206/2422] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 06:00:31.489782 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b28dc-95a7-4dc0-983b-8aefb75f8fea admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:00:31.501133 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b28dc-95a7-4dc0-983b-8aefb75f8fea admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:00:31.509298 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc6a85-f471-45cc-9ba4-0268e7978593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:00:31.510600 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc6a85-f471-45cc-9ba4-0268e7978593 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:31.510600 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc6a85-f471-45cc-9ba4-0268e7978593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:31.510799 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc6a85-f471-45cc-9ba4-0268e7978593 admin admin] PATH_INFO: `/v3/projects/0873793ef3ab483f860468b6d0103693/users/9dd821111a5d4759b37153a1d53c77d4/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:31.527915 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc6a85-f471-45cc-9ba4-0268e7978593 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0873793ef3ab483f860468b6d0103693, user_id=9dd821111a5d4759b37153a1d53c77d4, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:00:31.530569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc6a85-f471-45cc-9ba4-0268e7978593 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:00:31.551161 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1217/2423] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:00:31 2022] PUT /identity/v3/projects/0873793ef3ab483f860468b6d0103693/users/9dd821111a5d4759b37153a1d53c77d4/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:00:31.555744 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71c629-2b3c-49e9-9ed2-611def05e096 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:00:31.565973 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71c629-2b3c-49e9-9ed2-611def05e096 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:00:31.632500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42235337-6ef6-4238-8ef6-5cabfd2a08d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:00:31.633251 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42235337-6ef6-4238-8ef6-5cabfd2a08d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:31.633534 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42235337-6ef6-4238-8ef6-5cabfd2a08d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:31.633809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42235337-6ef6-4238-8ef6-5cabfd2a08d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:31.634567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42235337-6ef6-4238-8ef6-5cabfd2a08d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:00:31.636219 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42235337-6ef6-4238-8ef6-5cabfd2a08d1 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:00:31.647275 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1207/2424] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:00:31.651499 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc6a85-f471-45cc-9ba4-0268e7978593 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:00:31.662528 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc6a85-f471-45cc-9ba4-0268e7978593 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:00:31.667540 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535558a-ad8c-4759-bc79-e8fd1b30a0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:00:31.668455 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535558a-ad8c-4759-bc79-e8fd1b30a0a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:31.668739 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535558a-ad8c-4759-bc79-e8fd1b30a0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:31.669014 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535558a-ad8c-4759-bc79-e8fd1b30a0a6 admin admin] PATH_INFO: `/v3/projects/0873793ef3ab483f860468b6d0103693/users/9dd821111a5d4759b37153a1d53c77d4/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:31.671047 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535558a-ad8c-4759-bc79-e8fd1b30a0a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0873793ef3ab483f860468b6d0103693, user_id=9dd821111a5d4759b37153a1d53c77d4, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:00:31.673749 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535558a-ad8c-4759-bc79-e8fd1b30a0a6 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:00:31.684713 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1218/2425] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:00:31 2022] PUT /identity/v3/projects/0873793ef3ab483f860468b6d0103693/users/9dd821111a5d4759b37153a1d53c77d4/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:00:36.459681 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e73586-f86f-4372-b642-24788c95d241 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:36.460142 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e73586-f86f-4372-b642-24788c95d241 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:36.460257 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e73586-f86f-4372-b642-24788c95d241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:36.519538 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-04e73586-f86f-4372-b642-24788c95d241 None None] MFA Rules not processed for user `9dd821111a5d4759b37153a1d53c77d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:00:36.520999 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-04e73586-f86f-4372-b642-24788c95d241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:00:36.678990 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1208/2426] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:00:36 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:00:36.700508 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535558a-ad8c-4759-bc79-e8fd1b30a0a6 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:00:36.702383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9535558a-ad8c-4759-bc79-e8fd1b30a0a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:00:36.830563 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535558a-ad8c-4759-bc79-e8fd1b30a0a6 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:00:36.838617 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c3a23-7602-4e2b-849f-1078fea32c6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:00:36.841205 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c3a23-7602-4e2b-849f-1078fea32c6e service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:36.841597 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c3a23-7602-4e2b-849f-1078fea32c6e service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:36.841967 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c3a23-7602-4e2b-849f-1078fea32c6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:36.951753 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c3a23-7602-4e2b-849f-1078fea32c6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:00:36.953667 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c3a23-7602-4e2b-849f-1078fea32c6e service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:00:36.964978 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1219/2427] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:00:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:00:38.160781 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6abb1e-454b-4987-ab11-1cf3daa7f4a9 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:38.161320 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6abb1e-454b-4987-ab11-1cf3daa7f4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:38.161320 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6abb1e-454b-4987-ab11-1cf3daa7f4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:38.181300 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-5d6abb1e-454b-4987-ab11-1cf3daa7f4a9 None None] MFA Rules not processed for user `48f8e070f93240119ac3ba6f20edf1e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:00:38.182710 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-5d6abb1e-454b-4987-ab11-1cf3daa7f4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:00:38.190285 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1209/2428] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:00:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:00:46.960451 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=91,keystone:INSERT=5 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:00:48.174909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=72 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:00:54.910108 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c3a23-7602-4e2b-849f-1078fea32c6e service nova] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:00:54.911950 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-923c3a23-7602-4e2b-849f-1078fea32c6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:00:54.980923 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c3a23-7602-4e2b-849f-1078fea32c6e service nova] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:00:54.985390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792c41c-f9b7-4530-8e60-c9624078b4f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:00:54.986047 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792c41c-f9b7-4530-8e60-c9624078b4f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:54.986490 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792c41c-f9b7-4530-8e60-c9624078b4f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:54.986775 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792c41c-f9b7-4530-8e60-c9624078b4f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:54.988719 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7792c41c-f9b7-4530-8e60-c9624078b4f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:00:55.057495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792c41c-f9b7-4530-8e60-c9624078b4f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:00:55.059090 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792c41c-f9b7-4530-8e60-c9624078b4f3 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:00:55.070607 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1220/2429] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:00:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:00:56.804383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6abb1e-454b-4987-ab11-1cf3daa7f4a9 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:00:56.815318 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6abb1e-454b-4987-ab11-1cf3daa7f4a9 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:00:56.820018 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42c0a1-1f92-4914-a46a-68ab67b0add4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:00:56.820786 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42c0a1-1f92-4914-a46a-68ab67b0add4 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:56.821122 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42c0a1-1f92-4914-a46a-68ab67b0add4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:56.821651 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42c0a1-1f92-4914-a46a-68ab67b0add4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:56.823764 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-bc42c0a1-1f92-4914-a46a-68ab67b0add4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:00:56.838709 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42c0a1-1f92-4914-a46a-68ab67b0add4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:00:56.840208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42c0a1-1f92-4914-a46a-68ab67b0add4 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:00:56.851931 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1210/2430] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:00:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:00:57.179234 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792c41c-f9b7-4530-8e60-c9624078b4f3 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:00:57.182019 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7792c41c-f9b7-4530-8e60-c9624078b4f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:00:57.194849 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792c41c-f9b7-4530-8e60-c9624078b4f3 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:00:57.198568 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67b977-118c-446c-883f-b2b634003ca9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:00:57.199269 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67b977-118c-446c-883f-b2b634003ca9 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:57.199557 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67b977-118c-446c-883f-b2b634003ca9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:57.199834 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67b977-118c-446c-883f-b2b634003ca9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:57.204077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6e67b977-118c-446c-883f-b2b634003ca9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:00:57.218331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67b977-118c-446c-883f-b2b634003ca9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:00:57.219940 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67b977-118c-446c-883f-b2b634003ca9 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:00:57.236091 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1221/2431] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:00:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:00:59.052512 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42c0a1-1f92-4914-a46a-68ab67b0add4 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:00:59.055366 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-bc42c0a1-1f92-4914-a46a-68ab67b0add4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:00:59.069931 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42c0a1-1f92-4914-a46a-68ab67b0add4 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:00:59.074383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0155795-c188-4c33-9b80-83e386d646a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:00:59.075305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0155795-c188-4c33-9b80-83e386d646a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:59.075587 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0155795-c188-4c33-9b80-83e386d646a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:59.075877 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0155795-c188-4c33-9b80-83e386d646a1 admin admin] PATH_INFO: `/v3/users/bd06f1f3ff124acbaede2c9fb1f116a0` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:59.077038 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0155795-c188-4c33-9b80-83e386d646a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd06f1f3ff124acbaede2c9fb1f116a0)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:00:59.079031 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0155795-c188-4c33-9b80-83e386d646a1 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:00:59.130799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f0155795-c188-4c33-9b80-83e386d646a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd06f1f3ff124acbaede2c9fb1f116a0'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:59.131410 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f0155795-c188-4c33-9b80-83e386d646a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd06f1f3ff124acbaede2c9fb1f116a0'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:59.141284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f0155795-c188-4c33-9b80-83e386d646a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd06f1f3ff124acbaede2c9fb1f116a0'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:59.141928 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f0155795-c188-4c33-9b80-83e386d646a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd06f1f3ff124acbaede2c9fb1f116a0'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:59.154709 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f0155795-c188-4c33-9b80-83e386d646a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd06f1f3ff124acbaede2c9fb1f116a0'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:59.173646 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1211/2432] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:00:59 2022] DELETE /identity/v3/users/bd06f1f3ff124acbaede2c9fb1f116a0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:00:59.379484 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67b977-118c-446c-883f-b2b634003ca9 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:00:59.393147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67b977-118c-446c-883f-b2b634003ca9 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:00:59.479157 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad89501-b2dd-4d60-87bd-eb547cf114a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:00:59.480042 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad89501-b2dd-4d60-87bd-eb547cf114a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:59.480751 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad89501-b2dd-4d60-87bd-eb547cf114a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:59.481028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad89501-b2dd-4d60-87bd-eb547cf114a4 admin admin] PATH_INFO: `/v3/projects/9550f8cb26ff4319ab4706466fc22f11` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:59.482227 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad89501-b2dd-4d60-87bd-eb547cf114a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9550f8cb26ff4319ab4706466fc22f11)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:00:59.484213 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad89501-b2dd-4d60-87bd-eb547cf114a4 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:00:59.529370 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:00:59.543158 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-cad89501-b2dd-4d60-87bd-eb547cf114a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9550f8cb26ff4319ab4706466fc22f11', 'request_id': 'req-cad89501-b2dd-4d60-87bd-eb547cf114a4'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:59.550170 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-cad89501-b2dd-4d60-87bd-eb547cf114a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9550f8cb26ff4319ab4706466fc22f11', 'request_id': 'req-cad89501-b2dd-4d60-87bd-eb547cf114a4'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:59.558822 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-cad89501-b2dd-4d60-87bd-eb547cf114a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9550f8cb26ff4319ab4706466fc22f11', 'request_id': 'req-cad89501-b2dd-4d60-87bd-eb547cf114a4'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:59.571351 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-cad89501-b2dd-4d60-87bd-eb547cf114a4 admin admin] The token cache is being invalidate because project 9550f8cb26ff4319ab4706466fc22f11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:00:59.571644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-cad89501-b2dd-4d60-87bd-eb547cf114a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:59.572292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-cad89501-b2dd-4d60-87bd-eb547cf114a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:00:59.573878 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1222/2433] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:00:59 2022] DELETE /identity/v3/projects/9550f8cb26ff4319ab4706466fc22f11 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:00:59.584285 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637466b2-1755-4ee5-b15c-74652dde3d57 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:59.584572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637466b2-1755-4ee5-b15c-74652dde3d57 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:59.584846 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637466b2-1755-4ee5-b15c-74652dde3d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:59.602914 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-637466b2-1755-4ee5-b15c-74652dde3d57 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:00:59.604271 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-637466b2-1755-4ee5-b15c-74652dde3d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:00:59.683633 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1212/2434] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:00:59.685314 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15a860-5554-4760-8ad5-92c9096dba90 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:59.685726 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15a860-5554-4760-8ad5-92c9096dba90 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:59.685856 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15a860-5554-4760-8ad5-92c9096dba90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:59.705261 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-7f15a860-5554-4760-8ad5-92c9096dba90 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:00:59.706466 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7f15a860-5554-4760-8ad5-92c9096dba90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:00:59.714388 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1223/2435] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:00:59.718630 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637466b2-1755-4ee5-b15c-74652dde3d57 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:00:59.728352 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637466b2-1755-4ee5-b15c-74652dde3d57 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:00:59.733403 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d46b8-bdf8-42d0-9110-bae67598d95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:00:59.734099 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d46b8-bdf8-42d0-9110-bae67598d95d admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:59.734384 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d46b8-bdf8-42d0-9110-bae67598d95d admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:59.734660 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d46b8-bdf8-42d0-9110-bae67598d95d admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:59.735509 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d46b8-bdf8-42d0-9110-bae67598d95d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 06:00:59.735958 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d46b8-bdf8-42d0-9110-bae67598d95d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:00:59.737654 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d46b8-bdf8-42d0-9110-bae67598d95d admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:00:59.750851 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1213/2436] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 06:00:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 06:00:59.755426 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15a860-5554-4760-8ad5-92c9096dba90 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:00:59.765309 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15a860-5554-4760-8ad5-92c9096dba90 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:00:59.770307 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8219f-502f-43db-a621-ab95fae8ff83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:00:59.771500 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8219f-502f-43db-a621-ab95fae8ff83 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:59.771878 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8219f-502f-43db-a621-ab95fae8ff83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:59.772219 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8219f-502f-43db-a621-ab95fae8ff83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:59.772983 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8219f-502f-43db-a621-ab95fae8ff83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:00:59.774978 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8219f-502f-43db-a621-ab95fae8ff83 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:00:59.806954 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1224/2437] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:00:59 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:00:59.808426 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d46b8-bdf8-42d0-9110-bae67598d95d admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:00:59.819325 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d46b8-bdf8-42d0-9110-bae67598d95d admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:00:59.869291 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:00:59.885498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a7206-b88f-4683-8c58-c9d60e042673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:00:59.886187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a7206-b88f-4683-8c58-c9d60e042673 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:59.886469 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a7206-b88f-4683-8c58-c9d60e042673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:59.886747 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a7206-b88f-4683-8c58-c9d60e042673 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:59.887484 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a7206-b88f-4683-8c58-c9d60e042673 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:00:59.889462 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a7206-b88f-4683-8c58-c9d60e042673 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:00:59.915207 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1214/2438] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:00:59 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:00:59.916705 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8219f-502f-43db-a621-ab95fae8ff83 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:00:59.927826 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8219f-502f-43db-a621-ab95fae8ff83 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:00:59.932556 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebdbd8-7f35-4fac-a534-3181979cb8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:00:59.933241 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebdbd8-7f35-4fac-a534-3181979cb8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:59.933517 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebdbd8-7f35-4fac-a534-3181979cb8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:59.933789 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebdbd8-7f35-4fac-a534-3181979cb8e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:59.934549 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bebdbd8-7f35-4fac-a534-3181979cb8e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:00:59.936219 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bebdbd8-7f35-4fac-a534-3181979cb8e2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:00:59.947897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1225/2439] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:00:59.952062 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a7206-b88f-4683-8c58-c9d60e042673 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:00:59.963474 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a7206-b88f-4683-8c58-c9d60e042673 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:00:59.969573 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc38190-fc57-42e9-a8c8-87f9374c0922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:00:59.970355 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc38190-fc57-42e9-a8c8-87f9374c0922 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:00:59.970701 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc38190-fc57-42e9-a8c8-87f9374c0922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:00:59.971026 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc38190-fc57-42e9-a8c8-87f9374c0922 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:00:59.971888 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc38190-fc57-42e9-a8c8-87f9374c0922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:00:59.973523 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc38190-fc57-42e9-a8c8-87f9374c0922 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:00:59.985422 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1215/2440] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:00:59.990057 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebdbd8-7f35-4fac-a534-3181979cb8e2 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:00.000478 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebdbd8-7f35-4fac-a534-3181979cb8e2 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:00.005401 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d7162-a792-4656-9829-d045692290a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:00.006298 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d7162-a792-4656-9829-d045692290a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:00.006577 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d7162-a792-4656-9829-d045692290a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:00.006853 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d7162-a792-4656-9829-d045692290a2 admin admin] PATH_INFO: `/v3/projects/8a5c0cb9a959456b87c56a4901ff2794/users/b7b9d5cc5bdb4289859e179ebf29646a/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:00.022011 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d7162-a792-4656-9829-d045692290a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a5c0cb9a959456b87c56a4901ff2794, user_id=b7b9d5cc5bdb4289859e179ebf29646a, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:00.026957 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d7162-a792-4656-9829-d045692290a2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:00.043724 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1226/2441] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:00:59 2022] PUT /identity/v3/projects/8a5c0cb9a959456b87c56a4901ff2794/users/b7b9d5cc5bdb4289859e179ebf29646a/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 06:01:00.055080 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ae0fe-6f51-408c-bfe9-af96ae57cfee None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:00.056161 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ae0fe-6f51-408c-bfe9-af96ae57cfee None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:00.056454 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ae0fe-6f51-408c-bfe9-af96ae57cfee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:00.084408 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-996ae0fe-6f51-408c-bfe9-af96ae57cfee None None] MFA Rules not processed for user `b7b9d5cc5bdb4289859e179ebf29646a`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:00.085624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-996ae0fe-6f51-408c-bfe9-af96ae57cfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:00.166166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1216/2442] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:01:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:01:00.171077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d7162-a792-4656-9829-d045692290a2 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:00.235648 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d7162-a792-4656-9829-d045692290a2 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:00.241495 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e004b8-19f0-4afd-9a74-977ac73d62f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:00.242158 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e004b8-19f0-4afd-9a74-977ac73d62f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:00.242441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e004b8-19f0-4afd-9a74-977ac73d62f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:00.242717 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e004b8-19f0-4afd-9a74-977ac73d62f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:00.243432 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e004b8-19f0-4afd-9a74-977ac73d62f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:00.245368 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e004b8-19f0-4afd-9a74-977ac73d62f9 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:00.273946 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1227/2443] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:01:00 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:01:00.278695 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ae0fe-6f51-408c-bfe9-af96ae57cfee None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:00.292661 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ae0fe-6f51-408c-bfe9-af96ae57cfee None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:00.352548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22587989-7701-4977-ae44-eba0d84d20b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:00.353137 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22587989-7701-4977-ae44-eba0d84d20b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:00.353423 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22587989-7701-4977-ae44-eba0d84d20b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:00.353724 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22587989-7701-4977-ae44-eba0d84d20b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:00.354429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22587989-7701-4977-ae44-eba0d84d20b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:00.356734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22587989-7701-4977-ae44-eba0d84d20b9 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:00.378811 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1217/2444] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:01:00 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 06:01:00.383039 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e004b8-19f0-4afd-9a74-977ac73d62f9 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:00.394262 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e004b8-19f0-4afd-9a74-977ac73d62f9 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:00.399725 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8879679-767b-4fdb-ab73-756736128691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:00.400413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8879679-767b-4fdb-ab73-756736128691 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:00.400694 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8879679-767b-4fdb-ab73-756736128691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:00.400967 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8879679-767b-4fdb-ab73-756736128691 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:00.401688 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8879679-767b-4fdb-ab73-756736128691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:00.403371 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8879679-767b-4fdb-ab73-756736128691 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:00.414583 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1228/2445] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:01:00.420407 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22587989-7701-4977-ae44-eba0d84d20b9 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:00.435257 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22587989-7701-4977-ae44-eba0d84d20b9 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:00.443284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012717b-f202-42b0-becc-df936db9194d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:00.444158 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012717b-f202-42b0-becc-df936db9194d admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:00.444433 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012717b-f202-42b0-becc-df936db9194d admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:00.444708 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012717b-f202-42b0-becc-df936db9194d admin admin] PATH_INFO: `/v3/projects/c2dcd144fa7341058a9a8caf6b398982/users/3458c529049f4fbcac5ca2bacf182835/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:00.460747 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012717b-f202-42b0-becc-df936db9194d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2dcd144fa7341058a9a8caf6b398982, user_id=3458c529049f4fbcac5ca2bacf182835, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:00.463534 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012717b-f202-42b0-becc-df936db9194d admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:00.479927 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1218/2446] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:01:00 2022] PUT /identity/v3/projects/c2dcd144fa7341058a9a8caf6b398982/users/3458c529049f4fbcac5ca2bacf182835/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:01:00.484673 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8879679-767b-4fdb-ab73-756736128691 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:00.497282 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8879679-767b-4fdb-ab73-756736128691 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:00.532012 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:00.557633 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279feb0-15d2-4c54-a7be-f5b782d52421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:00.558308 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279feb0-15d2-4c54-a7be-f5b782d52421 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:00.558586 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279feb0-15d2-4c54-a7be-f5b782d52421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:00.558854 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279feb0-15d2-4c54-a7be-f5b782d52421 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:00.559600 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279feb0-15d2-4c54-a7be-f5b782d52421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:00.561227 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279feb0-15d2-4c54-a7be-f5b782d52421 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:00.571168 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1229/2447] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:01:00.575277 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012717b-f202-42b0-becc-df936db9194d admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:00.586335 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012717b-f202-42b0-becc-df936db9194d admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:00.591311 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cd027-4c65-4992-a14b-31c1f8dad1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:00.592216 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cd027-4c65-4992-a14b-31c1f8dad1e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:00.592532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cd027-4c65-4992-a14b-31c1f8dad1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:00.592815 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cd027-4c65-4992-a14b-31c1f8dad1e0 admin admin] PATH_INFO: `/v3/projects/c2dcd144fa7341058a9a8caf6b398982/users/3458c529049f4fbcac5ca2bacf182835/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:00.594891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09cd027-4c65-4992-a14b-31c1f8dad1e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2dcd144fa7341058a9a8caf6b398982, user_id=3458c529049f4fbcac5ca2bacf182835, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:00.597600 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09cd027-4c65-4992-a14b-31c1f8dad1e0 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:00.609371 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1219/2448] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:01:00 2022] PUT /identity/v3/projects/c2dcd144fa7341058a9a8caf6b398982/users/3458c529049f4fbcac5ca2bacf182835/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:01:00.619210 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792afab-86dc-4c4c-a526-9cb482433c64 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:00.619500 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792afab-86dc-4c4c-a526-9cb482433c64 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:00.619782 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792afab-86dc-4c4c-a526-9cb482433c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:00.648138 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d792afab-86dc-4c4c-a526-9cb482433c64 None None] MFA Rules not processed for user `3458c529049f4fbcac5ca2bacf182835`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:00.649420 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d792afab-86dc-4c4c-a526-9cb482433c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:00.715954 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1230/2449] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:01:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 06:01:00.728148 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cd027-4c65-4992-a14b-31c1f8dad1e0 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:00.730778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d09cd027-4c65-4992-a14b-31c1f8dad1e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:00.741850 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:00.809561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cd027-4c65-4992-a14b-31c1f8dad1e0 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:00.813558 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966d402-6143-4281-a0e6-af46e4cf253c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:00.814202 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966d402-6143-4281-a0e6-af46e4cf253c service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:00.814482 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966d402-6143-4281-a0e6-af46e4cf253c service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:00.814749 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966d402-6143-4281-a0e6-af46e4cf253c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:00.824801 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4966d402-6143-4281-a0e6-af46e4cf253c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:00.826260 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4966d402-6143-4281-a0e6-af46e4cf253c service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:00.835880 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1220/2450] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:01:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:01:01.263040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792afab-86dc-4c4c-a526-9cb482433c64 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:01.325522 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792afab-86dc-4c4c-a526-9cb482433c64 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:01.331422 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796578f-7979-4ad8-a3d6-e42269f48afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:01.332340 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796578f-7979-4ad8-a3d6-e42269f48afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:01.332626 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796578f-7979-4ad8-a3d6-e42269f48afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:01.332901 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796578f-7979-4ad8-a3d6-e42269f48afa admin admin] PATH_INFO: `/v3/users/b7b9d5cc5bdb4289859e179ebf29646a` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:01.334220 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796578f-7979-4ad8-a3d6-e42269f48afa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7b9d5cc5bdb4289859e179ebf29646a)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:01.336230 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796578f-7979-4ad8-a3d6-e42269f48afa admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:01.387028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2796578f-7979-4ad8-a3d6-e42269f48afa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7b9d5cc5bdb4289859e179ebf29646a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:01.395310 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2796578f-7979-4ad8-a3d6-e42269f48afa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7b9d5cc5bdb4289859e179ebf29646a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:01.400755 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:01.406070 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2796578f-7979-4ad8-a3d6-e42269f48afa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7b9d5cc5bdb4289859e179ebf29646a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:01.407131 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2796578f-7979-4ad8-a3d6-e42269f48afa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7b9d5cc5bdb4289859e179ebf29646a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:01.424108 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-2796578f-7979-4ad8-a3d6-e42269f48afa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7b9d5cc5bdb4289859e179ebf29646a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:01.435257 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b28dfe-22d2-4501-9abf-ab247a7814b0 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:01.436148 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b28dfe-22d2-4501-9abf-ab247a7814b0 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:01.436589 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b28dfe-22d2-4501-9abf-ab247a7814b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:01.441212 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1231/2451] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:01:01 2022] DELETE /identity/v3/users/b7b9d5cc5bdb4289859e179ebf29646a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:01:01.456258 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-e7b28dfe-22d2-4501-9abf-ab247a7814b0 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:01.457595 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e7b28dfe-22d2-4501-9abf-ab247a7814b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:01.525394 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1221/2452] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:01:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 06:01:01.535567 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796578f-7979-4ad8-a3d6-e42269f48afa admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:01.537223 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2796578f-7979-4ad8-a3d6-e42269f48afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:01.596219 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796578f-7979-4ad8-a3d6-e42269f48afa admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:01.600595 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00454753-6190-4504-891c-f20c94c34737 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:01.601249 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00454753-6190-4504-891c-f20c94c34737 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:01.601530 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00454753-6190-4504-891c-f20c94c34737 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:01.601803 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00454753-6190-4504-891c-f20c94c34737 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:01.612144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00454753-6190-4504-891c-f20c94c34737 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:01.613649 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00454753-6190-4504-891c-f20c94c34737 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:01.623837 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1232/2453] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:01:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:01:01.991898 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b28dfe-22d2-4501-9abf-ab247a7814b0 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:01.993348 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e7b28dfe-22d2-4501-9abf-ab247a7814b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:02.008106 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b28dfe-22d2-4501-9abf-ab247a7814b0 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:02.014953 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0d02b-0bd3-496d-bf1e-e9b13a523bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:02.015891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0d02b-0bd3-496d-bf1e-e9b13a523bf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:02.016188 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0d02b-0bd3-496d-bf1e-e9b13a523bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:02.016412 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0d02b-0bd3-496d-bf1e-e9b13a523bf6 admin admin] PATH_INFO: `/v3/projects/8a5c0cb9a959456b87c56a4901ff2794` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:02.017883 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0d02b-0bd3-496d-bf1e-e9b13a523bf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a5c0cb9a959456b87c56a4901ff2794)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:02.019906 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0d02b-0bd3-496d-bf1e-e9b13a523bf6 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:02.067923 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-2bc0d02b-0bd3-496d-bf1e-e9b13a523bf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a5c0cb9a959456b87c56a4901ff2794', 'request_id': 'req-2bc0d02b-0bd3-496d-bf1e-e9b13a523bf6'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:02.076332 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-2bc0d02b-0bd3-496d-bf1e-e9b13a523bf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a5c0cb9a959456b87c56a4901ff2794', 'request_id': 'req-2bc0d02b-0bd3-496d-bf1e-e9b13a523bf6'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:02.083100 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-2bc0d02b-0bd3-496d-bf1e-e9b13a523bf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a5c0cb9a959456b87c56a4901ff2794', 'request_id': 'req-2bc0d02b-0bd3-496d-bf1e-e9b13a523bf6'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:02.094210 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-2bc0d02b-0bd3-496d-bf1e-e9b13a523bf6 admin admin] The token cache is being invalidate because project 8a5c0cb9a959456b87c56a4901ff2794 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:01:02.094496 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-2bc0d02b-0bd3-496d-bf1e-e9b13a523bf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:02.095208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-2bc0d02b-0bd3-496d-bf1e-e9b13a523bf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:02.096925 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1222/2454] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:01:01 2022] DELETE /identity/v3/projects/8a5c0cb9a959456b87c56a4901ff2794 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 06:01:02.103046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00454753-6190-4504-891c-f20c94c34737 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:02.117148 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00454753-6190-4504-891c-f20c94c34737 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:02.177467 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8291c-e102-477b-9c14-c775a2f64b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:02.178266 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8291c-e102-477b-9c14-c775a2f64b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:02.178545 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8291c-e102-477b-9c14-c775a2f64b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:02.178819 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8291c-e102-477b-9c14-c775a2f64b66 admin admin] PATH_INFO: `/v3/users/3458c529049f4fbcac5ca2bacf182835` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:02.180164 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8291c-e102-477b-9c14-c775a2f64b66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3458c529049f4fbcac5ca2bacf182835)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:02.182113 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8291c-e102-477b-9c14-c775a2f64b66 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:02.232789 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-39a8291c-e102-477b-9c14-c775a2f64b66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3458c529049f4fbcac5ca2bacf182835'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:02.240230 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-39a8291c-e102-477b-9c14-c775a2f64b66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3458c529049f4fbcac5ca2bacf182835'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:02.250527 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-39a8291c-e102-477b-9c14-c775a2f64b66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3458c529049f4fbcac5ca2bacf182835'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:02.251163 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-39a8291c-e102-477b-9c14-c775a2f64b66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3458c529049f4fbcac5ca2bacf182835'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:02.263670 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-39a8291c-e102-477b-9c14-c775a2f64b66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3458c529049f4fbcac5ca2bacf182835'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:02.266962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:02.271879 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1233/2455] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:01:02 2022] DELETE /identity/v3/users/3458c529049f4fbcac5ca2bacf182835 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:01:02.705538 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0d02b-0bd3-496d-bf1e-e9b13a523bf6 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:02.706989 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-2bc0d02b-0bd3-496d-bf1e-e9b13a523bf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:02.723357 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0d02b-0bd3-496d-bf1e-e9b13a523bf6 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:02.735261 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:02.789867 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f38169-33ff-4692-8118-a878ecfe2212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:02.790758 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f38169-33ff-4692-8118-a878ecfe2212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:02.791044 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f38169-33ff-4692-8118-a878ecfe2212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:02.791380 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f38169-33ff-4692-8118-a878ecfe2212 admin admin] PATH_INFO: `/v3/projects/c2dcd144fa7341058a9a8caf6b398982` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:02.792727 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f38169-33ff-4692-8118-a878ecfe2212 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2dcd144fa7341058a9a8caf6b398982)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:02.794680 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f38169-33ff-4692-8118-a878ecfe2212 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:02.856283 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-41f38169-33ff-4692-8118-a878ecfe2212 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2dcd144fa7341058a9a8caf6b398982', 'request_id': 'req-41f38169-33ff-4692-8118-a878ecfe2212'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:02.865991 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-41f38169-33ff-4692-8118-a878ecfe2212 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2dcd144fa7341058a9a8caf6b398982', 'request_id': 'req-41f38169-33ff-4692-8118-a878ecfe2212'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:02.873316 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-41f38169-33ff-4692-8118-a878ecfe2212 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2dcd144fa7341058a9a8caf6b398982', 'request_id': 'req-41f38169-33ff-4692-8118-a878ecfe2212'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:02.884581 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-41f38169-33ff-4692-8118-a878ecfe2212 admin admin] The token cache is being invalidate because project c2dcd144fa7341058a9a8caf6b398982 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:01:02.884879 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-41f38169-33ff-4692-8118-a878ecfe2212 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:02.885550 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-41f38169-33ff-4692-8118-a878ecfe2212 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:02.887421 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1223/2456] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:01:02 2022] DELETE /identity/v3/projects/c2dcd144fa7341058a9a8caf6b398982 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:01:02.893304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc3459-8dd2-4417-bc20-87a3e1c9149e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:02.893788 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc3459-8dd2-4417-bc20-87a3e1c9149e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:02.893902 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc3459-8dd2-4417-bc20-87a3e1c9149e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:02.912852 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-60fc3459-8dd2-4417-bc20-87a3e1c9149e None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:02.914060 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-60fc3459-8dd2-4417-bc20-87a3e1c9149e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:02.975818 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1234/2457] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:01:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 06:01:02.984403 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c7bee-a72f-46c6-928c-40fbf2e9f7e2 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:02.984693 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c7bee-a72f-46c6-928c-40fbf2e9f7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:02.984983 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c7bee-a72f-46c6-928c-40fbf2e9f7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:03.003684 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-b16c7bee-a72f-46c6-928c-40fbf2e9f7e2 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:03.004912 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b16c7bee-a72f-46c6-928c-40fbf2e9f7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:03.013627 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1224/2458] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:01:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:01:03.017884 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc3459-8dd2-4417-bc20-87a3e1c9149e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:03.028347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc3459-8dd2-4417-bc20-87a3e1c9149e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:03.033724 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702cb32-a1a1-498d-8b09-762840ae9df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:03.034386 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702cb32-a1a1-498d-8b09-762840ae9df3 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:03.034664 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702cb32-a1a1-498d-8b09-762840ae9df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:03.034934 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702cb32-a1a1-498d-8b09-762840ae9df3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:03.035685 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702cb32-a1a1-498d-8b09-762840ae9df3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 06:01:03.035986 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702cb32-a1a1-498d-8b09-762840ae9df3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:03.037626 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702cb32-a1a1-498d-8b09-762840ae9df3 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:03.050371 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1235/2459] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 06:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 06:01:03.054262 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c7bee-a72f-46c6-928c-40fbf2e9f7e2 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:03.063735 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c7bee-a72f-46c6-928c-40fbf2e9f7e2 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:03.068460 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d23c9-0e16-4215-b83f-92b8f80292c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:03.069128 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d23c9-0e16-4215-b83f-92b8f80292c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:03.069420 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d23c9-0e16-4215-b83f-92b8f80292c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:03.069701 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d23c9-0e16-4215-b83f-92b8f80292c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:03.070452 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d23c9-0e16-4215-b83f-92b8f80292c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:03.072454 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d23c9-0e16-4215-b83f-92b8f80292c1 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:03.100072 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1225/2460] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:01:03 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:01:03.106137 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702cb32-a1a1-498d-8b09-762840ae9df3 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:03.116496 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702cb32-a1a1-498d-8b09-762840ae9df3 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:03.174117 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b840d1-8a2d-4433-9642-7bd4031a1e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:03.174824 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b840d1-8a2d-4433-9642-7bd4031a1e31 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:03.175103 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b840d1-8a2d-4433-9642-7bd4031a1e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:03.175443 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b840d1-8a2d-4433-9642-7bd4031a1e31 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:03.176148 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b840d1-8a2d-4433-9642-7bd4031a1e31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:03.178087 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b840d1-8a2d-4433-9642-7bd4031a1e31 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:03.203068 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1236/2461] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:01:03 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 06:01:03.204430 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d23c9-0e16-4215-b83f-92b8f80292c1 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:03.215679 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d23c9-0e16-4215-b83f-92b8f80292c1 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:03.221560 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1327b76-9278-46a0-a4b5-821a8efde0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:03.222247 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1327b76-9278-46a0-a4b5-821a8efde0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:03.222530 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1327b76-9278-46a0-a4b5-821a8efde0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:03.222849 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1327b76-9278-46a0-a4b5-821a8efde0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:03.223562 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1327b76-9278-46a0-a4b5-821a8efde0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:03.224987 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b840d1-8a2d-4433-9642-7bd4031a1e31 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:03.225626 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1327b76-9278-46a0-a4b5-821a8efde0a2 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:03.227144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-07b840d1-8a2d-4433-9642-7bd4031a1e31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:03.239217 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1226/2462] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:01:03.242233 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1327b76-9278-46a0-a4b5-821a8efde0a2 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:03.253295 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1327b76-9278-46a0-a4b5-821a8efde0a2 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:03.257979 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf958d5a-e80a-4922-92c9-793e289242f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:03.258650 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf958d5a-e80a-4922-92c9-793e289242f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:03.258963 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf958d5a-e80a-4922-92c9-793e289242f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:03.259273 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf958d5a-e80a-4922-92c9-793e289242f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:03.260000 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf958d5a-e80a-4922-92c9-793e289242f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:03.261610 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf958d5a-e80a-4922-92c9-793e289242f7 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:03.272156 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1227/2463] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 06:01:03.276107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf958d5a-e80a-4922-92c9-793e289242f7 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:03.285765 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf958d5a-e80a-4922-92c9-793e289242f7 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:03.289078 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b840d1-8a2d-4433-9642-7bd4031a1e31 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:03.290933 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67252873-c431-496c-be19-8e0c89c2569d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:03.291871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67252873-c431-496c-be19-8e0c89c2569d admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:03.292153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67252873-c431-496c-be19-8e0c89c2569d admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:03.292430 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67252873-c431-496c-be19-8e0c89c2569d admin admin] PATH_INFO: `/v3/projects/49f7695302db4fc58e69d3d2f71ccd51/users/3e8d8f7605e04825af43da60d1f4ce42/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:03.292916 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77dfcdb-36ea-4a8e-9308-9fdf13cfa63b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:03.293598 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77dfcdb-36ea-4a8e-9308-9fdf13cfa63b service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:03.293866 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77dfcdb-36ea-4a8e-9308-9fdf13cfa63b service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:03.294132 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77dfcdb-36ea-4a8e-9308-9fdf13cfa63b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:03.295962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d77dfcdb-36ea-4a8e-9308-9fdf13cfa63b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:03.307424 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67252873-c431-496c-be19-8e0c89c2569d admin admin] RBAC: Authorizing `identity:create_grant(project_id=49f7695302db4fc58e69d3d2f71ccd51, user_id=3e8d8f7605e04825af43da60d1f4ce42, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:03.310163 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67252873-c431-496c-be19-8e0c89c2569d admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:03.324046 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1228/2464] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:01:03 2022] PUT /identity/v3/projects/49f7695302db4fc58e69d3d2f71ccd51/users/3e8d8f7605e04825af43da60d1f4ce42/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 06:01:03.328476 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:03.329077 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a46b0-bc6e-4709-a8cd-42fbb3c9f7d7 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:03.329577 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a46b0-bc6e-4709-a8cd-42fbb3c9f7d7 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:03.330016 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a46b0-bc6e-4709-a8cd-42fbb3c9f7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:03.348007 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-e79a46b0-bc6e-4709-a8cd-42fbb3c9f7d7 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:03.349437 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e79a46b0-bc6e-4709-a8cd-42fbb3c9f7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:03.364305 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77dfcdb-36ea-4a8e-9308-9fdf13cfa63b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:03.365805 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77dfcdb-36ea-4a8e-9308-9fdf13cfa63b service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:03.376357 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1237/2465] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:01:03 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:01:03.377775 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:03.414842 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1229/2466] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 06:01:03.424098 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77dfcdb-36ea-4a8e-9308-9fdf13cfa63b service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:03.432976 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77dfcdb-36ea-4a8e-9308-9fdf13cfa63b service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:03.484958 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f0a60-106b-43a3-b7ad-adac6beeaa14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:03.485660 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f0a60-106b-43a3-b7ad-adac6beeaa14 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:03.485937 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f0a60-106b-43a3-b7ad-adac6beeaa14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:03.486238 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f0a60-106b-43a3-b7ad-adac6beeaa14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:03.495938 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f0a60-106b-43a3-b7ad-adac6beeaa14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:03.497388 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f0a60-106b-43a3-b7ad-adac6beeaa14 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:03.507392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1238/2467] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:01:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:01:04.250295 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b33e6a-8274-403c-b39f-8d880c21fb4d None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:04.250859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b33e6a-8274-403c-b39f-8d880c21fb4d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:04.250859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b33e6a-8274-403c-b39f-8d880c21fb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:04.277986 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-16b33e6a-8274-403c-b39f-8d880c21fb4d None None] MFA Rules not processed for user `3e8d8f7605e04825af43da60d1f4ce42`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:04.279212 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-16b33e6a-8274-403c-b39f-8d880c21fb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:04.351945 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1230/2468] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:01:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 06:01:04.356932 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f0a60-106b-43a3-b7ad-adac6beeaa14 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:04.368175 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f0a60-106b-43a3-b7ad-adac6beeaa14 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:04.376694 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4e1b9-d6dd-48f4-acb7-5c35bcbf26f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:04.377625 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4e1b9-d6dd-48f4-acb7-5c35bcbf26f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:04.378178 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4e1b9-d6dd-48f4-acb7-5c35bcbf26f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:04.378640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4e1b9-d6dd-48f4-acb7-5c35bcbf26f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:04.379606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4e1b9-d6dd-48f4-acb7-5c35bcbf26f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:04.383066 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4e1b9-d6dd-48f4-acb7-5c35bcbf26f6 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:04.424393 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b33e6a-8274-403c-b39f-8d880c21fb4d None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:04.427436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1239/2469] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:01:04 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:01:04.437241 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b33e6a-8274-403c-b39f-8d880c21fb4d None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:04.502529 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc7071-adb5-4365-a195-37a136819d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:04.503240 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc7071-adb5-4365-a195-37a136819d86 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:04.503524 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc7071-adb5-4365-a195-37a136819d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:04.503797 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc7071-adb5-4365-a195-37a136819d86 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:04.504485 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc7071-adb5-4365-a195-37a136819d86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:04.506484 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc7071-adb5-4365-a195-37a136819d86 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:04.537574 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1231/2470] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:01:04 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:01:04.538778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4e1b9-d6dd-48f4-acb7-5c35bcbf26f6 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:04.548925 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4e1b9-d6dd-48f4-acb7-5c35bcbf26f6 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:04.554092 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e18755-a903-4459-bcb5-ef5659d7a413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:04.554772 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e18755-a903-4459-bcb5-ef5659d7a413 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:04.555059 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e18755-a903-4459-bcb5-ef5659d7a413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:04.555373 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e18755-a903-4459-bcb5-ef5659d7a413 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:04.556104 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e18755-a903-4459-bcb5-ef5659d7a413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:04.557729 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e18755-a903-4459-bcb5-ef5659d7a413 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:04.568850 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1240/2471] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 06:01:04.573126 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc7071-adb5-4365-a195-37a136819d86 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:04.585356 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc7071-adb5-4365-a195-37a136819d86 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:04.589987 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911190f-8552-491a-9d73-08c5b9f7a3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:04.590875 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911190f-8552-491a-9d73-08c5b9f7a3f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:04.591169 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911190f-8552-491a-9d73-08c5b9f7a3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:04.591460 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911190f-8552-491a-9d73-08c5b9f7a3f3 admin admin] PATH_INFO: `/v3/projects/10337f850e4d4851a0426a45b32aeb71/users/66e2bf6169dd4b0688052f518982a83c/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:04.606446 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c911190f-8552-491a-9d73-08c5b9f7a3f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10337f850e4d4851a0426a45b32aeb71, user_id=66e2bf6169dd4b0688052f518982a83c, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:04.609192 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c911190f-8552-491a-9d73-08c5b9f7a3f3 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:04.623418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1232/2472] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:01:04 2022] PUT /identity/v3/projects/10337f850e4d4851a0426a45b32aeb71/users/66e2bf6169dd4b0688052f518982a83c/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:01:04.627610 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e18755-a903-4459-bcb5-ef5659d7a413 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:04.638868 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e18755-a903-4459-bcb5-ef5659d7a413 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:04.699354 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c46a5-9810-4d68-bcb8-fe0245fc6ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:04.700036 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c46a5-9810-4d68-bcb8-fe0245fc6ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:04.700320 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c46a5-9810-4d68-bcb8-fe0245fc6ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:04.700595 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c46a5-9810-4d68-bcb8-fe0245fc6ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:04.701322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c46a5-9810-4d68-bcb8-fe0245fc6ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:04.702936 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c46a5-9810-4d68-bcb8-fe0245fc6ae3 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:04.713698 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1241/2473] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:01:04.717861 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911190f-8552-491a-9d73-08c5b9f7a3f3 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:04.729896 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911190f-8552-491a-9d73-08c5b9f7a3f3 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:04.735668 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427536b-5727-4377-abba-eb1a01eef701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:04.736413 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427536b-5727-4377-abba-eb1a01eef701 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:04.736691 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427536b-5727-4377-abba-eb1a01eef701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:04.736969 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427536b-5727-4377-abba-eb1a01eef701 admin admin] PATH_INFO: `/v3/projects/10337f850e4d4851a0426a45b32aeb71/users/66e2bf6169dd4b0688052f518982a83c/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:04.738986 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c427536b-5727-4377-abba-eb1a01eef701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10337f850e4d4851a0426a45b32aeb71, user_id=66e2bf6169dd4b0688052f518982a83c, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:04.741719 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c427536b-5727-4377-abba-eb1a01eef701 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:04.752742 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1233/2474] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:01:04 2022] PUT /identity/v3/projects/10337f850e4d4851a0426a45b32aeb71/users/66e2bf6169dd4b0688052f518982a83c/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:01:05.466489 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd8aed-3cca-4550-bfb9-5cfd6ce7b01d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:05.467011 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd8aed-3cca-4550-bfb9-5cfd6ce7b01d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:05.467279 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd8aed-3cca-4550-bfb9-5cfd6ce7b01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:05.497121 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d9fd8aed-3cca-4550-bfb9-5cfd6ce7b01d None None] MFA Rules not processed for user `66e2bf6169dd4b0688052f518982a83c`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:05.498644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d9fd8aed-3cca-4550-bfb9-5cfd6ce7b01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:05.529520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:05.595210 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1242/2475] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:01:05 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:01:05.607740 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1276e-4ebe-4721-b1d7-6e23e31beee4 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:05.608240 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1276e-4ebe-4721-b1d7-6e23e31beee4 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:05.608543 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1276e-4ebe-4721-b1d7-6e23e31beee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:05.626358 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-9ad1276e-4ebe-4721-b1d7-6e23e31beee4 None None] MFA Rules not processed for user `3e8d8f7605e04825af43da60d1f4ce42`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:05.627724 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9ad1276e-4ebe-4721-b1d7-6e23e31beee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:05.633475 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:05.691210 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1234/2476] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:01:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:01:05.702553 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd8aed-3cca-4550-bfb9-5cfd6ce7b01d None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:05.704152 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d9fd8aed-3cca-4550-bfb9-5cfd6ce7b01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:05.782201 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd8aed-3cca-4550-bfb9-5cfd6ce7b01d None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:05.788046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c76bda-99b0-4ed7-acf5-3bed01d4ec72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:05.788670 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c76bda-99b0-4ed7-acf5-3bed01d4ec72 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:05.788959 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c76bda-99b0-4ed7-acf5-3bed01d4ec72 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:05.789228 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c76bda-99b0-4ed7-acf5-3bed01d4ec72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:05.797603 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c76bda-99b0-4ed7-acf5-3bed01d4ec72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:05.799553 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c76bda-99b0-4ed7-acf5-3bed01d4ec72 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:05.809483 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1243/2477] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:01:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:01:12.416186 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1276e-4ebe-4721-b1d7-6e23e31beee4 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:12.430226 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1276e-4ebe-4721-b1d7-6e23e31beee4 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:12.437230 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2992820-69b7-4eb7-81a2-85c382381dcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:12.437880 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2992820-69b7-4eb7-81a2-85c382381dcd service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:12.438153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2992820-69b7-4eb7-81a2-85c382381dcd service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:12.438431 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2992820-69b7-4eb7-81a2-85c382381dcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:12.440418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b2992820-69b7-4eb7-81a2-85c382381dcd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:12.504127 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2992820-69b7-4eb7-81a2-85c382381dcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:12.505776 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2992820-69b7-4eb7-81a2-85c382381dcd service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:12.516443 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1235/2478] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:01:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:01:13.978682 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847c8d6-56f0-47df-9ad3-959848878c88 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:13.979284 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847c8d6-56f0-47df-9ad3-959848878c88 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:13.979284 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847c8d6-56f0-47df-9ad3-959848878c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:13.999075 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6847c8d6-56f0-47df-9ad3-959848878c88 None None] MFA Rules not processed for user `3ed779ae7e0f4c90aaed6d1f9e86a4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:14.000342 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6847c8d6-56f0-47df-9ad3-959848878c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:14.061833 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1244/2479] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jul 4 06:01:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:01:14.075162 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2992820-69b7-4eb7-81a2-85c382381dcd service nova] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:14.076679 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b2992820-69b7-4eb7-81a2-85c382381dcd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:14.171145 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2992820-69b7-4eb7-81a2-85c382381dcd service nova] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:14.176296 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc76a2-1b4e-4e9b-85e3-f275426ec94a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55a1c343c60428db2d9e5e6ed865e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:14.176979 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc76a2-1b4e-4e9b-85e3-f275426ec94a service swift] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:14.177231 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc76a2-1b4e-4e9b-85e3-f275426ec94a service swift] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:14.177604 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc76a2-1b4e-4e9b-85e3-f275426ec94a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:14.186315 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc76a2-1b4e-4e9b-85e3-f275426ec94a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:14.187978 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc76a2-1b4e-4e9b-85e3-f275426ec94a service swift] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:14.196156 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1236/2480] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 4 06:01:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 06:01:19.953407 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847c8d6-56f0-47df-9ad3-959848878c88 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:19.954811 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6847c8d6-56f0-47df-9ad3-959848878c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:20.016386 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:20.020981 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847c8d6-56f0-47df-9ad3-959848878c88 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:20.025019 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d04a0-6d7e-4912-bec7-4294848dee92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:20.025667 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d04a0-6d7e-4912-bec7-4294848dee92 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:20.025944 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d04a0-6d7e-4912-bec7-4294848dee92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:20.026213 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d04a0-6d7e-4912-bec7-4294848dee92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:20.036498 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d04a0-6d7e-4912-bec7-4294848dee92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:20.038066 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d04a0-6d7e-4912-bec7-4294848dee92 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:20.048377 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1245/2481] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:01:19 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:01:21.749051 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc76a2-1b4e-4e9b-85e3-f275426ec94a service swift] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:21.769901 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc76a2-1b4e-4e9b-85e3-f275426ec94a service swift] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:21.778306 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607981b8-b573-478f-8646-d2ae51eef39c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:21.779230 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607981b8-b573-478f-8646-d2ae51eef39c service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:21.780170 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607981b8-b573-478f-8646-d2ae51eef39c service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:21.780562 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607981b8-b573-478f-8646-d2ae51eef39c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:21.783033 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-607981b8-b573-478f-8646-d2ae51eef39c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:21.819816 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:21.866593 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607981b8-b573-478f-8646-d2ae51eef39c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:21.868470 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607981b8-b573-478f-8646-d2ae51eef39c service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:21.882460 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1237/2482] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:01:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:01:24.860687 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d04a0-6d7e-4912-bec7-4294848dee92 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:24.862339 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-cd4d04a0-6d7e-4912-bec7-4294848dee92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:24.926421 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d04a0-6d7e-4912-bec7-4294848dee92 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:24.930108 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c57a3-184b-406d-8ce7-6d6291843b94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:24.930764 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c57a3-184b-406d-8ce7-6d6291843b94 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:24.931041 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c57a3-184b-406d-8ce7-6d6291843b94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:24.931361 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c57a3-184b-406d-8ce7-6d6291843b94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:24.933146 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ab4c57a3-184b-406d-8ce7-6d6291843b94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:24.942409 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c57a3-184b-406d-8ce7-6d6291843b94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:24.943917 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c57a3-184b-406d-8ce7-6d6291843b94 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:24.952066 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1246/2483] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:01:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:01:28.133381 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607981b8-b573-478f-8646-d2ae51eef39c service nova] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:28.143391 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607981b8-b573-478f-8646-d2ae51eef39c service nova] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:28.147431 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c27ad-3ce3-4422-a316-afede4f2dd9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:28.148098 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c27ad-3ce3-4422-a316-afede4f2dd9e service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:28.148382 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c27ad-3ce3-4422-a316-afede4f2dd9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:28.148660 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c27ad-3ce3-4422-a316-afede4f2dd9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:28.150812 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c50c27ad-3ce3-4422-a316-afede4f2dd9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:28.161252 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c27ad-3ce3-4422-a316-afede4f2dd9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:28.163611 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c27ad-3ce3-4422-a316-afede4f2dd9e service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:28.172287 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1238/2484] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:01:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:01:28.517439 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c57a3-184b-406d-8ce7-6d6291843b94 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:28.518847 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ab4c57a3-184b-406d-8ce7-6d6291843b94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:28.598049 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c57a3-184b-406d-8ce7-6d6291843b94 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:28.603514 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680574ae-eaf9-43fb-a397-ed6f823b2529 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260f58535f4e46a197d00276d37fd515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:28.604303 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680574ae-eaf9-43fb-a397-ed6f823b2529 service placement] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:28.605006 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680574ae-eaf9-43fb-a397-ed6f823b2529 service placement] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:28.605284 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680574ae-eaf9-43fb-a397-ed6f823b2529 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:28.607570 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-680574ae-eaf9-43fb-a397-ed6f823b2529 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:28.619722 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680574ae-eaf9-43fb-a397-ed6f823b2529 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:28.621398 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680574ae-eaf9-43fb-a397-ed6f823b2529 service placement] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:28.631322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1247/2485] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:01:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:01:30.347283 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2a4ed-7311-4428-8749-193c2ce6a680 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:30.347773 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2a4ed-7311-4428-8749-193c2ce6a680 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:30.347902 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2a4ed-7311-4428-8749-193c2ce6a680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:30.369164 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-eef2a4ed-7311-4428-8749-193c2ce6a680 None None] MFA Rules not processed for user `3ed779ae7e0f4c90aaed6d1f9e86a4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:30.370387 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-eef2a4ed-7311-4428-8749-193c2ce6a680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:30.379945 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1239/2486] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jul 4 06:01:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 06:01:30.394565 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680574ae-eaf9-43fb-a397-ed6f823b2529 service placement] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:30.409047 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680574ae-eaf9-43fb-a397-ed6f823b2529 service placement] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:30.415324 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b068bb-eec3-4f3f-8a93-2085e4f6e9b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55a1c343c60428db2d9e5e6ed865e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:30.415979 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b068bb-eec3-4f3f-8a93-2085e4f6e9b0 service swift] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:30.416312 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b068bb-eec3-4f3f-8a93-2085e4f6e9b0 service swift] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:30.416516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b068bb-eec3-4f3f-8a93-2085e4f6e9b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:30.429944 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b068bb-eec3-4f3f-8a93-2085e4f6e9b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:30.431692 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b068bb-eec3-4f3f-8a93-2085e4f6e9b0 service swift] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:30.441811 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1248/2487] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 4 06:01:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 06:01:39.769896 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2a4ed-7311-4428-8749-193c2ce6a680 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:39.784964 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2a4ed-7311-4428-8749-193c2ce6a680 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:39.790415 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328c9f7-90d9-413f-a7c0-7aecca1bca14 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260f58535f4e46a197d00276d37fd515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:39.791104 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328c9f7-90d9-413f-a7c0-7aecca1bca14 service placement] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:39.791434 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328c9f7-90d9-413f-a7c0-7aecca1bca14 service placement] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:39.791713 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328c9f7-90d9-413f-a7c0-7aecca1bca14 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:39.793543 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e328c9f7-90d9-413f-a7c0-7aecca1bca14 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:39.806837 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328c9f7-90d9-413f-a7c0-7aecca1bca14 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:39.808776 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328c9f7-90d9-413f-a7c0-7aecca1bca14 service placement] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:39.828876 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1240/2488] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:01:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:01:40.437188 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=68 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:40.475713 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd1fe1-82b4-488e-bda6-a6190f8ff1ad None None] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:40.476004 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd1fe1-82b4-488e-bda6-a6190f8ff1ad None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:40.476277 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd1fe1-82b4-488e-bda6-a6190f8ff1ad None None] PATH_INFO: `/` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:40.478020 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1249/2489] 10.222.0.16 () {54 vars in 921 bytes} [Mon Jul 4 06:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 06:01:40.488135 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e689e2-8d22-4aaf-8817-aa7074c3adde None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:40.488440 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e689e2-8d22-4aaf-8817-aa7074c3adde None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:40.488700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e689e2-8d22-4aaf-8817-aa7074c3adde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:40.533160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-b0e689e2-8d22-4aaf-8817-aa7074c3adde None None] MFA Rules not processed for user `260f58535f4e46a197d00276d37fd515`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:40.534588 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b0e689e2-8d22-4aaf-8817-aa7074c3adde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:40.548678 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1241/2490] 10.222.0.16 () {58 vars in 1018 bytes} [Mon Jul 4 06:01:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:01:40.567866 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd1fe1-82b4-488e-bda6-a6190f8ff1ad None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:40.577813 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e689e2-8d22-4aaf-8817-aa7074c3adde None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:40.585680 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd1fe1-82b4-488e-bda6-a6190f8ff1ad None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:40.597493 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368c19e-fc5e-4bd8-88ce-4e74a2b66014 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260f58535f4e46a197d00276d37fd515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:40.598216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368c19e-fc5e-4bd8-88ce-4e74a2b66014 service placement] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:40.598452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368c19e-fc5e-4bd8-88ce-4e74a2b66014 service placement] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:40.598712 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368c19e-fc5e-4bd8-88ce-4e74a2b66014 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:40.617749 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368c19e-fc5e-4bd8-88ce-4e74a2b66014 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:40.619784 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368c19e-fc5e-4bd8-88ce-4e74a2b66014 service placement] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:40.632247 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1250/2491] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:01:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:01:40.663503 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e689e2-8d22-4aaf-8817-aa7074c3adde None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:40.668236 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa88f63-7881-442e-b85c-4aec9cee1181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:40.669130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa88f63-7881-442e-b85c-4aec9cee1181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:40.669411 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa88f63-7881-442e-b85c-4aec9cee1181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:40.669718 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa88f63-7881-442e-b85c-4aec9cee1181 admin admin] PATH_INFO: `/v3/users/3e8d8f7605e04825af43da60d1f4ce42` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:40.670919 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa88f63-7881-442e-b85c-4aec9cee1181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e8d8f7605e04825af43da60d1f4ce42)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:40.672958 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa88f63-7881-442e-b85c-4aec9cee1181 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:40.724455 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7aa88f63-7881-442e-b85c-4aec9cee1181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e8d8f7605e04825af43da60d1f4ce42'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:40.725122 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7aa88f63-7881-442e-b85c-4aec9cee1181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e8d8f7605e04825af43da60d1f4ce42'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:40.734039 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7aa88f63-7881-442e-b85c-4aec9cee1181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e8d8f7605e04825af43da60d1f4ce42'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:40.734771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7aa88f63-7881-442e-b85c-4aec9cee1181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e8d8f7605e04825af43da60d1f4ce42'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:40.748093 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7aa88f63-7881-442e-b85c-4aec9cee1181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e8d8f7605e04825af43da60d1f4ce42'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:40.756548 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:40.763196 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1242/2492] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:01:40 2022] DELETE /identity/v3/users/3e8d8f7605e04825af43da60d1f4ce42 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:01:40.951160 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368c19e-fc5e-4bd8-88ce-4e74a2b66014 service placement] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:40.962063 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368c19e-fc5e-4bd8-88ce-4e74a2b66014 service placement] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:41.020113 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2206e6-8e83-4564-8a17-2993259e4858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:41.020989 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2206e6-8e83-4564-8a17-2993259e4858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:41.021268 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2206e6-8e83-4564-8a17-2993259e4858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:41.021543 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2206e6-8e83-4564-8a17-2993259e4858 admin admin] PATH_INFO: `/v3/projects/49f7695302db4fc58e69d3d2f71ccd51` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:41.022728 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2206e6-8e83-4564-8a17-2993259e4858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49f7695302db4fc58e69d3d2f71ccd51)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:41.024711 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2206e6-8e83-4564-8a17-2993259e4858 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:41.071455 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-cd2206e6-8e83-4564-8a17-2993259e4858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49f7695302db4fc58e69d3d2f71ccd51', 'request_id': 'req-cd2206e6-8e83-4564-8a17-2993259e4858'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:41.077791 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-cd2206e6-8e83-4564-8a17-2993259e4858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49f7695302db4fc58e69d3d2f71ccd51', 'request_id': 'req-cd2206e6-8e83-4564-8a17-2993259e4858'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:41.086824 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-cd2206e6-8e83-4564-8a17-2993259e4858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49f7695302db4fc58e69d3d2f71ccd51', 'request_id': 'req-cd2206e6-8e83-4564-8a17-2993259e4858'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:41.101190 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-cd2206e6-8e83-4564-8a17-2993259e4858 admin admin] The token cache is being invalidate because project 49f7695302db4fc58e69d3d2f71ccd51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:01:41.101608 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-cd2206e6-8e83-4564-8a17-2993259e4858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:41.102634 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-cd2206e6-8e83-4564-8a17-2993259e4858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:41.104774 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1251/2493] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:01:40 2022] DELETE /identity/v3/projects/49f7695302db4fc58e69d3d2f71ccd51 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:01:41.109179 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa88f63-7881-442e-b85c-4aec9cee1181 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:41.111438 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-7aa88f63-7881-442e-b85c-4aec9cee1181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:41.131006 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa88f63-7881-442e-b85c-4aec9cee1181 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:41.192844 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a344bd-f3e5-440e-ae52-4a85c9ee008c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:41.194517 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a344bd-f3e5-440e-ae52-4a85c9ee008c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:41.194938 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a344bd-f3e5-440e-ae52-4a85c9ee008c admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:41.195419 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a344bd-f3e5-440e-ae52-4a85c9ee008c admin admin] PATH_INFO: `/v3/users/66e2bf6169dd4b0688052f518982a83c` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:41.196782 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a344bd-f3e5-440e-ae52-4a85c9ee008c admin admin] RBAC: Authorizing `identity:delete_user(user_id=66e2bf6169dd4b0688052f518982a83c)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:41.198728 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a344bd-f3e5-440e-ae52-4a85c9ee008c admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:41.247930 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e7a344bd-f3e5-440e-ae52-4a85c9ee008c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66e2bf6169dd4b0688052f518982a83c'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:41.248655 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e7a344bd-f3e5-440e-ae52-4a85c9ee008c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66e2bf6169dd4b0688052f518982a83c'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:41.258300 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e7a344bd-f3e5-440e-ae52-4a85c9ee008c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66e2bf6169dd4b0688052f518982a83c'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:41.258936 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e7a344bd-f3e5-440e-ae52-4a85c9ee008c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66e2bf6169dd4b0688052f518982a83c'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:41.271966 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e7a344bd-f3e5-440e-ae52-4a85c9ee008c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66e2bf6169dd4b0688052f518982a83c'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:41.285606 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1243/2494] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:01:41 2022] DELETE /identity/v3/users/66e2bf6169dd4b0688052f518982a83c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:01:41.480868 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2206e6-8e83-4564-8a17-2993259e4858 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:41.482722 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-cd2206e6-8e83-4564-8a17-2993259e4858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:41.497734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2206e6-8e83-4564-8a17-2993259e4858 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:41.568560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c616468-c563-4b27-872c-18503c3a62e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:41.569503 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c616468-c563-4b27-872c-18503c3a62e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:41.569855 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c616468-c563-4b27-872c-18503c3a62e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:41.570193 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c616468-c563-4b27-872c-18503c3a62e7 admin admin] PATH_INFO: `/v3/projects/10337f850e4d4851a0426a45b32aeb71` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:41.571520 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c616468-c563-4b27-872c-18503c3a62e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10337f850e4d4851a0426a45b32aeb71)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:41.573551 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c616468-c563-4b27-872c-18503c3a62e7 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:41.596092 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:41.626123 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5c616468-c563-4b27-872c-18503c3a62e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10337f850e4d4851a0426a45b32aeb71', 'request_id': 'req-5c616468-c563-4b27-872c-18503c3a62e7'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:41.632688 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5c616468-c563-4b27-872c-18503c3a62e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10337f850e4d4851a0426a45b32aeb71', 'request_id': 'req-5c616468-c563-4b27-872c-18503c3a62e7'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:41.647141 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5c616468-c563-4b27-872c-18503c3a62e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10337f850e4d4851a0426a45b32aeb71', 'request_id': 'req-5c616468-c563-4b27-872c-18503c3a62e7'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:41.658986 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5c616468-c563-4b27-872c-18503c3a62e7 admin admin] The token cache is being invalidate because project 10337f850e4d4851a0426a45b32aeb71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:01:41.659393 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5c616468-c563-4b27-872c-18503c3a62e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:41.660192 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5c616468-c563-4b27-872c-18503c3a62e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:41.662024 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1252/2495] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:01:41 2022] DELETE /identity/v3/projects/10337f850e4d4851a0426a45b32aeb71 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:01:41.668666 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270ad97-ff59-4934-b304-e0b19cf4f8d8 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:41.669040 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270ad97-ff59-4934-b304-e0b19cf4f8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:41.669382 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270ad97-ff59-4934-b304-e0b19cf4f8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:41.688914 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-4270ad97-ff59-4934-b304-e0b19cf4f8d8 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:41.690291 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-4270ad97-ff59-4934-b304-e0b19cf4f8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:41.774045 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1244/2496] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:01:41.781352 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cb2ba-6687-46a1-bd04-4438b0e8c0ef None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:41.781872 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cb2ba-6687-46a1-bd04-4438b0e8c0ef None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:41.782390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cb2ba-6687-46a1-bd04-4438b0e8c0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:41.802748 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-725cb2ba-6687-46a1-bd04-4438b0e8c0ef None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:41.804368 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-725cb2ba-6687-46a1-bd04-4438b0e8c0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:41.813184 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1253/2497] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:01:41.817714 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4270ad97-ff59-4934-b304-e0b19cf4f8d8 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:41.829617 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4270ad97-ff59-4934-b304-e0b19cf4f8d8 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:41.834833 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919428c-2cd6-48da-8161-26fa61add8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:41.835556 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919428c-2cd6-48da-8161-26fa61add8be admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:41.835850 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919428c-2cd6-48da-8161-26fa61add8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:41.836186 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919428c-2cd6-48da-8161-26fa61add8be admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:41.837096 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919428c-2cd6-48da-8161-26fa61add8be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 06:01:41.837403 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919428c-2cd6-48da-8161-26fa61add8be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:41.839031 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919428c-2cd6-48da-8161-26fa61add8be admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:41.855757 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1245/2498] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 06:01:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 06:01:41.857645 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725cb2ba-6687-46a1-bd04-4438b0e8c0ef None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:41.869629 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725cb2ba-6687-46a1-bd04-4438b0e8c0ef None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:41.874842 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64eaf2-ed67-438a-8e52-feea5057154f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:41.875553 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64eaf2-ed67-438a-8e52-feea5057154f admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:41.875837 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64eaf2-ed67-438a-8e52-feea5057154f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:41.876111 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64eaf2-ed67-438a-8e52-feea5057154f admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:41.876835 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64eaf2-ed67-438a-8e52-feea5057154f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:41.878798 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64eaf2-ed67-438a-8e52-feea5057154f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:41.911281 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1254/2499] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:01:41 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 06:01:41.915215 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919428c-2cd6-48da-8161-26fa61add8be admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:41.932039 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:41.962543 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919428c-2cd6-48da-8161-26fa61add8be admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:42.053574 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6185b5e-1e8f-4c9b-b2c4-a37bdf118717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:42.054267 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6185b5e-1e8f-4c9b-b2c4-a37bdf118717 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:42.054545 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6185b5e-1e8f-4c9b-b2c4-a37bdf118717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:42.054816 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6185b5e-1e8f-4c9b-b2c4-a37bdf118717 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:42.055599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6185b5e-1e8f-4c9b-b2c4-a37bdf118717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:42.057542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6185b5e-1e8f-4c9b-b2c4-a37bdf118717 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:42.078317 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1246/2500] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:01:41 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:01:42.082351 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64eaf2-ed67-438a-8e52-feea5057154f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:42.092818 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64eaf2-ed67-438a-8e52-feea5057154f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:42.097317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2763e-b988-4343-9202-fbf0d8b1bed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:42.097993 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2763e-b988-4343-9202-fbf0d8b1bed2 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:42.098273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2763e-b988-4343-9202-fbf0d8b1bed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:42.098559 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2763e-b988-4343-9202-fbf0d8b1bed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:42.099285 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2763e-b988-4343-9202-fbf0d8b1bed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:42.100899 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2763e-b988-4343-9202-fbf0d8b1bed2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:42.111903 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1255/2501] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:01:42.116051 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6185b5e-1e8f-4c9b-b2c4-a37bdf118717 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:42.126270 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6185b5e-1e8f-4c9b-b2c4-a37bdf118717 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:42.131342 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea83ed9-5757-4367-a215-097899ad0a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:42.132150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea83ed9-5757-4367-a215-097899ad0a12 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:42.132434 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea83ed9-5757-4367-a215-097899ad0a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:42.132708 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea83ed9-5757-4367-a215-097899ad0a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:42.133526 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea83ed9-5757-4367-a215-097899ad0a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:42.135128 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea83ed9-5757-4367-a215-097899ad0a12 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:42.145500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1247/2502] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:01:42.149838 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2763e-b988-4343-9202-fbf0d8b1bed2 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:42.160611 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2763e-b988-4343-9202-fbf0d8b1bed2 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:42.165823 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad7fd9-29c2-47a7-a4a2-0dc6cf7b8cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:42.166715 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad7fd9-29c2-47a7-a4a2-0dc6cf7b8cc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:42.166998 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad7fd9-29c2-47a7-a4a2-0dc6cf7b8cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:42.167311 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad7fd9-29c2-47a7-a4a2-0dc6cf7b8cc3 admin admin] PATH_INFO: `/v3/projects/09573fe054024239ab17b1327f3026ff/users/f0e12f6e3f7a4eb4b7bc688e3dae04a9/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:42.182823 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad7fd9-29c2-47a7-a4a2-0dc6cf7b8cc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09573fe054024239ab17b1327f3026ff, user_id=f0e12f6e3f7a4eb4b7bc688e3dae04a9, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:42.185567 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad7fd9-29c2-47a7-a4a2-0dc6cf7b8cc3 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:42.202478 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1256/2503] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:01:42 2022] PUT /identity/v3/projects/09573fe054024239ab17b1327f3026ff/users/f0e12f6e3f7a4eb4b7bc688e3dae04a9/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:01:42.216774 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f34b4a-abad-4109-ab93-5c72eddce4b3 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:42.217065 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f34b4a-abad-4109-ab93-5c72eddce4b3 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:42.217340 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f34b4a-abad-4109-ab93-5c72eddce4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:42.245186 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-c9f34b4a-abad-4109-ab93-5c72eddce4b3 None None] MFA Rules not processed for user `f0e12f6e3f7a4eb4b7bc688e3dae04a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:42.246390 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c9f34b4a-abad-4109-ab93-5c72eddce4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:42.311968 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1248/2504] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:01:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:01:42.323616 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad7fd9-29c2-47a7-a4a2-0dc6cf7b8cc3 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:42.325898 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1bad7fd9-29c2-47a7-a4a2-0dc6cf7b8cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:42.391309 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad7fd9-29c2-47a7-a4a2-0dc6cf7b8cc3 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:42.394857 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a662e76-be3e-4b7a-9c61-722195270373 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:42.395566 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a662e76-be3e-4b7a-9c61-722195270373 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:42.395838 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a662e76-be3e-4b7a-9c61-722195270373 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:42.396080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a662e76-be3e-4b7a-9c61-722195270373 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:42.405337 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a662e76-be3e-4b7a-9c61-722195270373 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:42.406806 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a662e76-be3e-4b7a-9c61-722195270373 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:42.417340 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1257/2505] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:01:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:01:43.404697 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f34b4a-abad-4109-ab93-5c72eddce4b3 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:43.406265 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c9f34b4a-abad-4109-ab93-5c72eddce4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:43.486647 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f34b4a-abad-4109-ab93-5c72eddce4b3 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:43.493114 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e346a-77d2-4b74-84c5-304c3458349e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:43.493780 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e346a-77d2-4b74-84c5-304c3458349e service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:43.494067 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e346a-77d2-4b74-84c5-304c3458349e service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:43.494397 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e346a-77d2-4b74-84c5-304c3458349e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:43.496298 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-753e346a-77d2-4b74-84c5-304c3458349e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:43.508394 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e346a-77d2-4b74-84c5-304c3458349e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:43.510011 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e346a-77d2-4b74-84c5-304c3458349e service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:43.514841 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:43.528724 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1249/2506] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:01:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:01:45.164701 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a662e76-be3e-4b7a-9c61-722195270373 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:45.166815 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9a662e76-be3e-4b7a-9c61-722195270373 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:45.179016 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97d06f-3996-45fd-9ee0-560b7c0901e4 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:45.179551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97d06f-3996-45fd-9ee0-560b7c0901e4 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:45.179551 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97d06f-3996-45fd-9ee0-560b7c0901e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:45.191724 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a662e76-be3e-4b7a-9c61-722195270373 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:45.204320 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-3c97d06f-3996-45fd-9ee0-560b7c0901e4 None None] MFA Rules not processed for user `3ed779ae7e0f4c90aaed6d1f9e86a4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:45.205793 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189c69d-25f8-47d7-a672-6732535944fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:45.206598 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189c69d-25f8-47d7-a672-6732535944fe service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:45.206935 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-3c97d06f-3996-45fd-9ee0-560b7c0901e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:45.207256 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189c69d-25f8-47d7-a672-6732535944fe service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:45.207643 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189c69d-25f8-47d7-a672-6732535944fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:45.209849 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f189c69d-25f8-47d7-a672-6732535944fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:45.230028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189c69d-25f8-47d7-a672-6732535944fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:45.233957 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189c69d-25f8-47d7-a672-6732535944fe service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:45.254064 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1258/2507] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:01:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:01:45.280988 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1250/2508] 10.222.0.16 () {58 vars in 967 bytes} [Mon Jul 4 06:01:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 06:01:45.298684 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189c69d-25f8-47d7-a672-6732535944fe service nova] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:45.298684 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f189c69d-25f8-47d7-a672-6732535944fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:45.339809 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:45.400784 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189c69d-25f8-47d7-a672-6732535944fe service nova] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:45.408941 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe799b-394e-46b1-b1f1-964e857acb77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55a1c343c60428db2d9e5e6ed865e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:45.409612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe799b-394e-46b1-b1f1-964e857acb77 service swift] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:45.409893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe799b-394e-46b1-b1f1-964e857acb77 service swift] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:45.410175 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe799b-394e-46b1-b1f1-964e857acb77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:45.422637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe799b-394e-46b1-b1f1-964e857acb77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:45.429286 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe799b-394e-46b1-b1f1-964e857acb77 service swift] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:45.439037 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1259/2509] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 4 06:01:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 04 06:01:47.999043 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97d06f-3996-45fd-9ee0-560b7c0901e4 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:48.073254 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97d06f-3996-45fd-9ee0-560b7c0901e4 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:48.079162 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c944e-a553-4daf-8302-152282da8d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:48.080070 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c944e-a553-4daf-8302-152282da8d06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:48.080350 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c944e-a553-4daf-8302-152282da8d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:48.080616 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c944e-a553-4daf-8302-152282da8d06 admin admin] PATH_INFO: `/v3/users/f0e12f6e3f7a4eb4b7bc688e3dae04a9` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:48.081885 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c944e-a553-4daf-8302-152282da8d06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0e12f6e3f7a4eb4b7bc688e3dae04a9)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:48.083966 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c944e-a553-4daf-8302-152282da8d06 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:48.141123 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-a39c944e-a553-4daf-8302-152282da8d06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0e12f6e3f7a4eb4b7bc688e3dae04a9'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:48.141771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-a39c944e-a553-4daf-8302-152282da8d06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0e12f6e3f7a4eb4b7bc688e3dae04a9'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:48.150651 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-a39c944e-a553-4daf-8302-152282da8d06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0e12f6e3f7a4eb4b7bc688e3dae04a9'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:48.151383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-a39c944e-a553-4daf-8302-152282da8d06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0e12f6e3f7a4eb4b7bc688e3dae04a9'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:48.163293 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-a39c944e-a553-4daf-8302-152282da8d06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0e12f6e3f7a4eb4b7bc688e3dae04a9'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:48.175172 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1251/2510] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:01:47 2022] DELETE /identity/v3/users/f0e12f6e3f7a4eb4b7bc688e3dae04a9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:01:48.180054 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb99f92-199d-4949-afc0-4c7e178c0bd1 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:48.180570 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb99f92-199d-4949-afc0-4c7e178c0bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:48.180693 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb99f92-199d-4949-afc0-4c7e178c0bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:48.198471 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-3eb99f92-199d-4949-afc0-4c7e178c0bd1 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:48.199721 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3eb99f92-199d-4949-afc0-4c7e178c0bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:48.260779 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1260/2511] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 06:01:48.275304 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c944e-a553-4daf-8302-152282da8d06 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:48.276900 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-a39c944e-a553-4daf-8302-152282da8d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:48.305349 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:48.341311 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c944e-a553-4daf-8302-152282da8d06 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:48.345208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3683169-7750-4515-abb6-5583285ff3ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:48.345860 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3683169-7750-4515-abb6-5583285ff3ee service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:48.346138 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3683169-7750-4515-abb6-5583285ff3ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:48.346418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3683169-7750-4515-abb6-5583285ff3ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:48.356274 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3683169-7750-4515-abb6-5583285ff3ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:48.357720 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3683169-7750-4515-abb6-5583285ff3ee service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:48.367332 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1252/2512] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:01:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:01:48.669774 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb99f92-199d-4949-afc0-4c7e178c0bd1 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:48.671434 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-3eb99f92-199d-4949-afc0-4c7e178c0bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:48.684133 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb99f92-199d-4949-afc0-4c7e178c0bd1 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:48.690686 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c06a2-5fcb-459c-8abd-d20d3342e362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:48.691622 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c06a2-5fcb-459c-8abd-d20d3342e362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:48.691986 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c06a2-5fcb-459c-8abd-d20d3342e362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:48.692380 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c06a2-5fcb-459c-8abd-d20d3342e362 admin admin] PATH_INFO: `/v3/projects/09573fe054024239ab17b1327f3026ff` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:48.693569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c06a2-5fcb-459c-8abd-d20d3342e362 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09573fe054024239ab17b1327f3026ff)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:48.695992 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c06a2-5fcb-459c-8abd-d20d3342e362 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:48.745751 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d98c06a2-5fcb-459c-8abd-d20d3342e362 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09573fe054024239ab17b1327f3026ff', 'request_id': 'req-d98c06a2-5fcb-459c-8abd-d20d3342e362'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:48.753275 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d98c06a2-5fcb-459c-8abd-d20d3342e362 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09573fe054024239ab17b1327f3026ff', 'request_id': 'req-d98c06a2-5fcb-459c-8abd-d20d3342e362'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:48.760770 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d98c06a2-5fcb-459c-8abd-d20d3342e362 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09573fe054024239ab17b1327f3026ff', 'request_id': 'req-d98c06a2-5fcb-459c-8abd-d20d3342e362'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:48.771085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d98c06a2-5fcb-459c-8abd-d20d3342e362 admin admin] The token cache is being invalidate because project 09573fe054024239ab17b1327f3026ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:01:48.771332 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d98c06a2-5fcb-459c-8abd-d20d3342e362 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:48.771955 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d98c06a2-5fcb-459c-8abd-d20d3342e362 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:48.773555 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1261/2513] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:01:48 2022] DELETE /identity/v3/projects/09573fe054024239ab17b1327f3026ff => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:01:48.778800 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463fcb0-83af-4bc8-a916-0bceac59f6be None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:48.779189 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463fcb0-83af-4bc8-a916-0bceac59f6be None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:48.779488 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463fcb0-83af-4bc8-a916-0bceac59f6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:48.798273 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d463fcb0-83af-4bc8-a916-0bceac59f6be None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:48.799530 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d463fcb0-83af-4bc8-a916-0bceac59f6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:48.862379 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1253/2514] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 06:01:48.870621 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4424444-a3f4-46d0-9cfc-19b9696858a3 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:48.870909 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4424444-a3f4-46d0-9cfc-19b9696858a3 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:48.871202 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4424444-a3f4-46d0-9cfc-19b9696858a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:48.891716 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a4424444-a3f4-46d0-9cfc-19b9696858a3 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:48.893758 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a4424444-a3f4-46d0-9cfc-19b9696858a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:48.904603 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1262/2515] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:01:48.909550 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463fcb0-83af-4bc8-a916-0bceac59f6be None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:48.924546 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463fcb0-83af-4bc8-a916-0bceac59f6be None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:48.932463 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0faeadf-ca1b-4828-9147-9c26267b9e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:48.933118 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0faeadf-ca1b-4828-9147-9c26267b9e2d admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:48.933396 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0faeadf-ca1b-4828-9147-9c26267b9e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:48.933662 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0faeadf-ca1b-4828-9147-9c26267b9e2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:48.934384 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0faeadf-ca1b-4828-9147-9c26267b9e2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 06:01:48.934686 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0faeadf-ca1b-4828-9147-9c26267b9e2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:48.936364 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0faeadf-ca1b-4828-9147-9c26267b9e2d admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:48.948157 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1254/2516] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 06:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 06:01:48.952538 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4424444-a3f4-46d0-9cfc-19b9696858a3 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:48.962128 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4424444-a3f4-46d0-9cfc-19b9696858a3 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:48.968292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340d1ea-302a-41af-8748-537a769de46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:48.968956 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340d1ea-302a-41af-8748-537a769de46f admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:48.969234 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340d1ea-302a-41af-8748-537a769de46f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:48.969629 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340d1ea-302a-41af-8748-537a769de46f admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:48.970331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340d1ea-302a-41af-8748-537a769de46f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:48.972345 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340d1ea-302a-41af-8748-537a769de46f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:49.001855 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1263/2517] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:01:48 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:01:49.006270 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0faeadf-ca1b-4828-9147-9c26267b9e2d admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:49.016927 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0faeadf-ca1b-4828-9147-9c26267b9e2d admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:49.076742 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a740cda-8208-4dd8-8165-723b488bfd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:49.077435 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a740cda-8208-4dd8-8165-723b488bfd76 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:49.077718 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a740cda-8208-4dd8-8165-723b488bfd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:49.077991 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a740cda-8208-4dd8-8165-723b488bfd76 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:49.078725 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a740cda-8208-4dd8-8165-723b488bfd76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:49.080732 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a740cda-8208-4dd8-8165-723b488bfd76 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:49.103016 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1255/2518] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:01:49 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:01:49.107599 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340d1ea-302a-41af-8748-537a769de46f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:49.118750 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340d1ea-302a-41af-8748-537a769de46f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:49.124355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467b527-0688-4f6f-ac38-d87cc54ebb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:49.125022 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467b527-0688-4f6f-ac38-d87cc54ebb2c admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:49.125307 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467b527-0688-4f6f-ac38-d87cc54ebb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:49.125581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467b527-0688-4f6f-ac38-d87cc54ebb2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:49.126314 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467b527-0688-4f6f-ac38-d87cc54ebb2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:49.127981 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467b527-0688-4f6f-ac38-d87cc54ebb2c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:49.139141 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1264/2519] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:01:49.143117 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a740cda-8208-4dd8-8165-723b488bfd76 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:49.153514 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a740cda-8208-4dd8-8165-723b488bfd76 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:49.158528 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f0eda-a9ea-4d06-bfce-8fe21f921b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:49.159216 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f0eda-a9ea-4d06-bfce-8fe21f921b87 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:49.159513 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f0eda-a9ea-4d06-bfce-8fe21f921b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:49.159771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f0eda-a9ea-4d06-bfce-8fe21f921b87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:49.160513 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f0eda-a9ea-4d06-bfce-8fe21f921b87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:49.162104 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f0eda-a9ea-4d06-bfce-8fe21f921b87 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:49.172364 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1256/2520] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:01:49.176515 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467b527-0688-4f6f-ac38-d87cc54ebb2c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:49.186448 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467b527-0688-4f6f-ac38-d87cc54ebb2c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:49.191217 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca9e63-c340-4e91-b53d-7177bba87da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:49.192125 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca9e63-c340-4e91-b53d-7177bba87da0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:49.192410 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca9e63-c340-4e91-b53d-7177bba87da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:49.192686 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca9e63-c340-4e91-b53d-7177bba87da0 admin admin] PATH_INFO: `/v3/projects/197b9495c00b466faf995efb521acb1b/users/473cc15d3cb74834ba4e0fbd8e0e1f02/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:49.194898 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:49.210107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca9e63-c340-4e91-b53d-7177bba87da0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=197b9495c00b466faf995efb521acb1b, user_id=473cc15d3cb74834ba4e0fbd8e0e1f02, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:49.212856 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca9e63-c340-4e91-b53d-7177bba87da0 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:49.227006 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1265/2521] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:01:49 2022] PUT /identity/v3/projects/197b9495c00b466faf995efb521acb1b/users/473cc15d3cb74834ba4e0fbd8e0e1f02/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:01:49.237782 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d859a20-abcd-422d-b067-d0e986d3ad8f None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:49.238075 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d859a20-abcd-422d-b067-d0e986d3ad8f None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:49.238355 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d859a20-abcd-422d-b067-d0e986d3ad8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:49.265241 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-8d859a20-abcd-422d-b067-d0e986d3ad8f None None] MFA Rules not processed for user `473cc15d3cb74834ba4e0fbd8e0e1f02`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:49.266633 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-8d859a20-abcd-422d-b067-d0e986d3ad8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:49.290907 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:49.341230 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1257/2522] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:01:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:01:49.346024 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca9e63-c340-4e91-b53d-7177bba87da0 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:49.410452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca9e63-c340-4e91-b53d-7177bba87da0 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:49.415776 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d735b-a612-4ddf-b13f-c1722d41b285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:49.416443 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d735b-a612-4ddf-b13f-c1722d41b285 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:49.416725 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d735b-a612-4ddf-b13f-c1722d41b285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:49.416998 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d735b-a612-4ddf-b13f-c1722d41b285 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:49.417679 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d735b-a612-4ddf-b13f-c1722d41b285 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:49.419659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d735b-a612-4ddf-b13f-c1722d41b285 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:49.446724 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1266/2523] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:01:49 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:01:49.451025 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d859a20-abcd-422d-b067-d0e986d3ad8f None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:49.462102 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d859a20-abcd-422d-b067-d0e986d3ad8f None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:49.518088 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7fee4-7604-42e8-ac21-0559acfe3aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:49.518748 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7fee4-7604-42e8-ac21-0559acfe3aee admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:49.519026 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7fee4-7604-42e8-ac21-0559acfe3aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:49.519330 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7fee4-7604-42e8-ac21-0559acfe3aee admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:49.520041 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7fee4-7604-42e8-ac21-0559acfe3aee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:49.521991 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7fee4-7604-42e8-ac21-0559acfe3aee admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:49.544552 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1258/2524] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:01:49 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 06:01:49.548627 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d735b-a612-4ddf-b13f-c1722d41b285 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:49.559694 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d735b-a612-4ddf-b13f-c1722d41b285 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:49.564967 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe0da4-8967-466e-a439-13f9058c2fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:49.565637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe0da4-8967-466e-a439-13f9058c2fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:49.565923 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe0da4-8967-466e-a439-13f9058c2fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:49.566198 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe0da4-8967-466e-a439-13f9058c2fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:49.566925 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe0da4-8967-466e-a439-13f9058c2fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:49.568617 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe0da4-8967-466e-a439-13f9058c2fc1 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:49.580591 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1267/2525] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:01:49.584913 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7fee4-7604-42e8-ac21-0559acfe3aee admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:49.597227 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7fee4-7604-42e8-ac21-0559acfe3aee admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:49.605734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdda8a5-1337-4ca7-9f55-0af5aba5593a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:49.606775 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdda8a5-1337-4ca7-9f55-0af5aba5593a admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:49.607245 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdda8a5-1337-4ca7-9f55-0af5aba5593a admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:49.607702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdda8a5-1337-4ca7-9f55-0af5aba5593a admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:49.608877 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdda8a5-1337-4ca7-9f55-0af5aba5593a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:49.611532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdda8a5-1337-4ca7-9f55-0af5aba5593a admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:49.625095 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1259/2526] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:01:49.629355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe0da4-8967-466e-a439-13f9058c2fc1 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:49.639566 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe0da4-8967-466e-a439-13f9058c2fc1 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:49.644411 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102aee1-c957-4470-afd0-eafd43324bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:49.645294 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102aee1-c957-4470-afd0-eafd43324bb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:49.645570 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102aee1-c957-4470-afd0-eafd43324bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:49.645841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102aee1-c957-4470-afd0-eafd43324bb0 admin admin] PATH_INFO: `/v3/projects/816d89c58a304d478837b4e7278bc645/users/70d9221ac61746d8ad6b4abb2f8e2312/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:49.661941 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102aee1-c957-4470-afd0-eafd43324bb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=816d89c58a304d478837b4e7278bc645, user_id=70d9221ac61746d8ad6b4abb2f8e2312, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:49.664700 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102aee1-c957-4470-afd0-eafd43324bb0 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:49.680048 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1268/2527] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:01:49 2022] PUT /identity/v3/projects/816d89c58a304d478837b4e7278bc645/users/70d9221ac61746d8ad6b4abb2f8e2312/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:01:49.689667 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad266a1c-a8df-4d0b-9404-96fe6d425a50 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:49.689950 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad266a1c-a8df-4d0b-9404-96fe6d425a50 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:49.690224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad266a1c-a8df-4d0b-9404-96fe6d425a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:49.718897 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-ad266a1c-a8df-4d0b-9404-96fe6d425a50 None None] MFA Rules not processed for user `70d9221ac61746d8ad6b4abb2f8e2312`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:49.720248 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-ad266a1c-a8df-4d0b-9404-96fe6d425a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:49.793740 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1260/2528] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:01:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:01:49.798899 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102aee1-c957-4470-afd0-eafd43324bb0 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:49.864406 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102aee1-c957-4470-afd0-eafd43324bb0 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:49.869922 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cea637-5457-4171-b14e-109a72ce0452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:49.870595 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cea637-5457-4171-b14e-109a72ce0452 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:49.870871 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cea637-5457-4171-b14e-109a72ce0452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:49.871142 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cea637-5457-4171-b14e-109a72ce0452 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:49.871886 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cea637-5457-4171-b14e-109a72ce0452 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:49.873889 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cea637-5457-4171-b14e-109a72ce0452 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:49.900831 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1269/2529] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:01:49 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:01:49.905085 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad266a1c-a8df-4d0b-9404-96fe6d425a50 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:49.916808 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad266a1c-a8df-4d0b-9404-96fe6d425a50 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:49.946708 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:49.983363 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3c309-968f-4101-864d-d36f94538555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:49.984065 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3c309-968f-4101-864d-d36f94538555 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:49.984355 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3c309-968f-4101-864d-d36f94538555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:49.984635 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3c309-968f-4101-864d-d36f94538555 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:49.985337 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c3c309-968f-4101-864d-d36f94538555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:49.987356 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c3c309-968f-4101-864d-d36f94538555 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:50.008281 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1261/2530] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:01:49 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:01:50.012498 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cea637-5457-4171-b14e-109a72ce0452 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:50.023218 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cea637-5457-4171-b14e-109a72ce0452 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:50.028841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119a9f4-d281-4288-82cb-d6e73ce7a2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:50.029526 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119a9f4-d281-4288-82cb-d6e73ce7a2f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:50.029801 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119a9f4-d281-4288-82cb-d6e73ce7a2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:50.030074 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119a9f4-d281-4288-82cb-d6e73ce7a2f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:50.030810 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119a9f4-d281-4288-82cb-d6e73ce7a2f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:50.032512 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119a9f4-d281-4288-82cb-d6e73ce7a2f5 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:50.043722 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1270/2531] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:01:50.048353 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3c309-968f-4101-864d-d36f94538555 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:50.063775 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3c309-968f-4101-864d-d36f94538555 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:50.072116 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443c852-b573-4c82-a887-43ab2723e858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:50.072999 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443c852-b573-4c82-a887-43ab2723e858 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:50.073271 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443c852-b573-4c82-a887-43ab2723e858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:50.073542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443c852-b573-4c82-a887-43ab2723e858 admin admin] PATH_INFO: `/v3/projects/3687c6c1a2d64911a682f1cd01a19306/users/3586fc1c276c4339b822ea9067fe7539/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:50.089387 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443c852-b573-4c82-a887-43ab2723e858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3687c6c1a2d64911a682f1cd01a19306, user_id=3586fc1c276c4339b822ea9067fe7539, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:50.092431 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443c852-b573-4c82-a887-43ab2723e858 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:50.107143 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1262/2532] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:01:50 2022] PUT /identity/v3/projects/3687c6c1a2d64911a682f1cd01a19306/users/3586fc1c276c4339b822ea9067fe7539/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:01:50.111164 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119a9f4-d281-4288-82cb-d6e73ce7a2f5 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:50.122023 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119a9f4-d281-4288-82cb-d6e73ce7a2f5 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:50.126105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:50.181991 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c3ad3-2914-43f7-af84-c3fe2aaede4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:50.182691 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c3ad3-2914-43f7-af84-c3fe2aaede4e admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:50.182960 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c3ad3-2914-43f7-af84-c3fe2aaede4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:50.183223 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c3ad3-2914-43f7-af84-c3fe2aaede4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:50.183956 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c3ad3-2914-43f7-af84-c3fe2aaede4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:50.185581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c3ad3-2914-43f7-af84-c3fe2aaede4e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:50.196041 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1271/2533] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:01:50.200450 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443c852-b573-4c82-a887-43ab2723e858 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:50.211722 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443c852-b573-4c82-a887-43ab2723e858 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:50.217694 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254a50f-eab4-4f6d-97b5-3152e7993877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:50.218633 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254a50f-eab4-4f6d-97b5-3152e7993877 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:50.218915 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254a50f-eab4-4f6d-97b5-3152e7993877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:50.219212 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254a50f-eab4-4f6d-97b5-3152e7993877 admin admin] PATH_INFO: `/v3/projects/3687c6c1a2d64911a682f1cd01a19306/users/3586fc1c276c4339b822ea9067fe7539/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:50.221494 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8254a50f-eab4-4f6d-97b5-3152e7993877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3687c6c1a2d64911a682f1cd01a19306, user_id=3586fc1c276c4339b822ea9067fe7539, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:50.224235 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8254a50f-eab4-4f6d-97b5-3152e7993877 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:50.238908 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1263/2534] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:01:50 2022] PUT /identity/v3/projects/3687c6c1a2d64911a682f1cd01a19306/users/3586fc1c276c4339b822ea9067fe7539/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:01:50.249303 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d15bb-8356-46fe-bead-4c5e96182fd1 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:50.249591 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d15bb-8356-46fe-bead-4c5e96182fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:50.249866 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d15bb-8356-46fe-bead-4c5e96182fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:50.277726 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-fe4d15bb-8356-46fe-bead-4c5e96182fd1 None None] MFA Rules not processed for user `3586fc1c276c4339b822ea9067fe7539`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:50.278922 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fe4d15bb-8356-46fe-bead-4c5e96182fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:50.347749 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1272/2535] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:01:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:01:50.360315 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254a50f-eab4-4f6d-97b5-3152e7993877 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:50.362374 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-8254a50f-eab4-4f6d-97b5-3152e7993877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:50.422595 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254a50f-eab4-4f6d-97b5-3152e7993877 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:50.427217 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb4732-9015-4f7b-99ce-26e464c34d26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:50.427903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb4732-9015-4f7b-99ce-26e464c34d26 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:50.428187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb4732-9015-4f7b-99ce-26e464c34d26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:50.428461 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb4732-9015-4f7b-99ce-26e464c34d26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:50.487437 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb4732-9015-4f7b-99ce-26e464c34d26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:50.488892 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb4732-9015-4f7b-99ce-26e464c34d26 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:50.498001 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1264/2536] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:01:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 06:01:50.929962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d15bb-8356-46fe-bead-4c5e96182fd1 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:50.931574 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-fe4d15bb-8356-46fe-bead-4c5e96182fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:50.993382 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d15bb-8356-46fe-bead-4c5e96182fd1 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:50.997846 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5c5c6-673f-46ed-8ce6-a40020b5867a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:50.998492 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5c5c6-673f-46ed-8ce6-a40020b5867a service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:50.998773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5c5c6-673f-46ed-8ce6-a40020b5867a service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:50.999050 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5c5c6-673f-46ed-8ce6-a40020b5867a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:51.001029 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e5d5c5c6-673f-46ed-8ce6-a40020b5867a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:51.049838 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:51.072968 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5c5c6-673f-46ed-8ce6-a40020b5867a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:51.074448 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5c5c6-673f-46ed-8ce6-a40020b5867a service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:51.084541 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1273/2537] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:01:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:01:52.014027 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb4732-9015-4f7b-99ce-26e464c34d26 service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:52.023631 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb4732-9015-4f7b-99ce-26e464c34d26 service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:52.027652 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506b312-eb92-44e6-86c2-184a1f5bfbb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:52.029490 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506b312-eb92-44e6-86c2-184a1f5bfbb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:52.029490 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506b312-eb92-44e6-86c2-184a1f5bfbb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:52.029490 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506b312-eb92-44e6-86c2-184a1f5bfbb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:52.066538 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:52.094832 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506b312-eb92-44e6-86c2-184a1f5bfbb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:52.096652 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506b312-eb92-44e6-86c2-184a1f5bfbb2 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:52.107066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1265/2538] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:01:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:01:52.667573 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5c5c6-673f-46ed-8ce6-a40020b5867a service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:52.677786 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5c5c6-673f-46ed-8ce6-a40020b5867a service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:52.685804 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4370b-cd5f-482a-99c7-494c8412415d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:52.686742 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4370b-cd5f-482a-99c7-494c8412415d service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:52.687028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4370b-cd5f-482a-99c7-494c8412415d service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:52.687345 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4370b-cd5f-482a-99c7-494c8412415d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:52.698045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4370b-cd5f-482a-99c7-494c8412415d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:52.699701 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4370b-cd5f-482a-99c7-494c8412415d service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:52.710242 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1274/2539] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:01:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:01:54.143537 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506b312-eb92-44e6-86c2-184a1f5bfbb2 service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:54.145385 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-0506b312-eb92-44e6-86c2-184a1f5bfbb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:54.160327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506b312-eb92-44e6-86c2-184a1f5bfbb2 service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:54.165224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85322d17-e2ce-4cf7-9d23-94eeef72cd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:54.166321 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85322d17-e2ce-4cf7-9d23-94eeef72cd41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:54.166766 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85322d17-e2ce-4cf7-9d23-94eeef72cd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:54.167077 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85322d17-e2ce-4cf7-9d23-94eeef72cd41 admin admin] PATH_INFO: `/v3/users/75f4eab7b971447bbe964e79fa6bf3c5` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:54.168613 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85322d17-e2ce-4cf7-9d23-94eeef72cd41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75f4eab7b971447bbe964e79fa6bf3c5)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:54.170571 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85322d17-e2ce-4cf7-9d23-94eeef72cd41 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:54.223549 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-85322d17-e2ce-4cf7-9d23-94eeef72cd41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75f4eab7b971447bbe964e79fa6bf3c5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:54.224264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-85322d17-e2ce-4cf7-9d23-94eeef72cd41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75f4eab7b971447bbe964e79fa6bf3c5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:54.232845 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-85322d17-e2ce-4cf7-9d23-94eeef72cd41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75f4eab7b971447bbe964e79fa6bf3c5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:54.233472 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-85322d17-e2ce-4cf7-9d23-94eeef72cd41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75f4eab7b971447bbe964e79fa6bf3c5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:54.246200 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-85322d17-e2ce-4cf7-9d23-94eeef72cd41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75f4eab7b971447bbe964e79fa6bf3c5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:54.258787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1266/2540] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:01:54 2022] DELETE /identity/v3/users/75f4eab7b971447bbe964e79fa6bf3c5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:01:54.439353 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4370b-cd5f-482a-99c7-494c8412415d service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:54.451467 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4370b-cd5f-482a-99c7-494c8412415d service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:54.511849 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a3c61-4044-42b8-ae95-499c783f5517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:54.512763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a3c61-4044-42b8-ae95-499c783f5517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:54.513028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a3c61-4044-42b8-ae95-499c783f5517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:54.513317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a3c61-4044-42b8-ae95-499c783f5517 admin admin] PATH_INFO: `/v3/projects/362564732c384a81937b954dd6e4370e` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:54.514572 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a3c61-4044-42b8-ae95-499c783f5517 admin admin] RBAC: Authorizing `identity:delete_project(project_id=362564732c384a81937b954dd6e4370e)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:54.516573 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a3c61-4044-42b8-ae95-499c783f5517 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:54.570108 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f80a3c61-4044-42b8-ae95-499c783f5517 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '362564732c384a81937b954dd6e4370e', 'request_id': 'req-f80a3c61-4044-42b8-ae95-499c783f5517'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:54.576902 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f80a3c61-4044-42b8-ae95-499c783f5517 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '362564732c384a81937b954dd6e4370e', 'request_id': 'req-f80a3c61-4044-42b8-ae95-499c783f5517'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:54.587097 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f80a3c61-4044-42b8-ae95-499c783f5517 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '362564732c384a81937b954dd6e4370e', 'request_id': 'req-f80a3c61-4044-42b8-ae95-499c783f5517'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:54.599234 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f80a3c61-4044-42b8-ae95-499c783f5517 admin admin] The token cache is being invalidate because project 362564732c384a81937b954dd6e4370e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:01:54.599533 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f80a3c61-4044-42b8-ae95-499c783f5517 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:54.600468 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-f80a3c61-4044-42b8-ae95-499c783f5517 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:54.602207 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1275/2541] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:01:54 2022] DELETE /identity/v3/projects/362564732c384a81937b954dd6e4370e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:01:54.607820 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae6eef-d4ef-44e2-b0d9-b8b899ba762d None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:54.608114 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae6eef-d4ef-44e2-b0d9-b8b899ba762d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:54.608393 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae6eef-d4ef-44e2-b0d9-b8b899ba762d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:54.627824 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-b0ae6eef-d4ef-44e2-b0d9-b8b899ba762d None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:54.629049 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b0ae6eef-d4ef-44e2-b0d9-b8b899ba762d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:54.695990 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1267/2542] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:01:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:01:54.704810 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503a1ee-c61d-4621-94dc-d299f5ee8364 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:54.705101 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503a1ee-c61d-4621-94dc-d299f5ee8364 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:54.705375 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503a1ee-c61d-4621-94dc-d299f5ee8364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:54.724337 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-9503a1ee-c61d-4621-94dc-d299f5ee8364 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:54.725542 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9503a1ee-c61d-4621-94dc-d299f5ee8364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:54.734119 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1276/2543] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:01:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:01:54.738488 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae6eef-d4ef-44e2-b0d9-b8b899ba762d None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:54.749074 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae6eef-d4ef-44e2-b0d9-b8b899ba762d None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:54.754771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4fd23-28ce-46d6-9ed1-465cabe056ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:54.755507 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4fd23-28ce-46d6-9ed1-465cabe056ae admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:54.755797 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4fd23-28ce-46d6-9ed1-465cabe056ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:54.756073 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4fd23-28ce-46d6-9ed1-465cabe056ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:54.756818 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4fd23-28ce-46d6-9ed1-465cabe056ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 06:01:54.757124 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4fd23-28ce-46d6-9ed1-465cabe056ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:54.758751 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4fd23-28ce-46d6-9ed1-465cabe056ae admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:54.771449 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1268/2544] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 06:01:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 06:01:54.775702 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503a1ee-c61d-4621-94dc-d299f5ee8364 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:54.785504 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503a1ee-c61d-4621-94dc-d299f5ee8364 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:54.791414 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa0f44-97a1-4a39-b516-4ea06350d7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:54.792104 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa0f44-97a1-4a39-b516-4ea06350d7dc admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:54.792385 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa0f44-97a1-4a39-b516-4ea06350d7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:54.792659 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa0f44-97a1-4a39-b516-4ea06350d7dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:54.793343 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa0f44-97a1-4a39-b516-4ea06350d7dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:54.795329 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa0f44-97a1-4a39-b516-4ea06350d7dc admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:54.825397 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1277/2545] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:01:54 2022] POST /identity/v3/projects => generated 403 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:01:54.830999 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4fd23-28ce-46d6-9ed1-465cabe056ae admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:54.844563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4fd23-28ce-46d6-9ed1-465cabe056ae admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:54.876124 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:54.905596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bbb5c-533e-4536-a69a-e2b7213b0fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:54.906268 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bbb5c-533e-4536-a69a-e2b7213b0fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:54.906613 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bbb5c-533e-4536-a69a-e2b7213b0fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:54.906960 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bbb5c-533e-4536-a69a-e2b7213b0fb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:54.907810 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bbb5c-533e-4536-a69a-e2b7213b0fb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:54.909743 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bbb5c-533e-4536-a69a-e2b7213b0fb2 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:54.931334 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1269/2546] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:01:54 2022] POST /identity/v3/users => generated 302 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:01:54.935109 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa0f44-97a1-4a39-b516-4ea06350d7dc admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:54.945855 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa0f44-97a1-4a39-b516-4ea06350d7dc admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:54.950872 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f1228-8635-45a3-adcb-43eaad359e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:54.951515 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f1228-8635-45a3-adcb-43eaad359e40 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:54.951797 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f1228-8635-45a3-adcb-43eaad359e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:54.952074 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f1228-8635-45a3-adcb-43eaad359e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:54.952794 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f1228-8635-45a3-adcb-43eaad359e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:54.954399 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f1228-8635-45a3-adcb-43eaad359e40 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:54.965240 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1278/2547] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:01:54.969791 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bbb5c-533e-4536-a69a-e2b7213b0fb2 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:54.981783 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bbb5c-533e-4536-a69a-e2b7213b0fb2 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:54.987640 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d751fff-46d9-43e1-ba22-52757a2f9012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:54.988305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d751fff-46d9-43e1-ba22-52757a2f9012 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:54.988589 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d751fff-46d9-43e1-ba22-52757a2f9012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:54.988861 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d751fff-46d9-43e1-ba22-52757a2f9012 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:54.989620 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d751fff-46d9-43e1-ba22-52757a2f9012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:54.991267 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d751fff-46d9-43e1-ba22-52757a2f9012 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:55.002915 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1270/2548] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:01:55.007348 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f1228-8635-45a3-adcb-43eaad359e40 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:55.017612 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f1228-8635-45a3-adcb-43eaad359e40 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:55.023158 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac6445-857d-42e4-bc76-783cd7bcfd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:55.024089 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac6445-857d-42e4-bc76-783cd7bcfd85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:55.024399 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac6445-857d-42e4-bc76-783cd7bcfd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:55.024677 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac6445-857d-42e4-bc76-783cd7bcfd85 admin admin] PATH_INFO: `/v3/projects/840b9c4a2cdb4a108149526d8053f595/users/16001ae8f27442c4aaa3de7137753af5/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:55.037597 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:55.041308 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac6445-857d-42e4-bc76-783cd7bcfd85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=840b9c4a2cdb4a108149526d8053f595, user_id=16001ae8f27442c4aaa3de7137753af5, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:55.044859 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac6445-857d-42e4-bc76-783cd7bcfd85 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:55.058890 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1279/2549] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:01:55 2022] PUT /identity/v3/projects/840b9c4a2cdb4a108149526d8053f595/users/16001ae8f27442c4aaa3de7137753af5/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:01:55.069530 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c2aa6-0735-4ae8-bcfe-d81240c028b6 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:55.069856 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c2aa6-0735-4ae8-bcfe-d81240c028b6 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:55.070172 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c2aa6-0735-4ae8-bcfe-d81240c028b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:55.098220 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-cd6c2aa6-0735-4ae8-bcfe-d81240c028b6 None None] MFA Rules not processed for user `16001ae8f27442c4aaa3de7137753af5`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:55.099529 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-cd6c2aa6-0735-4ae8-bcfe-d81240c028b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:55.169365 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1271/2550] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:01:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:01:55.176647 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac6445-857d-42e4-bc76-783cd7bcfd85 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:55.245835 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac6445-857d-42e4-bc76-783cd7bcfd85 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:55.250565 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677224c-4642-4279-9ccf-7aceec719bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:55.251273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677224c-4642-4279-9ccf-7aceec719bed admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:55.251560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677224c-4642-4279-9ccf-7aceec719bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:55.251837 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677224c-4642-4279-9ccf-7aceec719bed admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:55.252522 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677224c-4642-4279-9ccf-7aceec719bed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:55.254452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677224c-4642-4279-9ccf-7aceec719bed admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:55.283292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1280/2551] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:01:55 2022] POST /identity/v3/projects => generated 405 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:01:55.288212 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c2aa6-0735-4ae8-bcfe-d81240c028b6 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:55.302368 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c2aa6-0735-4ae8-bcfe-d81240c028b6 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:55.368006 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc05a9-ee3b-4feb-b30a-a9c001fe0318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:55.368650 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc05a9-ee3b-4feb-b30a-a9c001fe0318 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:55.368932 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc05a9-ee3b-4feb-b30a-a9c001fe0318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:55.369220 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc05a9-ee3b-4feb-b30a-a9c001fe0318 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:55.370005 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc05a9-ee3b-4feb-b30a-a9c001fe0318 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:55.371986 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc05a9-ee3b-4feb-b30a-a9c001fe0318 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:55.394820 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1272/2552] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:01:55 2022] POST /identity/v3/users => generated 309 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:01:55.398847 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677224c-4642-4279-9ccf-7aceec719bed admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:55.410145 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677224c-4642-4279-9ccf-7aceec719bed admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:55.415072 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40313377-ad80-4ae4-8a02-4f3876b96e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:55.415806 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40313377-ad80-4ae4-8a02-4f3876b96e0a admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:55.416091 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40313377-ad80-4ae4-8a02-4f3876b96e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:55.416365 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40313377-ad80-4ae4-8a02-4f3876b96e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:55.417189 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40313377-ad80-4ae4-8a02-4f3876b96e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:55.418856 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40313377-ad80-4ae4-8a02-4f3876b96e0a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:55.431217 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1281/2553] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 06:01:55.434371 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc05a9-ee3b-4feb-b30a-a9c001fe0318 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:55.445073 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc05a9-ee3b-4feb-b30a-a9c001fe0318 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:55.449709 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d430db-5750-477d-b229-da2929f242f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:55.450612 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d430db-5750-477d-b229-da2929f242f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:55.450901 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d430db-5750-477d-b229-da2929f242f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:55.451168 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d430db-5750-477d-b229-da2929f242f2 admin admin] PATH_INFO: `/v3/projects/b6555c0141a74dc583bac33a88b23323/users/3092725dc5b247d1b6b58fc2e448672e/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:55.467457 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d430db-5750-477d-b229-da2929f242f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6555c0141a74dc583bac33a88b23323, user_id=3092725dc5b247d1b6b58fc2e448672e, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:55.470107 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d430db-5750-477d-b229-da2929f242f2 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:55.484851 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1273/2554] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:01:55 2022] PUT /identity/v3/projects/b6555c0141a74dc583bac33a88b23323/users/3092725dc5b247d1b6b58fc2e448672e/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:01:55.488799 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40313377-ad80-4ae4-8a02-4f3876b96e0a admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:55.499652 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40313377-ad80-4ae4-8a02-4f3876b96e0a admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:55.571856 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd215078-115a-4cb8-8df6-372d0cd69c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:55.572763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd215078-115a-4cb8-8df6-372d0cd69c1a admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:55.573179 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd215078-115a-4cb8-8df6-372d0cd69c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:55.573554 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd215078-115a-4cb8-8df6-372d0cd69c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:55.574450 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd215078-115a-4cb8-8df6-372d0cd69c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:55.576249 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd215078-115a-4cb8-8df6-372d0cd69c1a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:55.587431 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1282/2555] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:01:55.591890 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d430db-5750-477d-b229-da2929f242f2 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:55.602119 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d430db-5750-477d-b229-da2929f242f2 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:55.607239 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a263a0-feae-4d75-9a71-00ef0c1bbcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:55.608187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a263a0-feae-4d75-9a71-00ef0c1bbcc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:55.608464 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a263a0-feae-4d75-9a71-00ef0c1bbcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:55.608823 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a263a0-feae-4d75-9a71-00ef0c1bbcc1 admin admin] PATH_INFO: `/v3/projects/b6555c0141a74dc583bac33a88b23323/users/3092725dc5b247d1b6b58fc2e448672e/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:55.611167 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a263a0-feae-4d75-9a71-00ef0c1bbcc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6555c0141a74dc583bac33a88b23323, user_id=3092725dc5b247d1b6b58fc2e448672e, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:55.613882 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a263a0-feae-4d75-9a71-00ef0c1bbcc1 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:55.616172 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:55.626053 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1274/2556] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:01:55 2022] PUT /identity/v3/projects/b6555c0141a74dc583bac33a88b23323/users/3092725dc5b247d1b6b58fc2e448672e/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:01:55.636788 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3661bf7-9866-4726-966c-c49e6d20539d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:55.637139 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3661bf7-9866-4726-966c-c49e6d20539d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:55.637344 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3661bf7-9866-4726-966c-c49e6d20539d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:55.663986 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-c3661bf7-9866-4726-966c-c49e6d20539d None None] MFA Rules not processed for user `3092725dc5b247d1b6b58fc2e448672e`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:55.665263 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c3661bf7-9866-4726-966c-c49e6d20539d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:55.713672 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:55.736724 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1283/2557] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:01:55 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:01:55.747661 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a263a0-feae-4d75-9a71-00ef0c1bbcc1 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:55.749662 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-97a263a0-feae-4d75-9a71-00ef0c1bbcc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:55.810654 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a263a0-feae-4d75-9a71-00ef0c1bbcc1 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:55.814326 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b95d5d-e506-4175-ae2e-16ee7a9b8f99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:55.814968 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b95d5d-e506-4175-ae2e-16ee7a9b8f99 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:55.815283 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b95d5d-e506-4175-ae2e-16ee7a9b8f99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:55.815557 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b95d5d-e506-4175-ae2e-16ee7a9b8f99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:55.824530 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b95d5d-e506-4175-ae2e-16ee7a9b8f99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:55.826008 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b95d5d-e506-4175-ae2e-16ee7a9b8f99 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:55.835759 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1275/2558] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:01:55 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:01:55.968401 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3661bf7-9866-4726-966c-c49e6d20539d None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:56.034082 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3661bf7-9866-4726-966c-c49e6d20539d None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:56.038896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a69ed4-8220-403b-8fa0-40db76ccf864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:56.039816 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a69ed4-8220-403b-8fa0-40db76ccf864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:56.040098 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a69ed4-8220-403b-8fa0-40db76ccf864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:56.040383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a69ed4-8220-403b-8fa0-40db76ccf864 admin admin] PATH_INFO: `/v3/users/16001ae8f27442c4aaa3de7137753af5` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:56.041595 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a69ed4-8220-403b-8fa0-40db76ccf864 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16001ae8f27442c4aaa3de7137753af5)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:56.043688 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a69ed4-8220-403b-8fa0-40db76ccf864 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:56.091397 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-93a69ed4-8220-403b-8fa0-40db76ccf864 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16001ae8f27442c4aaa3de7137753af5'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:56.098120 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-93a69ed4-8220-403b-8fa0-40db76ccf864 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16001ae8f27442c4aaa3de7137753af5'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:56.107588 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-93a69ed4-8220-403b-8fa0-40db76ccf864 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16001ae8f27442c4aaa3de7137753af5'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:56.108392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-93a69ed4-8220-403b-8fa0-40db76ccf864 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16001ae8f27442c4aaa3de7137753af5'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:56.120794 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-93a69ed4-8220-403b-8fa0-40db76ccf864 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16001ae8f27442c4aaa3de7137753af5'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:56.126717 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1284/2559] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:01:55 2022] DELETE /identity/v3/users/16001ae8f27442c4aaa3de7137753af5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:01:56.131582 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1133c-1cf7-4e39-9f98-3f89243bab5a None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:56.131868 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1133c-1cf7-4e39-9f98-3f89243bab5a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:56.132139 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1133c-1cf7-4e39-9f98-3f89243bab5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:56.150572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-8cb1133c-1cf7-4e39-9f98-3f89243bab5a None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:56.151914 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-8cb1133c-1cf7-4e39-9f98-3f89243bab5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:56.216293 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1276/2560] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:01:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:01:56.226027 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a69ed4-8220-403b-8fa0-40db76ccf864 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:56.227656 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-93a69ed4-8220-403b-8fa0-40db76ccf864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:56.289873 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a69ed4-8220-403b-8fa0-40db76ccf864 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:56.293982 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b44b17-5ef0-49d2-ba2c-95182015585e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:56.294622 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b44b17-5ef0-49d2-ba2c-95182015585e service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:56.294894 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b44b17-5ef0-49d2-ba2c-95182015585e service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:56.295213 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b44b17-5ef0-49d2-ba2c-95182015585e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:56.304860 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b44b17-5ef0-49d2-ba2c-95182015585e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:56.306305 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b44b17-5ef0-49d2-ba2c-95182015585e service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:56.317474 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1285/2561] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:01:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:01:56.671558 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1133c-1cf7-4e39-9f98-3f89243bab5a None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:56.673502 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-8cb1133c-1cf7-4e39-9f98-3f89243bab5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:56.685684 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1133c-1cf7-4e39-9f98-3f89243bab5a None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:56.690201 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a73b3-d752-4665-af3a-7e0a1b30d630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:56.691097 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a73b3-d752-4665-af3a-7e0a1b30d630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:56.691411 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a73b3-d752-4665-af3a-7e0a1b30d630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:56.691684 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a73b3-d752-4665-af3a-7e0a1b30d630 admin admin] PATH_INFO: `/v3/users/473cc15d3cb74834ba4e0fbd8e0e1f02` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:56.692873 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a73b3-d752-4665-af3a-7e0a1b30d630 admin admin] RBAC: Authorizing `identity:delete_user(user_id=473cc15d3cb74834ba4e0fbd8e0e1f02)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:56.694840 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a73b3-d752-4665-af3a-7e0a1b30d630 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:56.747599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-bc1a73b3-d752-4665-af3a-7e0a1b30d630 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '473cc15d3cb74834ba4e0fbd8e0e1f02'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:56.748298 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-bc1a73b3-d752-4665-af3a-7e0a1b30d630 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '473cc15d3cb74834ba4e0fbd8e0e1f02'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:56.758146 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-bc1a73b3-d752-4665-af3a-7e0a1b30d630 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '473cc15d3cb74834ba4e0fbd8e0e1f02'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:56.758835 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-bc1a73b3-d752-4665-af3a-7e0a1b30d630 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '473cc15d3cb74834ba4e0fbd8e0e1f02'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:56.774232 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-bc1a73b3-d752-4665-af3a-7e0a1b30d630 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '473cc15d3cb74834ba4e0fbd8e0e1f02'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:56.786617 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1277/2562] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:01:56 2022] DELETE /identity/v3/users/473cc15d3cb74834ba4e0fbd8e0e1f02 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:01:56.791444 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3bdef5-96bd-4ed5-a1ba-92a06df90325 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:56.792181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3bdef5-96bd-4ed5-a1ba-92a06df90325 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:56.792181 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3bdef5-96bd-4ed5-a1ba-92a06df90325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:56.809678 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-1e3bdef5-96bd-4ed5-a1ba-92a06df90325 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:56.810953 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1e3bdef5-96bd-4ed5-a1ba-92a06df90325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:56.814964 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:56.868715 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a73b3-d752-4665-af3a-7e0a1b30d630 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:56.870307 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-bc1a73b3-d752-4665-af3a-7e0a1b30d630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:56.878413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1286/2563] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:01:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:01:56.885963 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a73b3-d752-4665-af3a-7e0a1b30d630 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:56.889155 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3bdef5-96bd-4ed5-a1ba-92a06df90325 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:56.890625 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1e3bdef5-96bd-4ed5-a1ba-92a06df90325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:56.891016 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34b6d4-aa8d-4a11-b061-5c478eaf9d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:56.892178 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34b6d4-aa8d-4a11-b061-5c478eaf9d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:56.892470 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34b6d4-aa8d-4a11-b061-5c478eaf9d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:56.892801 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34b6d4-aa8d-4a11-b061-5c478eaf9d24 admin admin] PATH_INFO: `/v3/projects/840b9c4a2cdb4a108149526d8053f595` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:56.893956 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34b6d4-aa8d-4a11-b061-5c478eaf9d24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=840b9c4a2cdb4a108149526d8053f595)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:56.895939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34b6d4-aa8d-4a11-b061-5c478eaf9d24 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:56.898672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:56.946946 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-6d34b6d4-aa8d-4a11-b061-5c478eaf9d24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '840b9c4a2cdb4a108149526d8053f595', 'request_id': 'req-6d34b6d4-aa8d-4a11-b061-5c478eaf9d24'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:56.954826 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-6d34b6d4-aa8d-4a11-b061-5c478eaf9d24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '840b9c4a2cdb4a108149526d8053f595', 'request_id': 'req-6d34b6d4-aa8d-4a11-b061-5c478eaf9d24'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:56.956674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3bdef5-96bd-4ed5-a1ba-92a06df90325 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:56.962100 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-6d34b6d4-aa8d-4a11-b061-5c478eaf9d24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '840b9c4a2cdb4a108149526d8053f595', 'request_id': 'req-6d34b6d4-aa8d-4a11-b061-5c478eaf9d24'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:56.972814 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-6d34b6d4-aa8d-4a11-b061-5c478eaf9d24 admin admin] The token cache is being invalidate because project 840b9c4a2cdb4a108149526d8053f595 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:01:56.973106 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-6d34b6d4-aa8d-4a11-b061-5c478eaf9d24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:56.973756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-6d34b6d4-aa8d-4a11-b061-5c478eaf9d24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:56.975383 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1278/2564] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:01:56 2022] DELETE /identity/v3/projects/840b9c4a2cdb4a108149526d8053f595 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 06:01:56.979658 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34b6d4-aa8d-4a11-b061-5c478eaf9d24 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:56.980985 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-6d34b6d4-aa8d-4a11-b061-5c478eaf9d24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:57.009476 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819dc231-d782-406c-a5f4-74e34f70d038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:57.010020 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819dc231-d782-406c-a5f4-74e34f70d038 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:57.010302 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819dc231-d782-406c-a5f4-74e34f70d038 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:57.010736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819dc231-d782-406c-a5f4-74e34f70d038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:57.012552 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-819dc231-d782-406c-a5f4-74e34f70d038 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:57.045217 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34b6d4-aa8d-4a11-b061-5c478eaf9d24 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:57.049843 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f7370-49a8-41b9-a8d7-04d74c8a77d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:57.050724 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f7370-49a8-41b9-a8d7-04d74c8a77d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:57.051027 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f7370-49a8-41b9-a8d7-04d74c8a77d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:57.051334 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f7370-49a8-41b9-a8d7-04d74c8a77d6 admin admin] PATH_INFO: `/v3/users/3092725dc5b247d1b6b58fc2e448672e` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:57.052513 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f7370-49a8-41b9-a8d7-04d74c8a77d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3092725dc5b247d1b6b58fc2e448672e)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:57.054470 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f7370-49a8-41b9-a8d7-04d74c8a77d6 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:57.073280 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819dc231-d782-406c-a5f4-74e34f70d038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:57.074714 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819dc231-d782-406c-a5f4-74e34f70d038 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:57.085244 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1287/2565] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:01:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 06:01:57.101522 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f15f7370-49a8-41b9-a8d7-04d74c8a77d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3092725dc5b247d1b6b58fc2e448672e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:57.102182 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f15f7370-49a8-41b9-a8d7-04d74c8a77d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3092725dc5b247d1b6b58fc2e448672e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:57.110821 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f15f7370-49a8-41b9-a8d7-04d74c8a77d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3092725dc5b247d1b6b58fc2e448672e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:57.111744 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f15f7370-49a8-41b9-a8d7-04d74c8a77d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3092725dc5b247d1b6b58fc2e448672e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:57.126028 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f15f7370-49a8-41b9-a8d7-04d74c8a77d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3092725dc5b247d1b6b58fc2e448672e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:57.138926 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1279/2566] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:01:56 2022] DELETE /identity/v3/users/3092725dc5b247d1b6b58fc2e448672e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 06:01:57.378387 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819dc231-d782-406c-a5f4-74e34f70d038 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:57.380256 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-819dc231-d782-406c-a5f4-74e34f70d038 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:57.403124 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819dc231-d782-406c-a5f4-74e34f70d038 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:57.416856 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:57.427990 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f7370-49a8-41b9-a8d7-04d74c8a77d6 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:57.429314 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f15f7370-49a8-41b9-a8d7-04d74c8a77d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:57.444403 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:57.474713 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfa629-5984-45b9-9886-f426ce06842e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:57.475616 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfa629-5984-45b9-9886-f426ce06842e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:57.475892 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfa629-5984-45b9-9886-f426ce06842e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:57.476163 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfa629-5984-45b9-9886-f426ce06842e admin admin] PATH_INFO: `/v3/projects/197b9495c00b466faf995efb521acb1b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:57.477322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfa629-5984-45b9-9886-f426ce06842e admin admin] RBAC: Authorizing `identity:delete_project(project_id=197b9495c00b466faf995efb521acb1b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:57.479704 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfa629-5984-45b9-9886-f426ce06842e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:57.504092 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f7370-49a8-41b9-a8d7-04d74c8a77d6 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:57.509355 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7c315-8305-49ba-b6c6-da08c9c57af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:57.510297 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7c315-8305-49ba-b6c6-da08c9c57af5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:57.510612 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7c315-8305-49ba-b6c6-da08c9c57af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:57.510887 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7c315-8305-49ba-b6c6-da08c9c57af5 admin admin] PATH_INFO: `/v3/projects/b6555c0141a74dc583bac33a88b23323` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:57.512087 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd7c315-8305-49ba-b6c6-da08c9c57af5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6555c0141a74dc583bac33a88b23323)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:57.513996 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd7c315-8305-49ba-b6c6-da08c9c57af5 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:57.526156 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a3dfa629-5984-45b9-9886-f426ce06842e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '197b9495c00b466faf995efb521acb1b', 'request_id': 'req-a3dfa629-5984-45b9-9886-f426ce06842e'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:57.535641 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a3dfa629-5984-45b9-9886-f426ce06842e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '197b9495c00b466faf995efb521acb1b', 'request_id': 'req-a3dfa629-5984-45b9-9886-f426ce06842e'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:57.549392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a3dfa629-5984-45b9-9886-f426ce06842e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '197b9495c00b466faf995efb521acb1b', 'request_id': 'req-a3dfa629-5984-45b9-9886-f426ce06842e'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:57.560059 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a3dfa629-5984-45b9-9886-f426ce06842e admin admin] The token cache is being invalidate because project 197b9495c00b466faf995efb521acb1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:01:57.560321 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a3dfa629-5984-45b9-9886-f426ce06842e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:57.560934 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a3dfa629-5984-45b9-9886-f426ce06842e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:57.562484 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1288/2567] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:01:57 2022] DELETE /identity/v3/projects/197b9495c00b466faf995efb521acb1b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:01:57.564363 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-2cd7c315-8305-49ba-b6c6-da08c9c57af5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6555c0141a74dc583bac33a88b23323', 'request_id': 'req-2cd7c315-8305-49ba-b6c6-da08c9c57af5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:57.566430 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfa629-5984-45b9-9886-f426ce06842e admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:57.567732 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a3dfa629-5984-45b9-9886-f426ce06842e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:57.573189 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-2cd7c315-8305-49ba-b6c6-da08c9c57af5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6555c0141a74dc583bac33a88b23323', 'request_id': 'req-2cd7c315-8305-49ba-b6c6-da08c9c57af5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:57.579991 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-2cd7c315-8305-49ba-b6c6-da08c9c57af5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6555c0141a74dc583bac33a88b23323', 'request_id': 'req-2cd7c315-8305-49ba-b6c6-da08c9c57af5'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:57.590731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-2cd7c315-8305-49ba-b6c6-da08c9c57af5 admin admin] The token cache is being invalidate because project b6555c0141a74dc583bac33a88b23323 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:01:57.591017 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-2cd7c315-8305-49ba-b6c6-da08c9c57af5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:57.591682 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-2cd7c315-8305-49ba-b6c6-da08c9c57af5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:57.593287 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1280/2568] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:01:57 2022] DELETE /identity/v3/projects/b6555c0141a74dc583bac33a88b23323 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:01:57.598156 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368fc1b-a66e-49c7-a778-b4b83c3ab0f8 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:57.598444 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368fc1b-a66e-49c7-a778-b4b83c3ab0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:57.598750 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368fc1b-a66e-49c7-a778-b4b83c3ab0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:57.617959 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-5368fc1b-a66e-49c7-a778-b4b83c3ab0f8 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:57.619270 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-5368fc1b-a66e-49c7-a778-b4b83c3ab0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:57.635950 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfa629-5984-45b9-9886-f426ce06842e admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:57.676590 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1281/2569] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 06:01:57.682885 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:57.686142 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a3b6c-a121-4992-9e74-40ac38acf49b None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:57.686648 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a3b6c-a121-4992-9e74-40ac38acf49b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:57.687000 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a3b6c-a121-4992-9e74-40ac38acf49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:57.693975 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26846edc-73d4-45c1-a69e-2b4a77c9b187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:57.694897 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26846edc-73d4-45c1-a69e-2b4a77c9b187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:57.695205 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26846edc-73d4-45c1-a69e-2b4a77c9b187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:57.695724 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26846edc-73d4-45c1-a69e-2b4a77c9b187 admin admin] PATH_INFO: `/v3/users/70d9221ac61746d8ad6b4abb2f8e2312` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:57.696926 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26846edc-73d4-45c1-a69e-2b4a77c9b187 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70d9221ac61746d8ad6b4abb2f8e2312)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:57.699204 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26846edc-73d4-45c1-a69e-2b4a77c9b187 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:57.705790 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-9d8a3b6c-a121-4992-9e74-40ac38acf49b None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:57.707003 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9d8a3b6c-a121-4992-9e74-40ac38acf49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:57.715636 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1282/2570] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:01:57.719932 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a3b6c-a121-4992-9e74-40ac38acf49b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:57.729828 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a3b6c-a121-4992-9e74-40ac38acf49b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:57.735633 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b48186-4e0d-4a93-8dca-f39460bb3f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:57.736299 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b48186-4e0d-4a93-8dca-f39460bb3f41 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:57.736595 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b48186-4e0d-4a93-8dca-f39460bb3f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:57.736863 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b48186-4e0d-4a93-8dca-f39460bb3f41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:57.737596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b48186-4e0d-4a93-8dca-f39460bb3f41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 06:01:57.737896 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b48186-4e0d-4a93-8dca-f39460bb3f41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:57.739592 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b48186-4e0d-4a93-8dca-f39460bb3f41 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:57.748220 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-26846edc-73d4-45c1-a69e-2b4a77c9b187 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70d9221ac61746d8ad6b4abb2f8e2312'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:57.751092 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1283/2571] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 06:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 06:01:57.755395 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b48186-4e0d-4a93-8dca-f39460bb3f41 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:57.759130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-26846edc-73d4-45c1-a69e-2b4a77c9b187 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70d9221ac61746d8ad6b4abb2f8e2312'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:57.765218 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b48186-4e0d-4a93-8dca-f39460bb3f41 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:57.768701 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-26846edc-73d4-45c1-a69e-2b4a77c9b187 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70d9221ac61746d8ad6b4abb2f8e2312'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:57.769443 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-26846edc-73d4-45c1-a69e-2b4a77c9b187 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70d9221ac61746d8ad6b4abb2f8e2312'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:57.770283 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fb7bb-a4a5-4fbe-a48e-50d11cbdecf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:57.770921 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fb7bb-a4a5-4fbe-a48e-50d11cbdecf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:57.771227 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fb7bb-a4a5-4fbe-a48e-50d11cbdecf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:57.771508 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fb7bb-a4a5-4fbe-a48e-50d11cbdecf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:57.772189 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fb7bb-a4a5-4fbe-a48e-50d11cbdecf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:57.774086 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fb7bb-a4a5-4fbe-a48e-50d11cbdecf2 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:57.782297 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-26846edc-73d4-45c1-a69e-2b4a77c9b187 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70d9221ac61746d8ad6b4abb2f8e2312'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:57.788529 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1289/2572] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:01:57 2022] DELETE /identity/v3/users/70d9221ac61746d8ad6b4abb2f8e2312 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 06:01:57.794237 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:57.801609 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1284/2573] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:01:57 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 06:01:57.806301 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26846edc-73d4-45c1-a69e-2b4a77c9b187 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:57.807844 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-26846edc-73d4-45c1-a69e-2b4a77c9b187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:57.876885 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26846edc-73d4-45c1-a69e-2b4a77c9b187 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:57.943105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddfdcb-2409-443d-b8d1-30a795d623bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:57.943771 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddfdcb-2409-443d-b8d1-30a795d623bc admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:57.944055 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddfdcb-2409-443d-b8d1-30a795d623bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:57.944320 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddfdcb-2409-443d-b8d1-30a795d623bc admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:57.945043 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddfdcb-2409-443d-b8d1-30a795d623bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:57.947078 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddfdcb-2409-443d-b8d1-30a795d623bc admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:57.972222 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1290/2574] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:01:57 2022] POST /identity/v3/users => generated 291 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:01:57.973573 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fb7bb-a4a5-4fbe-a48e-50d11cbdecf2 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:57.985451 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fb7bb-a4a5-4fbe-a48e-50d11cbdecf2 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:57.990814 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968c6c4-5e04-445c-ad56-61cc6a9a62ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:57.991621 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968c6c4-5e04-445c-ad56-61cc6a9a62ae admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:57.991857 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968c6c4-5e04-445c-ad56-61cc6a9a62ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:57.992156 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968c6c4-5e04-445c-ad56-61cc6a9a62ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:57.992885 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e968c6c4-5e04-445c-ad56-61cc6a9a62ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:57.994858 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e968c6c4-5e04-445c-ad56-61cc6a9a62ae admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:58.005328 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1285/2575] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:01:58.009879 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddfdcb-2409-443d-b8d1-30a795d623bc admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:58.022193 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddfdcb-2409-443d-b8d1-30a795d623bc admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:58.026778 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d68d05-840c-40f5-9e92-c1b4e1c7488d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:58.027477 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d68d05-840c-40f5-9e92-c1b4e1c7488d admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:58.027758 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d68d05-840c-40f5-9e92-c1b4e1c7488d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:58.028030 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d68d05-840c-40f5-9e92-c1b4e1c7488d admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:58.028741 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d68d05-840c-40f5-9e92-c1b4e1c7488d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:58.030793 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d68d05-840c-40f5-9e92-c1b4e1c7488d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:58.033060 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:58.043034 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1291/2576] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:01:58.047301 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968c6c4-5e04-445c-ad56-61cc6a9a62ae admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:58.058655 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968c6c4-5e04-445c-ad56-61cc6a9a62ae admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:58.064248 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdfe7d-65ab-4b77-b9ba-72323dcf9178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:58.065246 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdfe7d-65ab-4b77-b9ba-72323dcf9178 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:58.065590 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdfe7d-65ab-4b77-b9ba-72323dcf9178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:58.065978 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdfe7d-65ab-4b77-b9ba-72323dcf9178 admin admin] PATH_INFO: `/v3/projects/976fd696f7c845fa991ff985573c4b7c/users/1fa49db0691e4b81acda0371c6859dad/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:58.071982 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d68d05-840c-40f5-9e92-c1b4e1c7488d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:58.073882 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e1d68d05-840c-40f5-9e92-c1b4e1c7488d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:58.083056 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbdfe7d-65ab-4b77-b9ba-72323dcf9178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=976fd696f7c845fa991ff985573c4b7c, user_id=1fa49db0691e4b81acda0371c6859dad, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:58.086724 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbdfe7d-65ab-4b77-b9ba-72323dcf9178 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:58.089596 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d68d05-840c-40f5-9e92-c1b4e1c7488d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:58.095046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b94418-24a3-4241-b864-3496941d2a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:58.096102 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b94418-24a3-4241-b864-3496941d2a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:58.096393 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b94418-24a3-4241-b864-3496941d2a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:58.096894 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b94418-24a3-4241-b864-3496941d2a97 admin admin] PATH_INFO: `/v3/projects/816d89c58a304d478837b4e7278bc645` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:58.098036 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b94418-24a3-4241-b864-3496941d2a97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=816d89c58a304d478837b4e7278bc645)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:58.099829 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b94418-24a3-4241-b864-3496941d2a97 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:58.107357 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1286/2577] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:01:58 2022] PUT /identity/v3/projects/976fd696f7c845fa991ff985573c4b7c/users/1fa49db0691e4b81acda0371c6859dad/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 06:01:58.113978 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb659ed-efe4-4d0a-88b1-440d82e08fa4 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:58.114265 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb659ed-efe4-4d0a-88b1-440d82e08fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:58.114505 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb659ed-efe4-4d0a-88b1-440d82e08fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:58.141243 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-acb659ed-efe4-4d0a-88b1-440d82e08fa4 None None] MFA Rules not processed for user `1fa49db0691e4b81acda0371c6859dad`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:58.142553 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-acb659ed-efe4-4d0a-88b1-440d82e08fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:58.150722 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-22b94418-24a3-4241-b864-3496941d2a97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '816d89c58a304d478837b4e7278bc645', 'request_id': 'req-22b94418-24a3-4241-b864-3496941d2a97'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:58.157923 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-22b94418-24a3-4241-b864-3496941d2a97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '816d89c58a304d478837b4e7278bc645', 'request_id': 'req-22b94418-24a3-4241-b864-3496941d2a97'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:58.165900 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-22b94418-24a3-4241-b864-3496941d2a97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '816d89c58a304d478837b4e7278bc645', 'request_id': 'req-22b94418-24a3-4241-b864-3496941d2a97'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:58.176542 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-22b94418-24a3-4241-b864-3496941d2a97 admin admin] The token cache is being invalidate because project 816d89c58a304d478837b4e7278bc645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:01:58.176829 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-22b94418-24a3-4241-b864-3496941d2a97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:58.177475 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-22b94418-24a3-4241-b864-3496941d2a97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:58.179050 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1292/2578] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:01:58 2022] DELETE /identity/v3/projects/816d89c58a304d478837b4e7278bc645 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 06:01:58.182848 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b94418-24a3-4241-b864-3496941d2a97 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:58.184177 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-22b94418-24a3-4241-b864-3496941d2a97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:58.210683 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1287/2579] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:01:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:01:58.215624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb659ed-efe4-4d0a-88b1-440d82e08fa4 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:58.216987 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-acb659ed-efe4-4d0a-88b1-440d82e08fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:58.249994 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b94418-24a3-4241-b864-3496941d2a97 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:58.254656 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa98b7b-63a1-41c5-9e77-8fcdf43f8381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:58.255585 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa98b7b-63a1-41c5-9e77-8fcdf43f8381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:58.255863 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa98b7b-63a1-41c5-9e77-8fcdf43f8381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:58.256135 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa98b7b-63a1-41c5-9e77-8fcdf43f8381 admin admin] PATH_INFO: `/v3/users/3586fc1c276c4339b822ea9067fe7539` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:58.257307 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa98b7b-63a1-41c5-9e77-8fcdf43f8381 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3586fc1c276c4339b822ea9067fe7539)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:58.259267 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa98b7b-63a1-41c5-9e77-8fcdf43f8381 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:58.284582 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb659ed-efe4-4d0a-88b1-440d82e08fa4 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:58.289555 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71032a7-df68-4d38-8d3a-d4b62236828f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:58.290241 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71032a7-df68-4d38-8d3a-d4b62236828f admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:58.290521 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71032a7-df68-4d38-8d3a-d4b62236828f admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:58.290793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71032a7-df68-4d38-8d3a-d4b62236828f admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:58.291522 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71032a7-df68-4d38-8d3a-d4b62236828f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:58.293654 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71032a7-df68-4d38-8d3a-d4b62236828f admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:58.309382 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-daa98b7b-63a1-41c5-9e77-8fcdf43f8381 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3586fc1c276c4339b822ea9067fe7539'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:58.316603 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-daa98b7b-63a1-41c5-9e77-8fcdf43f8381 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3586fc1c276c4339b822ea9067fe7539'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:58.322752 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1288/2580] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:01:58 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:01:58.323922 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71032a7-df68-4d38-8d3a-d4b62236828f admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:58.324518 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-daa98b7b-63a1-41c5-9e77-8fcdf43f8381 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3586fc1c276c4339b822ea9067fe7539'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:58.325141 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-daa98b7b-63a1-41c5-9e77-8fcdf43f8381 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3586fc1c276c4339b822ea9067fe7539'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:58.337148 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-daa98b7b-63a1-41c5-9e77-8fcdf43f8381 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3586fc1c276c4339b822ea9067fe7539'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:58.339347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:58.344492 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1293/2581] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:01:58 2022] DELETE /identity/v3/users/3586fc1c276c4339b822ea9067fe7539 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:01:58.368667 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:58.392316 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71032a7-df68-4d38-8d3a-d4b62236828f admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:58.453644 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa397b73-70c8-4c72-9591-1884c80c362e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:58.454308 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa397b73-70c8-4c72-9591-1884c80c362e admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:58.454605 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa397b73-70c8-4c72-9591-1884c80c362e admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:58.454874 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa397b73-70c8-4c72-9591-1884c80c362e admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:58.455603 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa397b73-70c8-4c72-9591-1884c80c362e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:58.457599 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa397b73-70c8-4c72-9591-1884c80c362e admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:58.479305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1289/2582] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:01:58 2022] POST /identity/v3/users => generated 297 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 06:01:58.483404 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa98b7b-63a1-41c5-9e77-8fcdf43f8381 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:58.484847 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-daa98b7b-63a1-41c5-9e77-8fcdf43f8381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:58.498401 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa98b7b-63a1-41c5-9e77-8fcdf43f8381 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:58.503404 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a12ff8-b6e3-46c2-8237-24ec9cf7929d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:58.504100 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a12ff8-b6e3-46c2-8237-24ec9cf7929d admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:58.504385 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a12ff8-b6e3-46c2-8237-24ec9cf7929d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:58.504663 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a12ff8-b6e3-46c2-8237-24ec9cf7929d admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:58.505416 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a12ff8-b6e3-46c2-8237-24ec9cf7929d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:58.507140 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a12ff8-b6e3-46c2-8237-24ec9cf7929d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:58.519230 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1294/2583] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 06:01:58.522343 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa397b73-70c8-4c72-9591-1884c80c362e admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:58.533326 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa397b73-70c8-4c72-9591-1884c80c362e admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:58.538550 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd9ab1-457a-4200-bf63-c96d49a3c6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:58.539652 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd9ab1-457a-4200-bf63-c96d49a3c6aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:58.540103 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd9ab1-457a-4200-bf63-c96d49a3c6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:58.540215 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd9ab1-457a-4200-bf63-c96d49a3c6aa admin admin] PATH_INFO: `/v3/projects/b822bc4465f442eb8f960c2006855902/users/b93b537f68cc4fba995dd0e901d92f5e/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:58.556409 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd9ab1-457a-4200-bf63-c96d49a3c6aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b822bc4465f442eb8f960c2006855902, user_id=b93b537f68cc4fba995dd0e901d92f5e, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:58.559260 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd9ab1-457a-4200-bf63-c96d49a3c6aa admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:58.574175 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1290/2584] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:01:58 2022] PUT /identity/v3/projects/b822bc4465f442eb8f960c2006855902/users/b93b537f68cc4fba995dd0e901d92f5e/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 06:01:58.578073 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a12ff8-b6e3-46c2-8237-24ec9cf7929d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:58.588051 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a12ff8-b6e3-46c2-8237-24ec9cf7929d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:58.639723 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd9ab1-457a-4200-bf63-c96d49a3c6aa admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:58.641803 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-8cdd9ab1-457a-4200-bf63-c96d49a3c6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:58.665589 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf5531-698e-4aa4-95e3-10358d4ce8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:58.666382 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf5531-698e-4aa4-95e3-10358d4ce8ea admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:58.666795 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf5531-698e-4aa4-95e3-10358d4ce8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:58.667237 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf5531-698e-4aa4-95e3-10358d4ce8ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:58.668161 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf5531-698e-4aa4-95e3-10358d4ce8ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:58.670095 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf5531-698e-4aa4-95e3-10358d4ce8ea admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:58.681563 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1295/2585] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:01:58.685687 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf5531-698e-4aa4-95e3-10358d4ce8ea admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:58.695249 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf5531-698e-4aa4-95e3-10358d4ce8ea admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:58.699894 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97dc70-6e64-49f5-890d-02f602b4d7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:58.700769 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97dc70-6e64-49f5-890d-02f602b4d7df admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:58.701051 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97dc70-6e64-49f5-890d-02f602b4d7df admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:58.701327 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97dc70-6e64-49f5-890d-02f602b4d7df admin admin] PATH_INFO: `/v3/projects/b822bc4465f442eb8f960c2006855902/users/b93b537f68cc4fba995dd0e901d92f5e/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:58.703319 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97dc70-6e64-49f5-890d-02f602b4d7df admin admin] RBAC: Authorizing `identity:create_grant(project_id=b822bc4465f442eb8f960c2006855902, user_id=b93b537f68cc4fba995dd0e901d92f5e, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:58.705948 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97dc70-6e64-49f5-890d-02f602b4d7df admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:58.713929 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd9ab1-457a-4200-bf63-c96d49a3c6aa admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:58.716932 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1296/2586] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:01:58 2022] PUT /identity/v3/projects/b822bc4465f442eb8f960c2006855902/users/b93b537f68cc4fba995dd0e901d92f5e/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 06:01:58.727765 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a81730-8737-49e2-8ba0-40ede94eedb1 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:58.728051 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a81730-8737-49e2-8ba0-40ede94eedb1 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:58.728319 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a81730-8737-49e2-8ba0-40ede94eedb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:58.755875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-24a81730-8737-49e2-8ba0-40ede94eedb1 None None] MFA Rules not processed for user `b93b537f68cc4fba995dd0e901d92f5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:58.757092 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-24a81730-8737-49e2-8ba0-40ede94eedb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:58.772090 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd312298-ac60-46d2-a7a1-ebfbb8e3979d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:58.772967 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd312298-ac60-46d2-a7a1-ebfbb8e3979d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:58.773247 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd312298-ac60-46d2-a7a1-ebfbb8e3979d admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:58.773515 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd312298-ac60-46d2-a7a1-ebfbb8e3979d admin admin] PATH_INFO: `/v3/projects/3687c6c1a2d64911a682f1cd01a19306` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:58.774664 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd312298-ac60-46d2-a7a1-ebfbb8e3979d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3687c6c1a2d64911a682f1cd01a19306)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:58.776688 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd312298-ac60-46d2-a7a1-ebfbb8e3979d admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:58.778147 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:58.825497 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-bd312298-ac60-46d2-a7a1-ebfbb8e3979d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3687c6c1a2d64911a682f1cd01a19306', 'request_id': 'req-bd312298-ac60-46d2-a7a1-ebfbb8e3979d'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:58.828578 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1297/2587] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:01:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:01:58.834593 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-bd312298-ac60-46d2-a7a1-ebfbb8e3979d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3687c6c1a2d64911a682f1cd01a19306', 'request_id': 'req-bd312298-ac60-46d2-a7a1-ebfbb8e3979d'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:58.841129 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a81730-8737-49e2-8ba0-40ede94eedb1 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:58.841514 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-bd312298-ac60-46d2-a7a1-ebfbb8e3979d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3687c6c1a2d64911a682f1cd01a19306', 'request_id': 'req-bd312298-ac60-46d2-a7a1-ebfbb8e3979d'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:58.842766 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-24a81730-8737-49e2-8ba0-40ede94eedb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:58.852938 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-bd312298-ac60-46d2-a7a1-ebfbb8e3979d admin admin] The token cache is being invalidate because project 3687c6c1a2d64911a682f1cd01a19306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:01:58.853226 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-bd312298-ac60-46d2-a7a1-ebfbb8e3979d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:58.854419 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-bd312298-ac60-46d2-a7a1-ebfbb8e3979d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:01:58.856143 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1291/2588] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:01:58 2022] DELETE /identity/v3/projects/3687c6c1a2d64911a682f1cd01a19306 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 06:01:58.861082 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148a745-12e8-4d04-9973-58fed23639cf None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:58.861842 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148a745-12e8-4d04-9973-58fed23639cf None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:58.862130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148a745-12e8-4d04-9973-58fed23639cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:58.881054 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d148a745-12e8-4d04-9973-58fed23639cf None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:58.882325 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d148a745-12e8-4d04-9973-58fed23639cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:58.907893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a81730-8737-49e2-8ba0-40ede94eedb1 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:58.918240 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:58.949832 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1292/2589] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:01:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 06:01:58.957658 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b08f1b-bf75-4873-8957-0755e1c5afb7 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:58.957948 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b08f1b-bf75-4873-8957-0755e1c5afb7 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:58.958229 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b08f1b-bf75-4873-8957-0755e1c5afb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:58.958682 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74bcffb-d67c-4092-9c66-d3f2fb93c6f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:58.959414 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74bcffb-d67c-4092-9c66-d3f2fb93c6f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:58.959695 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74bcffb-d67c-4092-9c66-d3f2fb93c6f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:58.959969 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74bcffb-d67c-4092-9c66-d3f2fb93c6f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:58.961753 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a74bcffb-d67c-4092-9c66-d3f2fb93c6f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:58.976669 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-88b08f1b-bf75-4873-8957-0755e1c5afb7 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:58.977865 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-88b08f1b-bf75-4873-8957-0755e1c5afb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:58.987201 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1293/2590] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:01:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:01:58.991405 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b08f1b-bf75-4873-8957-0755e1c5afb7 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:59.000600 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b08f1b-bf75-4873-8957-0755e1c5afb7 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:59.005732 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5af91-671b-4960-9c86-432df4fcf593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:59.006495 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5af91-671b-4960-9c86-432df4fcf593 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:59.006772 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5af91-671b-4960-9c86-432df4fcf593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:59.007040 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5af91-671b-4960-9c86-432df4fcf593 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:59.007812 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5af91-671b-4960-9c86-432df4fcf593 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 06:01:59.008110 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5af91-671b-4960-9c86-432df4fcf593 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:59.009724 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5af91-671b-4960-9c86-432df4fcf593 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:59.021936 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1294/2591] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 06:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 06:01:59.026218 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5af91-671b-4960-9c86-432df4fcf593 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:59.027413 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74bcffb-d67c-4092-9c66-d3f2fb93c6f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:59.028905 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74bcffb-d67c-4092-9c66-d3f2fb93c6f9 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:59.036451 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5af91-671b-4960-9c86-432df4fcf593 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:59.038928 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1298/2592] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:01:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 06:01:59.042811 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3e0e5-8e2d-4fd9-8729-11ac689a896f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:59.043633 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3e0e5-8e2d-4fd9-8729-11ac689a896f admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:59.044019 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3e0e5-8e2d-4fd9-8729-11ac689a896f admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:59.044305 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3e0e5-8e2d-4fd9-8729-11ac689a896f admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:59.045065 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3e0e5-8e2d-4fd9-8729-11ac689a896f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:59.047600 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3e0e5-8e2d-4fd9-8729-11ac689a896f admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:59.077645 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1295/2593] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:01:59 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 06:01:59.079500 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74bcffb-d67c-4092-9c66-d3f2fb93c6f9 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:59.090326 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74bcffb-d67c-4092-9c66-d3f2fb93c6f9 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:59.112930 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3e0e5-8e2d-4fd9-8729-11ac689a896f admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:59.114680 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-adf3e0e5-8e2d-4fd9-8729-11ac689a896f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:59.149156 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081750a-7477-4b57-ae50-37f64b463171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:59.149829 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081750a-7477-4b57-ae50-37f64b463171 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:59.150103 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081750a-7477-4b57-ae50-37f64b463171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:59.150377 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081750a-7477-4b57-ae50-37f64b463171 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:59.151098 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081750a-7477-4b57-ae50-37f64b463171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:59.153065 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081750a-7477-4b57-ae50-37f64b463171 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:59.171820 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:59.174523 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1299/2594] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:01:59 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:01:59.175908 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3e0e5-8e2d-4fd9-8729-11ac689a896f admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:59.178587 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081750a-7477-4b57-ae50-37f64b463171 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:59.180580 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3316b7a-c2d0-4319-890e-59a0f356c4ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:59.181275 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3316b7a-c2d0-4319-890e-59a0f356c4ad service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:59.181769 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3316b7a-c2d0-4319-890e-59a0f356c4ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:59.182397 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3316b7a-c2d0-4319-890e-59a0f356c4ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:59.184883 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d3316b7a-c2d0-4319-890e-59a0f356c4ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:59.188567 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081750a-7477-4b57-ae50-37f64b463171 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:59.193258 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af5483-6e7c-40c0-8414-4d7f187666e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:59.193900 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af5483-6e7c-40c0-8414-4d7f187666e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:59.194182 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af5483-6e7c-40c0-8414-4d7f187666e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:59.194441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af5483-6e7c-40c0-8414-4d7f187666e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:59.195222 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af5483-6e7c-40c0-8414-4d7f187666e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:59.196839 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af5483-6e7c-40c0-8414-4d7f187666e6 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:59.206833 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1300/2595] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:01:59.210798 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af5483-6e7c-40c0-8414-4d7f187666e6 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:59.220428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af5483-6e7c-40c0-8414-4d7f187666e6 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:59.226603 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6caf6-7b7c-420e-bbd2-fe09c6a6b52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:59.227307 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6caf6-7b7c-420e-bbd2-fe09c6a6b52f admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:59.227595 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6caf6-7b7c-420e-bbd2-fe09c6a6b52f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:59.227899 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6caf6-7b7c-420e-bbd2-fe09c6a6b52f admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:59.229016 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6caf6-7b7c-420e-bbd2-fe09c6a6b52f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:59.230635 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6caf6-7b7c-420e-bbd2-fe09c6a6b52f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:59.241887 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1301/2596] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 06:01:59.245995 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6caf6-7b7c-420e-bbd2-fe09c6a6b52f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:59.249454 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3316b7a-c2d0-4319-890e-59a0f356c4ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:59.250913 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3316b7a-c2d0-4319-890e-59a0f356c4ad service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:59.255236 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6caf6-7b7c-420e-bbd2-fe09c6a6b52f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:59.259847 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb05062a-7c5a-409e-9bb5-9f20e8c7289d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:59.260023 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1296/2597] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:01:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 06:01:59.260698 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05062a-7c5a-409e-9bb5-9f20e8c7289d admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:59.260977 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05062a-7c5a-409e-9bb5-9f20e8c7289d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:59.261293 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05062a-7c5a-409e-9bb5-9f20e8c7289d admin admin] PATH_INFO: `/v3/projects/a808293d2787435787131a4d6d3f2c91/users/0438d9298b5d437db1aa91b137cf0a16/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:59.277301 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb05062a-7c5a-409e-9bb5-9f20e8c7289d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a808293d2787435787131a4d6d3f2c91, user_id=0438d9298b5d437db1aa91b137cf0a16, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:59.280033 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb05062a-7c5a-409e-9bb5-9f20e8c7289d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:59.294154 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1302/2598] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:01:59 2022] PUT /identity/v3/projects/a808293d2787435787131a4d6d3f2c91/users/0438d9298b5d437db1aa91b137cf0a16/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 06:01:59.365159 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40c48b-e09a-4528-8916-446a3392ec8a None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:59.365449 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40c48b-e09a-4528-8916-446a3392ec8a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:59.365752 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40c48b-e09a-4528-8916-446a3392ec8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:59.402993 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-9f40c48b-e09a-4528-8916-446a3392ec8a None None] MFA Rules not processed for user `0438d9298b5d437db1aa91b137cf0a16`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:01:59.404244 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-9f40c48b-e09a-4528-8916-446a3392ec8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:01:59.482751 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1297/2599] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:01:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 06:01:59.495026 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb05062a-7c5a-409e-9bb5-9f20e8c7289d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:01:59.505016 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:01:59.554783 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb05062a-7c5a-409e-9bb5-9f20e8c7289d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:01:59.558697 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d7310-34c5-4762-8bcc-529d4fbc946e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:01:59.559407 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d7310-34c5-4762-8bcc-529d4fbc946e service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:01:59.559689 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d7310-34c5-4762-8bcc-529d4fbc946e service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:01:59.559956 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d7310-34c5-4762-8bcc-529d4fbc946e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:01:59.568305 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d7310-34c5-4762-8bcc-529d4fbc946e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:01:59.569773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d7310-34c5-4762-8bcc-529d4fbc946e service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:01:59.578737 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1303/2600] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:01:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:02:02.152264 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40c48b-e09a-4528-8916-446a3392ec8a None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:02.218890 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40c48b-e09a-4528-8916-446a3392ec8a None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:02.223828 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5730a-2fc6-490b-8456-74ad938b7a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:02.224751 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5730a-2fc6-490b-8456-74ad938b7a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:02.225030 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5730a-2fc6-490b-8456-74ad938b7a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:02.225332 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5730a-2fc6-490b-8456-74ad938b7a7b admin admin] PATH_INFO: `/v3/users/0438d9298b5d437db1aa91b137cf0a16` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:02.226616 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5730a-2fc6-490b-8456-74ad938b7a7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0438d9298b5d437db1aa91b137cf0a16)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:02.229138 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5730a-2fc6-490b-8456-74ad938b7a7b admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:02.275349 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:02.288080 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-b5f5730a-2fc6-490b-8456-74ad938b7a7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0438d9298b5d437db1aa91b137cf0a16'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:02.288899 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-b5f5730a-2fc6-490b-8456-74ad938b7a7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0438d9298b5d437db1aa91b137cf0a16'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:02.297083 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-b5f5730a-2fc6-490b-8456-74ad938b7a7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0438d9298b5d437db1aa91b137cf0a16'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:02.297804 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-b5f5730a-2fc6-490b-8456-74ad938b7a7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0438d9298b5d437db1aa91b137cf0a16'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:02.310780 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-b5f5730a-2fc6-490b-8456-74ad938b7a7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0438d9298b5d437db1aa91b137cf0a16'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:02.323497 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1298/2601] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:02:02 2022] DELETE /identity/v3/users/0438d9298b5d437db1aa91b137cf0a16 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:02:02.328635 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698d94c-b85c-4d4c-87b2-637ffc768df5 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:02.329100 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698d94c-b85c-4d4c-87b2-637ffc768df5 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:02.329100 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698d94c-b85c-4d4c-87b2-637ffc768df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:02.347039 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-2698d94c-b85c-4d4c-87b2-637ffc768df5 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:02:02.348269 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2698d94c-b85c-4d4c-87b2-637ffc768df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:02.412102 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1304/2602] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:02:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:02:02.421798 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5730a-2fc6-490b-8456-74ad938b7a7b admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:02.423321 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b5f5730a-2fc6-490b-8456-74ad938b7a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:02.503822 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5730a-2fc6-490b-8456-74ad938b7a7b admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:02.510880 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc301d-9793-4e11-a370-48da5e414d35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:02.511883 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc301d-9793-4e11-a370-48da5e414d35 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:02.512274 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc301d-9793-4e11-a370-48da5e414d35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:02.512649 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc301d-9793-4e11-a370-48da5e414d35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:02.522822 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc301d-9793-4e11-a370-48da5e414d35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:02.524308 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc301d-9793-4e11-a370-48da5e414d35 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:02.534242 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1299/2603] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:02:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:02:02.809691 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698d94c-b85c-4d4c-87b2-637ffc768df5 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:02.811347 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2698d94c-b85c-4d4c-87b2-637ffc768df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:02.826156 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698d94c-b85c-4d4c-87b2-637ffc768df5 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:02.832231 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3479e6c7-eba0-4240-98f2-e2db5906a43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:02.833240 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479e6c7-eba0-4240-98f2-e2db5906a43e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:02.833633 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479e6c7-eba0-4240-98f2-e2db5906a43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:02.834046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479e6c7-eba0-4240-98f2-e2db5906a43e admin admin] PATH_INFO: `/v3/projects/a808293d2787435787131a4d6d3f2c91` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:02.835391 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3479e6c7-eba0-4240-98f2-e2db5906a43e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a808293d2787435787131a4d6d3f2c91)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:02.837319 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3479e6c7-eba0-4240-98f2-e2db5906a43e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:02.887941 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3479e6c7-eba0-4240-98f2-e2db5906a43e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a808293d2787435787131a4d6d3f2c91', 'request_id': 'req-3479e6c7-eba0-4240-98f2-e2db5906a43e'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:02.894315 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3479e6c7-eba0-4240-98f2-e2db5906a43e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a808293d2787435787131a4d6d3f2c91', 'request_id': 'req-3479e6c7-eba0-4240-98f2-e2db5906a43e'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:02.904105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3479e6c7-eba0-4240-98f2-e2db5906a43e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a808293d2787435787131a4d6d3f2c91', 'request_id': 'req-3479e6c7-eba0-4240-98f2-e2db5906a43e'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:02.914819 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3479e6c7-eba0-4240-98f2-e2db5906a43e admin admin] The token cache is being invalidate because project a808293d2787435787131a4d6d3f2c91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:02:02.915098 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3479e6c7-eba0-4240-98f2-e2db5906a43e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:02.915753 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3479e6c7-eba0-4240-98f2-e2db5906a43e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:02.917344 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1305/2604] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:02:02 2022] DELETE /identity/v3/projects/a808293d2787435787131a4d6d3f2c91 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:02:06.125453 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc301d-9793-4e11-a370-48da5e414d35 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:06.126880 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-10dc301d-9793-4e11-a370-48da5e414d35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:06.140124 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc301d-9793-4e11-a370-48da5e414d35 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:06.198775 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e54162-dbbb-4daa-b79b-bee6fb1cd864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:06.199624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e54162-dbbb-4daa-b79b-bee6fb1cd864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:06.199903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e54162-dbbb-4daa-b79b-bee6fb1cd864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:06.200174 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e54162-dbbb-4daa-b79b-bee6fb1cd864 admin admin] PATH_INFO: `/v3/users/1fa49db0691e4b81acda0371c6859dad` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:06.201401 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e54162-dbbb-4daa-b79b-bee6fb1cd864 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fa49db0691e4b81acda0371c6859dad)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:06.203508 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e54162-dbbb-4daa-b79b-bee6fb1cd864 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:06.256395 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-80e54162-dbbb-4daa-b79b-bee6fb1cd864 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fa49db0691e4b81acda0371c6859dad'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:06.257058 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-80e54162-dbbb-4daa-b79b-bee6fb1cd864 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fa49db0691e4b81acda0371c6859dad'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:06.265270 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-80e54162-dbbb-4daa-b79b-bee6fb1cd864 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fa49db0691e4b81acda0371c6859dad'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:06.265880 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-80e54162-dbbb-4daa-b79b-bee6fb1cd864 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fa49db0691e4b81acda0371c6859dad'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:06.267826 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:06.280004 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-80e54162-dbbb-4daa-b79b-bee6fb1cd864 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fa49db0691e4b81acda0371c6859dad'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:06.291927 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1300/2605] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:02:06 2022] DELETE /identity/v3/users/1fa49db0691e4b81acda0371c6859dad => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:02:06.296629 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a253cec-ca5f-49af-b8cf-ddbcd1ef9870 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:06.297145 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a253cec-ca5f-49af-b8cf-ddbcd1ef9870 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:06.297145 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a253cec-ca5f-49af-b8cf-ddbcd1ef9870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:06.314999 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-1a253cec-ca5f-49af-b8cf-ddbcd1ef9870 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:02:06.316230 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1a253cec-ca5f-49af-b8cf-ddbcd1ef9870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:06.345767 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:06.378852 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1306/2606] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:02:06.389791 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e54162-dbbb-4daa-b79b-bee6fb1cd864 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:06.391363 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-80e54162-dbbb-4daa-b79b-bee6fb1cd864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:06.449555 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e54162-dbbb-4daa-b79b-bee6fb1cd864 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:06.453662 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46af6a-b9b8-4bf3-a447-fdb892d5fef9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:06.454342 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46af6a-b9b8-4bf3-a447-fdb892d5fef9 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:06.454620 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46af6a-b9b8-4bf3-a447-fdb892d5fef9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:06.454893 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46af6a-b9b8-4bf3-a447-fdb892d5fef9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:06.464258 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46af6a-b9b8-4bf3-a447-fdb892d5fef9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:06.465746 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46af6a-b9b8-4bf3-a447-fdb892d5fef9 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:06.476487 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1301/2607] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:02:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:02:06.774830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a253cec-ca5f-49af-b8cf-ddbcd1ef9870 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:06.776272 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1a253cec-ca5f-49af-b8cf-ddbcd1ef9870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:06.790506 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a253cec-ca5f-49af-b8cf-ddbcd1ef9870 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:06.795424 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307a8c0-e88a-4900-80fb-c5c624689a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:06.796986 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307a8c0-e88a-4900-80fb-c5c624689a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:06.797269 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307a8c0-e88a-4900-80fb-c5c624689a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:06.797547 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307a8c0-e88a-4900-80fb-c5c624689a82 admin admin] PATH_INFO: `/v3/projects/976fd696f7c845fa991ff985573c4b7c` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:06.798726 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307a8c0-e88a-4900-80fb-c5c624689a82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=976fd696f7c845fa991ff985573c4b7c)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:06.800688 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307a8c0-e88a-4900-80fb-c5c624689a82 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:06.849052 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e307a8c0-e88a-4900-80fb-c5c624689a82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '976fd696f7c845fa991ff985573c4b7c', 'request_id': 'req-e307a8c0-e88a-4900-80fb-c5c624689a82'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:06.855782 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e307a8c0-e88a-4900-80fb-c5c624689a82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '976fd696f7c845fa991ff985573c4b7c', 'request_id': 'req-e307a8c0-e88a-4900-80fb-c5c624689a82'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:06.864844 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e307a8c0-e88a-4900-80fb-c5c624689a82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '976fd696f7c845fa991ff985573c4b7c', 'request_id': 'req-e307a8c0-e88a-4900-80fb-c5c624689a82'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:06.875680 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e307a8c0-e88a-4900-80fb-c5c624689a82 admin admin] The token cache is being invalidate because project 976fd696f7c845fa991ff985573c4b7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:02:06.875962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e307a8c0-e88a-4900-80fb-c5c624689a82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:06.876607 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-e307a8c0-e88a-4900-80fb-c5c624689a82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:06.878210 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1307/2608] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:02:06 2022] DELETE /identity/v3/projects/976fd696f7c845fa991ff985573c4b7c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:02:06.882337 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46af6a-b9b8-4bf3-a447-fdb892d5fef9 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:06.892114 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46af6a-b9b8-4bf3-a447-fdb892d5fef9 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:06.950879 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1129836-4f02-4849-8dd8-f885a05e20dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:06.951882 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1129836-4f02-4849-8dd8-f885a05e20dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:06.952164 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1129836-4f02-4849-8dd8-f885a05e20dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:06.952436 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1129836-4f02-4849-8dd8-f885a05e20dc admin admin] PATH_INFO: `/v3/users/b93b537f68cc4fba995dd0e901d92f5e` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:06.953677 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1129836-4f02-4849-8dd8-f885a05e20dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b93b537f68cc4fba995dd0e901d92f5e)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:06.955643 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1129836-4f02-4849-8dd8-f885a05e20dc admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:07.004049 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e1129836-4f02-4849-8dd8-f885a05e20dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b93b537f68cc4fba995dd0e901d92f5e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:07.004678 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e1129836-4f02-4849-8dd8-f885a05e20dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b93b537f68cc4fba995dd0e901d92f5e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:07.013363 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e1129836-4f02-4849-8dd8-f885a05e20dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b93b537f68cc4fba995dd0e901d92f5e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:07.013983 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e1129836-4f02-4849-8dd8-f885a05e20dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b93b537f68cc4fba995dd0e901d92f5e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:07.026363 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e1129836-4f02-4849-8dd8-f885a05e20dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b93b537f68cc4fba995dd0e901d92f5e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:07.031688 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:07.039876 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1302/2609] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:02:06 2022] DELETE /identity/v3/users/b93b537f68cc4fba995dd0e901d92f5e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:02:07.312084 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307a8c0-e88a-4900-80fb-c5c624689a82 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:07.313662 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e307a8c0-e88a-4900-80fb-c5c624689a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:07.330809 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307a8c0-e88a-4900-80fb-c5c624689a82 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:07.389875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc2110-7dff-41bf-9f92-1861548e9ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:07.390758 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc2110-7dff-41bf-9f92-1861548e9ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:07.391041 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc2110-7dff-41bf-9f92-1861548e9ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:07.391369 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc2110-7dff-41bf-9f92-1861548e9ea4 admin admin] PATH_INFO: `/v3/projects/b822bc4465f442eb8f960c2006855902` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:07.392549 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc2110-7dff-41bf-9f92-1861548e9ea4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b822bc4465f442eb8f960c2006855902)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:07.394472 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc2110-7dff-41bf-9f92-1861548e9ea4 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:07.443362 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-44cc2110-7dff-41bf-9f92-1861548e9ea4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b822bc4465f442eb8f960c2006855902', 'request_id': 'req-44cc2110-7dff-41bf-9f92-1861548e9ea4'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:07.449346 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-44cc2110-7dff-41bf-9f92-1861548e9ea4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b822bc4465f442eb8f960c2006855902', 'request_id': 'req-44cc2110-7dff-41bf-9f92-1861548e9ea4'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:07.452871 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:07.458517 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-44cc2110-7dff-41bf-9f92-1861548e9ea4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b822bc4465f442eb8f960c2006855902', 'request_id': 'req-44cc2110-7dff-41bf-9f92-1861548e9ea4'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:07.470754 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-44cc2110-7dff-41bf-9f92-1861548e9ea4 admin admin] The token cache is being invalidate because project b822bc4465f442eb8f960c2006855902 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:02:07.471040 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-44cc2110-7dff-41bf-9f92-1861548e9ea4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:07.471696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-44cc2110-7dff-41bf-9f92-1861548e9ea4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:07.473253 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1308/2610] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:02:07 2022] DELETE /identity/v3/projects/b822bc4465f442eb8f960c2006855902 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:02:07.478129 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9aeb8-a9a7-46bc-bff7-ae6f0b244723 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:07.478933 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9aeb8-a9a7-46bc-bff7-ae6f0b244723 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:07.479030 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9aeb8-a9a7-46bc-bff7-ae6f0b244723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:07.497671 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-f4a9aeb8-a9a7-46bc-bff7-ae6f0b244723 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:02:07.498982 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f4a9aeb8-a9a7-46bc-bff7-ae6f0b244723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:07.563669 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1303/2611] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:02:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:02:07.571689 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08095b75-f2e1-4a6a-8d1a-b22bbdc55943 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:07.571977 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08095b75-f2e1-4a6a-8d1a-b22bbdc55943 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:07.572255 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08095b75-f2e1-4a6a-8d1a-b22bbdc55943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:07.590910 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-08095b75-f2e1-4a6a-8d1a-b22bbdc55943 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:02:07.592163 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-08095b75-f2e1-4a6a-8d1a-b22bbdc55943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:07.600287 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1309/2612] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:02:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:02:07.604890 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9aeb8-a9a7-46bc-bff7-ae6f0b244723 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:07.614565 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9aeb8-a9a7-46bc-bff7-ae6f0b244723 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:07.619269 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31f0a9-f114-4895-a2a6-34089eaa18bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:07.619936 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31f0a9-f114-4895-a2a6-34089eaa18bd admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:07.620221 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31f0a9-f114-4895-a2a6-34089eaa18bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:07.620500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31f0a9-f114-4895-a2a6-34089eaa18bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:07.621266 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31f0a9-f114-4895-a2a6-34089eaa18bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 06:02:07.621576 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31f0a9-f114-4895-a2a6-34089eaa18bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:07.623244 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31f0a9-f114-4895-a2a6-34089eaa18bd admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:07.634725 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1304/2613] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 06:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 06:02:07.639150 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08095b75-f2e1-4a6a-8d1a-b22bbdc55943 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:07.648584 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08095b75-f2e1-4a6a-8d1a-b22bbdc55943 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:07.653681 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443403c-ac90-480d-86a0-2c154b130a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:07.654364 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443403c-ac90-480d-86a0-2c154b130a0c admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:07.654644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443403c-ac90-480d-86a0-2c154b130a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:07.654964 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443403c-ac90-480d-86a0-2c154b130a0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:07.655683 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443403c-ac90-480d-86a0-2c154b130a0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:07.657591 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443403c-ac90-480d-86a0-2c154b130a0c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:07.687568 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1310/2614] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:02:07 2022] POST /identity/v3/projects => generated 355 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:02:07.691799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31f0a9-f114-4895-a2a6-34089eaa18bd admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:07.701975 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31f0a9-f114-4895-a2a6-34089eaa18bd admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:07.772653 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725defe-9a17-440f-8e0e-585c58df19b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:07.774797 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725defe-9a17-440f-8e0e-585c58df19b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:07.774797 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725defe-9a17-440f-8e0e-585c58df19b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:07.774797 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725defe-9a17-440f-8e0e-585c58df19b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:07.776553 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725defe-9a17-440f-8e0e-585c58df19b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:07.780003 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725defe-9a17-440f-8e0e-585c58df19b6 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:07.809447 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1305/2615] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:02:07 2022] POST /identity/v3/users => generated 278 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:02:07.813609 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443403c-ac90-480d-86a0-2c154b130a0c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:07.824010 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443403c-ac90-480d-86a0-2c154b130a0c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:07.828911 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c6ba2-b7d2-4812-9d0e-9a28fe148a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:07.829568 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c6ba2-b7d2-4812-9d0e-9a28fe148a2f admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:07.829867 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c6ba2-b7d2-4812-9d0e-9a28fe148a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:07.830175 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c6ba2-b7d2-4812-9d0e-9a28fe148a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:07.830853 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c6ba2-b7d2-4812-9d0e-9a28fe148a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:07.832501 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c6ba2-b7d2-4812-9d0e-9a28fe148a2f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:07.842781 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1311/2616] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:02:07.846766 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725defe-9a17-440f-8e0e-585c58df19b6 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:07.857213 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725defe-9a17-440f-8e0e-585c58df19b6 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:07.862319 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4380704-c410-410c-afa3-5b4b175741ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:07.862977 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4380704-c410-410c-afa3-5b4b175741ca admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:07.863294 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4380704-c410-410c-afa3-5b4b175741ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:07.863568 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4380704-c410-410c-afa3-5b4b175741ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:07.864286 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4380704-c410-410c-afa3-5b4b175741ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:07.865889 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4380704-c410-410c-afa3-5b4b175741ca admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:07.876284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1306/2617] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:02:07.880124 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c6ba2-b7d2-4812-9d0e-9a28fe148a2f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:07.890141 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c6ba2-b7d2-4812-9d0e-9a28fe148a2f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:07.895023 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a76bf3-2f40-4a6b-b3c1-e85ba7d4daec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:07.895932 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a76bf3-2f40-4a6b-b3c1-e85ba7d4daec admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:07.896210 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a76bf3-2f40-4a6b-b3c1-e85ba7d4daec admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:07.896478 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a76bf3-2f40-4a6b-b3c1-e85ba7d4daec admin admin] PATH_INFO: `/v3/projects/fe84b78a7f324f44847c1d3ac758115a/users/438fe94620e14a0c829a8e5d6dbd924f/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:07.911262 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a76bf3-2f40-4a6b-b3c1-e85ba7d4daec admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe84b78a7f324f44847c1d3ac758115a, user_id=438fe94620e14a0c829a8e5d6dbd924f, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:07.913898 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a76bf3-2f40-4a6b-b3c1-e85ba7d4daec admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:07.928082 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1312/2618] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:02:07 2022] PUT /identity/v3/projects/fe84b78a7f324f44847c1d3ac758115a/users/438fe94620e14a0c829a8e5d6dbd924f/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:02:07.938482 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437bf143-b8e5-4b69-aecb-7a59dbb4fe26 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:07.938766 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437bf143-b8e5-4b69-aecb-7a59dbb4fe26 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:07.939039 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437bf143-b8e5-4b69-aecb-7a59dbb4fe26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:07.965577 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-437bf143-b8e5-4b69-aecb-7a59dbb4fe26 None None] MFA Rules not processed for user `438fe94620e14a0c829a8e5d6dbd924f`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:02:07.966774 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-437bf143-b8e5-4b69-aecb-7a59dbb4fe26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:08.025515 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:08.042797 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1307/2619] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:02:07 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 06:02:08.047682 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a76bf3-2f40-4a6b-b3c1-e85ba7d4daec admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:08.109524 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a76bf3-2f40-4a6b-b3c1-e85ba7d4daec admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:08.114344 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8aae57-0841-4a0f-a7f1-d5892f6d4a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:08.114997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8aae57-0841-4a0f-a7f1-d5892f6d4a7d admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:08.115312 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8aae57-0841-4a0f-a7f1-d5892f6d4a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:08.115566 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8aae57-0841-4a0f-a7f1-d5892f6d4a7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:08.116246 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8aae57-0841-4a0f-a7f1-d5892f6d4a7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:08.118135 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8aae57-0841-4a0f-a7f1-d5892f6d4a7d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:08.144225 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1313/2620] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:02:08 2022] POST /identity/v3/projects => generated 357 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:02:08.149961 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437bf143-b8e5-4b69-aecb-7a59dbb4fe26 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:08.163426 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437bf143-b8e5-4b69-aecb-7a59dbb4fe26 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:08.221594 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2eec89-4dd7-4593-be68-66c5a3013291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:08.222262 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2eec89-4dd7-4593-be68-66c5a3013291 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:08.222542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2eec89-4dd7-4593-be68-66c5a3013291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:08.222819 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2eec89-4dd7-4593-be68-66c5a3013291 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:08.223540 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2eec89-4dd7-4593-be68-66c5a3013291 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:08.225530 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2eec89-4dd7-4593-be68-66c5a3013291 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:08.247087 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1308/2621] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:02:08 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:02:08.251346 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8aae57-0841-4a0f-a7f1-d5892f6d4a7d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:08.261920 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8aae57-0841-4a0f-a7f1-d5892f6d4a7d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:08.267053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a998be6-17cd-4acf-b464-07a2f1d377ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:08.267744 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a998be6-17cd-4acf-b464-07a2f1d377ce admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:08.268025 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a998be6-17cd-4acf-b464-07a2f1d377ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:08.268302 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a998be6-17cd-4acf-b464-07a2f1d377ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:08.269013 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a998be6-17cd-4acf-b464-07a2f1d377ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:08.270621 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a998be6-17cd-4acf-b464-07a2f1d377ce admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:08.281418 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1314/2622] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:02:08.285703 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2eec89-4dd7-4593-be68-66c5a3013291 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:08.296224 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2eec89-4dd7-4593-be68-66c5a3013291 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:08.301939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cf8e7-b894-42c7-b062-3d3f40e6220a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:08.302799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cf8e7-b894-42c7-b062-3d3f40e6220a admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:08.303082 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cf8e7-b894-42c7-b062-3d3f40e6220a admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:08.303389 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cf8e7-b894-42c7-b062-3d3f40e6220a admin admin] PATH_INFO: `/v3/projects/dc8471edecdd480389a430437ac89338/users/0ab59efcdcc442108ed6361f7b06dca0/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:08.319849 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7cf8e7-b894-42c7-b062-3d3f40e6220a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc8471edecdd480389a430437ac89338, user_id=0ab59efcdcc442108ed6361f7b06dca0, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:08.322507 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7cf8e7-b894-42c7-b062-3d3f40e6220a admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:08.337745 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1309/2623] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:02:08 2022] PUT /identity/v3/projects/dc8471edecdd480389a430437ac89338/users/0ab59efcdcc442108ed6361f7b06dca0/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:02:08.341869 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a998be6-17cd-4acf-b464-07a2f1d377ce admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:08.353771 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a998be6-17cd-4acf-b464-07a2f1d377ce admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:08.406621 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:08.414486 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5793a50-04d6-4870-96f2-e60c3e5a5990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:08.415171 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5793a50-04d6-4870-96f2-e60c3e5a5990 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:08.415488 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5793a50-04d6-4870-96f2-e60c3e5a5990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:08.415761 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5793a50-04d6-4870-96f2-e60c3e5a5990 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:08.416809 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5793a50-04d6-4870-96f2-e60c3e5a5990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:08.419158 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5793a50-04d6-4870-96f2-e60c3e5a5990 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:08.429933 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1315/2624] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:02:08.434446 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cf8e7-b894-42c7-b062-3d3f40e6220a admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:08.445732 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cf8e7-b894-42c7-b062-3d3f40e6220a admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:08.450485 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad52841-96cc-4a51-b425-de3c43d15f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:08.451411 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad52841-96cc-4a51-b425-de3c43d15f5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:08.451762 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad52841-96cc-4a51-b425-de3c43d15f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:08.452039 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad52841-96cc-4a51-b425-de3c43d15f5a admin admin] PATH_INFO: `/v3/projects/dc8471edecdd480389a430437ac89338/users/0ab59efcdcc442108ed6361f7b06dca0/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:08.454081 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad52841-96cc-4a51-b425-de3c43d15f5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc8471edecdd480389a430437ac89338, user_id=0ab59efcdcc442108ed6361f7b06dca0, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:08.456775 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad52841-96cc-4a51-b425-de3c43d15f5a admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:08.467160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1310/2625] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:02:08 2022] PUT /identity/v3/projects/dc8471edecdd480389a430437ac89338/users/0ab59efcdcc442108ed6361f7b06dca0/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:02:08.478423 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51673b-e460-4413-aaaf-7d386e924665 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:08.479023 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51673b-e460-4413-aaaf-7d386e924665 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:08.479341 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51673b-e460-4413-aaaf-7d386e924665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:08.511618 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-1d51673b-e460-4413-aaaf-7d386e924665 None None] MFA Rules not processed for user `0ab59efcdcc442108ed6361f7b06dca0`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:02:08.513477 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1d51673b-e460-4413-aaaf-7d386e924665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:08.584090 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1316/2626] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:02:08 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:02:08.596528 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad52841-96cc-4a51-b425-de3c43d15f5a admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:08.598445 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-2ad52841-96cc-4a51-b425-de3c43d15f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:08.660971 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad52841-96cc-4a51-b425-de3c43d15f5a admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:08.664761 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9e2e6-0704-4e73-a733-b96c85b20951 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:08.665411 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9e2e6-0704-4e73-a733-b96c85b20951 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:08.665695 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9e2e6-0704-4e73-a733-b96c85b20951 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:08.665946 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9e2e6-0704-4e73-a733-b96c85b20951 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:08.675505 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9e2e6-0704-4e73-a733-b96c85b20951 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:08.676946 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9e2e6-0704-4e73-a733-b96c85b20951 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:08.686426 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1311/2627] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:02:08 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 06:02:08.763441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51673b-e460-4413-aaaf-7d386e924665 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:08.773714 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51673b-e460-4413-aaaf-7d386e924665 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:08.777745 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6bf10-d9db-410c-b1a4-31697eb2f1aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:08.778419 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6bf10-d9db-410c-b1a4-31697eb2f1aa service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:08.778656 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6bf10-d9db-410c-b1a4-31697eb2f1aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:08.778927 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6bf10-d9db-410c-b1a4-31697eb2f1aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:08.841425 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac6bf10-d9db-410c-b1a4-31697eb2f1aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:08.842997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac6bf10-d9db-410c-b1a4-31697eb2f1aa service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:08.852190 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1317/2628] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:02:08 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:02:18.682108 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=74,keystone:INSERT=5 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:18.848021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=65 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:24.106682 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9e2e6-0704-4e73-a733-b96c85b20951 service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:24.174866 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9e2e6-0704-4e73-a733-b96c85b20951 service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:24.179531 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de824dd5-d9ab-46b9-b46b-7a1410418a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:24.180474 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de824dd5-d9ab-46b9-b46b-7a1410418a1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:24.180771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de824dd5-d9ab-46b9-b46b-7a1410418a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:24.181040 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de824dd5-d9ab-46b9-b46b-7a1410418a1c admin admin] PATH_INFO: `/v3/users/438fe94620e14a0c829a8e5d6dbd924f` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:24.182317 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de824dd5-d9ab-46b9-b46b-7a1410418a1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=438fe94620e14a0c829a8e5d6dbd924f)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:24.184322 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de824dd5-d9ab-46b9-b46b-7a1410418a1c admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:24.240650 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-de824dd5-d9ab-46b9-b46b-7a1410418a1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '438fe94620e14a0c829a8e5d6dbd924f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:24.241553 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-de824dd5-d9ab-46b9-b46b-7a1410418a1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '438fe94620e14a0c829a8e5d6dbd924f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:24.251316 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-de824dd5-d9ab-46b9-b46b-7a1410418a1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '438fe94620e14a0c829a8e5d6dbd924f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:24.252093 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-de824dd5-d9ab-46b9-b46b-7a1410418a1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '438fe94620e14a0c829a8e5d6dbd924f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:24.265975 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-de824dd5-d9ab-46b9-b46b-7a1410418a1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '438fe94620e14a0c829a8e5d6dbd924f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:24.280278 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1312/2629] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:02:24 2022] DELETE /identity/v3/users/438fe94620e14a0c829a8e5d6dbd924f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:02:24.285276 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6066f-87d1-40a2-8a6e-732764685b8f None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:24.285886 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6066f-87d1-40a2-8a6e-732764685b8f None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:24.285886 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6066f-87d1-40a2-8a6e-732764685b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:24.305158 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-2ae6066f-87d1-40a2-8a6e-732764685b8f None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:02:24.306428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2ae6066f-87d1-40a2-8a6e-732764685b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:24.351005 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de824dd5-d9ab-46b9-b46b-7a1410418a1c admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:24.352552 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-de824dd5-d9ab-46b9-b46b-7a1410418a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:24.383806 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1318/2630] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:02:24.393970 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6066f-87d1-40a2-8a6e-732764685b8f None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:24.395462 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2ae6066f-87d1-40a2-8a6e-732764685b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:24.415966 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de824dd5-d9ab-46b9-b46b-7a1410418a1c admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:24.420965 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb24c1-f3f5-4a5e-9108-4399aebcf938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:24.421638 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb24c1-f3f5-4a5e-9108-4399aebcf938 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:24.421919 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb24c1-f3f5-4a5e-9108-4399aebcf938 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:24.422193 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb24c1-f3f5-4a5e-9108-4399aebcf938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:24.424201 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-a6eb24c1-f3f5-4a5e-9108-4399aebcf938 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:24.437593 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb24c1-f3f5-4a5e-9108-4399aebcf938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:24.439083 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb24c1-f3f5-4a5e-9108-4399aebcf938 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:24.449237 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1313/2631] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:02:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 06:02:24.452248 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6066f-87d1-40a2-8a6e-732764685b8f None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:24.455926 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072b783-3244-4d7d-94f0-8243a47dbdf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:24.456588 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072b783-3244-4d7d-94f0-8243a47dbdf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:24.456870 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072b783-3244-4d7d-94f0-8243a47dbdf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:24.457144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072b783-3244-4d7d-94f0-8243a47dbdf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:24.466462 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072b783-3244-4d7d-94f0-8243a47dbdf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:24.468036 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072b783-3244-4d7d-94f0-8243a47dbdf0 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:24.478561 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1319/2632] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:02:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 06:02:25.145402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb24c1-f3f5-4a5e-9108-4399aebcf938 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:25.147717 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-a6eb24c1-f3f5-4a5e-9108-4399aebcf938 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:25.164161 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb24c1-f3f5-4a5e-9108-4399aebcf938 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:25.171476 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240a5df-304f-4fab-8ded-73eb247d3ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:25.172360 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240a5df-304f-4fab-8ded-73eb247d3ee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:25.172634 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240a5df-304f-4fab-8ded-73eb247d3ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:25.172909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240a5df-304f-4fab-8ded-73eb247d3ee4 admin admin] PATH_INFO: `/v3/projects/fe84b78a7f324f44847c1d3ac758115a` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:25.174233 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240a5df-304f-4fab-8ded-73eb247d3ee4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe84b78a7f324f44847c1d3ac758115a)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:25.176221 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240a5df-304f-4fab-8ded-73eb247d3ee4 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:25.202838 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:25.237099 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e240a5df-304f-4fab-8ded-73eb247d3ee4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe84b78a7f324f44847c1d3ac758115a', 'request_id': 'req-e240a5df-304f-4fab-8ded-73eb247d3ee4'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:25.245721 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e240a5df-304f-4fab-8ded-73eb247d3ee4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe84b78a7f324f44847c1d3ac758115a', 'request_id': 'req-e240a5df-304f-4fab-8ded-73eb247d3ee4'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:25.252952 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e240a5df-304f-4fab-8ded-73eb247d3ee4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe84b78a7f324f44847c1d3ac758115a', 'request_id': 'req-e240a5df-304f-4fab-8ded-73eb247d3ee4'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:25.264789 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e240a5df-304f-4fab-8ded-73eb247d3ee4 admin admin] The token cache is being invalidate because project fe84b78a7f324f44847c1d3ac758115a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:02:25.265110 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e240a5df-304f-4fab-8ded-73eb247d3ee4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:25.265736 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e240a5df-304f-4fab-8ded-73eb247d3ee4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:25.268481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1314/2633] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:02:25 2022] DELETE /identity/v3/projects/fe84b78a7f324f44847c1d3ac758115a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 06:02:25.272607 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072b783-3244-4d7d-94f0-8243a47dbdf0 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:25.282461 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072b783-3244-4d7d-94f0-8243a47dbdf0 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:25.342228 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4734ceb-3b29-4349-b831-ccf350b97425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:25.343309 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4734ceb-3b29-4349-b831-ccf350b97425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:25.343661 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4734ceb-3b29-4349-b831-ccf350b97425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:25.344032 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4734ceb-3b29-4349-b831-ccf350b97425 admin admin] PATH_INFO: `/v3/users/0ab59efcdcc442108ed6361f7b06dca0` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:25.345330 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4734ceb-3b29-4349-b831-ccf350b97425 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ab59efcdcc442108ed6361f7b06dca0)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:25.347372 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4734ceb-3b29-4349-b831-ccf350b97425 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:25.398767 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:25.400539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c4734ceb-3b29-4349-b831-ccf350b97425 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ab59efcdcc442108ed6361f7b06dca0'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:25.409171 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c4734ceb-3b29-4349-b831-ccf350b97425 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ab59efcdcc442108ed6361f7b06dca0'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:25.416954 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c4734ceb-3b29-4349-b831-ccf350b97425 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ab59efcdcc442108ed6361f7b06dca0'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:25.417620 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c4734ceb-3b29-4349-b831-ccf350b97425 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ab59efcdcc442108ed6361f7b06dca0'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:25.430476 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c4734ceb-3b29-4349-b831-ccf350b97425 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ab59efcdcc442108ed6361f7b06dca0'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:25.439286 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1320/2634] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:02:25 2022] DELETE /identity/v3/users/0ab59efcdcc442108ed6361f7b06dca0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:02:25.867019 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240a5df-304f-4fab-8ded-73eb247d3ee4 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:25.868485 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e240a5df-304f-4fab-8ded-73eb247d3ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:25.882624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240a5df-304f-4fab-8ded-73eb247d3ee4 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:25.954683 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f40ed-d251-4438-a734-49bd922f1ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:25.955537 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f40ed-d251-4438-a734-49bd922f1ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:25.955819 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f40ed-d251-4438-a734-49bd922f1ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:25.956095 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f40ed-d251-4438-a734-49bd922f1ebf admin admin] PATH_INFO: `/v3/projects/dc8471edecdd480389a430437ac89338` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:25.957302 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f40ed-d251-4438-a734-49bd922f1ebf admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc8471edecdd480389a430437ac89338)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:25.959426 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f40ed-d251-4438-a734-49bd922f1ebf admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:26.006511 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3e4f40ed-d251-4438-a734-49bd922f1ebf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc8471edecdd480389a430437ac89338', 'request_id': 'req-3e4f40ed-d251-4438-a734-49bd922f1ebf'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:26.013847 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3e4f40ed-d251-4438-a734-49bd922f1ebf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc8471edecdd480389a430437ac89338', 'request_id': 'req-3e4f40ed-d251-4438-a734-49bd922f1ebf'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:26.020566 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3e4f40ed-d251-4438-a734-49bd922f1ebf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc8471edecdd480389a430437ac89338', 'request_id': 'req-3e4f40ed-d251-4438-a734-49bd922f1ebf'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:26.031195 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3e4f40ed-d251-4438-a734-49bd922f1ebf admin admin] The token cache is being invalidate because project dc8471edecdd480389a430437ac89338 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:02:26.031488 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3e4f40ed-d251-4438-a734-49bd922f1ebf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:26.032149 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3e4f40ed-d251-4438-a734-49bd922f1ebf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:26.034022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1315/2635] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:02:25 2022] DELETE /identity/v3/projects/dc8471edecdd480389a430437ac89338 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:02:26.038806 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb516b-a8d7-4fdd-b8c5-1e9132bc5515 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:26.039099 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb516b-a8d7-4fdd-b8c5-1e9132bc5515 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:26.039429 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb516b-a8d7-4fdd-b8c5-1e9132bc5515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:26.057917 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-1ccb516b-a8d7-4fdd-b8c5-1e9132bc5515 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:02:26.059115 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1ccb516b-a8d7-4fdd-b8c5-1e9132bc5515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:26.120069 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1321/2636] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:02:26.128555 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010487a-c78c-439f-b88b-aec4310d2630 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:26.128916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010487a-c78c-439f-b88b-aec4310d2630 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:26.129260 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010487a-c78c-439f-b88b-aec4310d2630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:26.148567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-a010487a-c78c-439f-b88b-aec4310d2630 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:02:26.149784 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-a010487a-c78c-439f-b88b-aec4310d2630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:26.158199 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1316/2637] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 06:02:26.162764 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb516b-a8d7-4fdd-b8c5-1e9132bc5515 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:26.173537 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb516b-a8d7-4fdd-b8c5-1e9132bc5515 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:26.179061 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc97d9-5d67-40dc-a09d-3d4294a010c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:26.179745 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc97d9-5d67-40dc-a09d-3d4294a010c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:26.180039 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc97d9-5d67-40dc-a09d-3d4294a010c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:26.180316 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc97d9-5d67-40dc-a09d-3d4294a010c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:26.181033 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc97d9-5d67-40dc-a09d-3d4294a010c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 06:02:26.181340 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc97d9-5d67-40dc-a09d-3d4294a010c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:26.183004 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc97d9-5d67-40dc-a09d-3d4294a010c4 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:26.196085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1322/2638] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 06:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 06:02:26.200055 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010487a-c78c-439f-b88b-aec4310d2630 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:26.214894 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010487a-c78c-439f-b88b-aec4310d2630 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:26.220852 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1a2c0-e523-4937-8b81-5b1d24c3964b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:26.221467 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1a2c0-e523-4937-8b81-5b1d24c3964b admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:26.221736 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1a2c0-e523-4937-8b81-5b1d24c3964b admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:26.222024 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1a2c0-e523-4937-8b81-5b1d24c3964b admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:26.222710 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1a2c0-e523-4937-8b81-5b1d24c3964b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:26.224756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1a2c0-e523-4937-8b81-5b1d24c3964b admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:26.256176 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:26.268888 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1317/2639] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:02:26 2022] POST /identity/v3/projects => generated 363 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:02:26.270097 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc97d9-5d67-40dc-a09d-3d4294a010c4 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:26.281478 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc97d9-5d67-40dc-a09d-3d4294a010c4 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:26.343911 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34672ad-39bf-4f7a-8e9c-494ae138e2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:26.344734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34672ad-39bf-4f7a-8e9c-494ae138e2ac admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:26.344853 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34672ad-39bf-4f7a-8e9c-494ae138e2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:26.345286 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34672ad-39bf-4f7a-8e9c-494ae138e2ac admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:26.346192 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34672ad-39bf-4f7a-8e9c-494ae138e2ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:26.348192 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34672ad-39bf-4f7a-8e9c-494ae138e2ac admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:26.374608 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1323/2640] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:02:26 2022] POST /identity/v3/users => generated 282 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 06:02:26.375893 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1a2c0-e523-4937-8b81-5b1d24c3964b admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:26.389681 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1a2c0-e523-4937-8b81-5b1d24c3964b admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:26.394808 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7bfb3-d2c7-491b-a474-b922a5c17186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:26.395517 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7bfb3-d2c7-491b-a474-b922a5c17186 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:26.395846 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7bfb3-d2c7-491b-a474-b922a5c17186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:26.396127 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7bfb3-d2c7-491b-a474-b922a5c17186 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:26.397004 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7bfb3-d2c7-491b-a474-b922a5c17186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:26.398779 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7bfb3-d2c7-491b-a474-b922a5c17186 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:26.415242 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1318/2641] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 06:02:26.418400 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34672ad-39bf-4f7a-8e9c-494ae138e2ac admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:26.432522 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34672ad-39bf-4f7a-8e9c-494ae138e2ac admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:26.438474 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58fca5-4564-424a-afe4-4af1f130a984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:26.439169 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58fca5-4564-424a-afe4-4af1f130a984 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:26.439476 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58fca5-4564-424a-afe4-4af1f130a984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:26.439749 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58fca5-4564-424a-afe4-4af1f130a984 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:26.440478 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58fca5-4564-424a-afe4-4af1f130a984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:26.442322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58fca5-4564-424a-afe4-4af1f130a984 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:26.453608 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1324/2642] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:02:26.457818 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7bfb3-d2c7-491b-a474-b922a5c17186 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:26.468292 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7bfb3-d2c7-491b-a474-b922a5c17186 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:26.473076 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc06aef-0b47-400e-850f-b6491a46bdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:26.473976 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc06aef-0b47-400e-850f-b6491a46bdc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:26.474279 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc06aef-0b47-400e-850f-b6491a46bdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:26.474546 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc06aef-0b47-400e-850f-b6491a46bdc8 admin admin] PATH_INFO: `/v3/projects/9147ad3f11cf4d15a96b2638f1ca9379/users/38119074eaac47c7b6cafa323b74adf5/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:26.503829 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc06aef-0b47-400e-850f-b6491a46bdc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9147ad3f11cf4d15a96b2638f1ca9379, user_id=38119074eaac47c7b6cafa323b74adf5, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:26.506899 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc06aef-0b47-400e-850f-b6491a46bdc8 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:26.523940 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1319/2643] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:02:26 2022] PUT /identity/v3/projects/9147ad3f11cf4d15a96b2638f1ca9379/users/38119074eaac47c7b6cafa323b74adf5/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 06:02:26.535662 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a854d22-416b-4f3e-beb9-0eecbbaa9e33 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:26.535954 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a854d22-416b-4f3e-beb9-0eecbbaa9e33 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:26.536236 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a854d22-416b-4f3e-beb9-0eecbbaa9e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:26.577409 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-4a854d22-416b-4f3e-beb9-0eecbbaa9e33 None None] MFA Rules not processed for user `38119074eaac47c7b6cafa323b74adf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:02:26.578627 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4a854d22-416b-4f3e-beb9-0eecbbaa9e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:26.599296 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:26.651225 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1325/2644] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:02:26 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:02:26.655533 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc06aef-0b47-400e-850f-b6491a46bdc8 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:26.723657 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc06aef-0b47-400e-850f-b6491a46bdc8 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:26.730371 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d31e96-7d20-4943-930e-40f618e4b684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:26.731054 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d31e96-7d20-4943-930e-40f618e4b684 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:26.731371 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d31e96-7d20-4943-930e-40f618e4b684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:26.731648 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d31e96-7d20-4943-930e-40f618e4b684 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:26.732387 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d31e96-7d20-4943-930e-40f618e4b684 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:26.734397 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d31e96-7d20-4943-930e-40f618e4b684 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:26.767527 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1320/2645] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:02:26 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 06:02:26.768818 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a854d22-416b-4f3e-beb9-0eecbbaa9e33 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:26.782136 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a854d22-416b-4f3e-beb9-0eecbbaa9e33 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:26.858896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c807d0b-7dc2-459e-8cf3-e5a32e88c1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:26.859352 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c807d0b-7dc2-459e-8cf3-e5a32e88c1ca admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:26.859719 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c807d0b-7dc2-459e-8cf3-e5a32e88c1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:26.860098 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c807d0b-7dc2-459e-8cf3-e5a32e88c1ca admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:26.860912 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c807d0b-7dc2-459e-8cf3-e5a32e88c1ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:26.862994 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c807d0b-7dc2-459e-8cf3-e5a32e88c1ca admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:26.885522 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1326/2646] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:02:26 2022] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:02:26.889727 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d31e96-7d20-4943-930e-40f618e4b684 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:26.900240 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d31e96-7d20-4943-930e-40f618e4b684 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:26.904745 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60beb2-7a76-44c9-b5e7-35ee6346c9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:26.905471 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60beb2-7a76-44c9-b5e7-35ee6346c9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:26.905755 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60beb2-7a76-44c9-b5e7-35ee6346c9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:26.906028 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60beb2-7a76-44c9-b5e7-35ee6346c9f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:26.906746 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60beb2-7a76-44c9-b5e7-35ee6346c9f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:26.908370 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60beb2-7a76-44c9-b5e7-35ee6346c9f2 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:26.920020 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1321/2647] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:02:26.924430 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c807d0b-7dc2-459e-8cf3-e5a32e88c1ca admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:26.935044 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c807d0b-7dc2-459e-8cf3-e5a32e88c1ca admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:26.940419 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47db789-124c-403c-8eb9-2c6319b4e978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:26.941460 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47db789-124c-403c-8eb9-2c6319b4e978 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:26.941743 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47db789-124c-403c-8eb9-2c6319b4e978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:26.942017 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47db789-124c-403c-8eb9-2c6319b4e978 admin admin] PATH_INFO: `/v3/projects/32b53714fc57420b9925d76b61d82da6/users/254b11d950f8440db8a74b2eeccf4a52/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:26.957908 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47db789-124c-403c-8eb9-2c6319b4e978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b53714fc57420b9925d76b61d82da6, user_id=254b11d950f8440db8a74b2eeccf4a52, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:26.960644 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47db789-124c-403c-8eb9-2c6319b4e978 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:26.976047 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1327/2648] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:02:26 2022] PUT /identity/v3/projects/32b53714fc57420b9925d76b61d82da6/users/254b11d950f8440db8a74b2eeccf4a52/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:02:26.980386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60beb2-7a76-44c9-b5e7-35ee6346c9f2 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:26.990991 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60beb2-7a76-44c9-b5e7-35ee6346c9f2 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:27.054799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7891db0-04cd-4e43-b9e8-2c58ce4ca73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:27.055517 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7891db0-04cd-4e43-b9e8-2c58ce4ca73b admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:27.055800 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7891db0-04cd-4e43-b9e8-2c58ce4ca73b admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:27.056070 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7891db0-04cd-4e43-b9e8-2c58ce4ca73b admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:27.056786 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7891db0-04cd-4e43-b9e8-2c58ce4ca73b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:27.058397 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7891db0-04cd-4e43-b9e8-2c58ce4ca73b admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:27.069257 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1322/2649] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:02:27.073611 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47db789-124c-403c-8eb9-2c6319b4e978 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:27.084508 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47db789-124c-403c-8eb9-2c6319b4e978 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:27.089401 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf08cdf-51d7-4180-a066-a1e6f96a05d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:27.090367 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf08cdf-51d7-4180-a066-a1e6f96a05d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:27.090710 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf08cdf-51d7-4180-a066-a1e6f96a05d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:27.091150 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf08cdf-51d7-4180-a066-a1e6f96a05d7 admin admin] PATH_INFO: `/v3/projects/32b53714fc57420b9925d76b61d82da6/users/254b11d950f8440db8a74b2eeccf4a52/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:27.093501 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf08cdf-51d7-4180-a066-a1e6f96a05d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b53714fc57420b9925d76b61d82da6, user_id=254b11d950f8440db8a74b2eeccf4a52, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:27.096283 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf08cdf-51d7-4180-a066-a1e6f96a05d7 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:27.107404 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1328/2650] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:02:27 2022] PUT /identity/v3/projects/32b53714fc57420b9925d76b61d82da6/users/254b11d950f8440db8a74b2eeccf4a52/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:02:27.118281 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f5c5a-85d8-44f4-9965-2f6a72f6daf2 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:27.118575 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f5c5a-85d8-44f4-9965-2f6a72f6daf2 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:27.118853 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f5c5a-85d8-44f4-9965-2f6a72f6daf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:27.146186 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-884f5c5a-85d8-44f4-9965-2f6a72f6daf2 None None] MFA Rules not processed for user `254b11d950f8440db8a74b2eeccf4a52`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:02:27.147480 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-884f5c5a-85d8-44f4-9965-2f6a72f6daf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:27.170087 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:27.226251 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1323/2651] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:02:27 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:02:27.240418 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf08cdf-51d7-4180-a066-a1e6f96a05d7 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:27.242406 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-8bf08cdf-51d7-4180-a066-a1e6f96a05d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:27.327295 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf08cdf-51d7-4180-a066-a1e6f96a05d7 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:27.331924 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5778d-b432-4539-9d31-694de156b164 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:27.332585 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5778d-b432-4539-9d31-694de156b164 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:27.332868 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5778d-b432-4539-9d31-694de156b164 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:27.333141 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5778d-b432-4539-9d31-694de156b164 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:27.342584 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5778d-b432-4539-9d31-694de156b164 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:27.344065 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5778d-b432-4539-9d31-694de156b164 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:27.354466 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1329/2652] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:02:27 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:02:27.440053 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f5c5a-85d8-44f4-9965-2f6a72f6daf2 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:27.450717 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f5c5a-85d8-44f4-9965-2f6a72f6daf2 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:27.455713 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5123b5-9b67-4816-84f9-f99a1d9968e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:27.456974 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5123b5-9b67-4816-84f9-f99a1d9968e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:27.456974 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5123b5-9b67-4816-84f9-f99a1d9968e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:27.457278 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5123b5-9b67-4816-84f9-f99a1d9968e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:27.524743 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5123b5-9b67-4816-84f9-f99a1d9968e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:27.526418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5123b5-9b67-4816-84f9-f99a1d9968e0 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:27.538002 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1324/2653] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:02:27 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:02:27.899930 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5778d-b432-4539-9d31-694de156b164 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:27.901638 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-7ec5778d-b432-4539-9d31-694de156b164 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:27.923858 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:27.976208 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5778d-b432-4539-9d31-694de156b164 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:27.981044 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026c730-22e8-42c1-a0c4-f65cec898e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:27.981925 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026c730-22e8-42c1-a0c4-f65cec898e47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:27.982208 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026c730-22e8-42c1-a0c4-f65cec898e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:27.982481 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026c730-22e8-42c1-a0c4-f65cec898e47 admin admin] PATH_INFO: `/v3/users/1c4799b3a1a046aba74e9a6117d4d532` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:27.983781 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026c730-22e8-42c1-a0c4-f65cec898e47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c4799b3a1a046aba74e9a6117d4d532)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:27.985715 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026c730-22e8-42c1-a0c4-f65cec898e47 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:28.034221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3026c730-22e8-42c1-a0c4-f65cec898e47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c4799b3a1a046aba74e9a6117d4d532'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:28.040872 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3026c730-22e8-42c1-a0c4-f65cec898e47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c4799b3a1a046aba74e9a6117d4d532'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:28.048978 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3026c730-22e8-42c1-a0c4-f65cec898e47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c4799b3a1a046aba74e9a6117d4d532'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:28.049758 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3026c730-22e8-42c1-a0c4-f65cec898e47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c4799b3a1a046aba74e9a6117d4d532'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:28.064707 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-3026c730-22e8-42c1-a0c4-f65cec898e47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c4799b3a1a046aba74e9a6117d4d532'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:28.070952 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1330/2654] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:02:27 2022] DELETE /identity/v3/users/1c4799b3a1a046aba74e9a6117d4d532 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:02:28.264754 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5123b5-9b67-4816-84f9-f99a1d9968e0 service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:28.276301 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5123b5-9b67-4816-84f9-f99a1d9968e0 service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:28.338047 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e0c9c-00b6-46ae-90cd-3bc6b128fd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:28.339491 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e0c9c-00b6-46ae-90cd-3bc6b128fd72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:28.339871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e0c9c-00b6-46ae-90cd-3bc6b128fd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:28.340218 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e0c9c-00b6-46ae-90cd-3bc6b128fd72 admin admin] PATH_INFO: `/v3/projects/586e394b58204dcc86bd39e6383cebb3` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:28.342095 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e0c9c-00b6-46ae-90cd-3bc6b128fd72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=586e394b58204dcc86bd39e6383cebb3)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:28.344280 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e0c9c-00b6-46ae-90cd-3bc6b128fd72 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:28.396260 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fb9e0c9c-00b6-46ae-90cd-3bc6b128fd72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '586e394b58204dcc86bd39e6383cebb3', 'request_id': 'req-fb9e0c9c-00b6-46ae-90cd-3bc6b128fd72'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:28.406625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fb9e0c9c-00b6-46ae-90cd-3bc6b128fd72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '586e394b58204dcc86bd39e6383cebb3', 'request_id': 'req-fb9e0c9c-00b6-46ae-90cd-3bc6b128fd72'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:28.408780 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:28.414161 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fb9e0c9c-00b6-46ae-90cd-3bc6b128fd72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '586e394b58204dcc86bd39e6383cebb3', 'request_id': 'req-fb9e0c9c-00b6-46ae-90cd-3bc6b128fd72'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:28.425997 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fb9e0c9c-00b6-46ae-90cd-3bc6b128fd72 admin admin] The token cache is being invalidate because project 586e394b58204dcc86bd39e6383cebb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:02:28.426278 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fb9e0c9c-00b6-46ae-90cd-3bc6b128fd72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:28.426930 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fb9e0c9c-00b6-46ae-90cd-3bc6b128fd72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:28.429023 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1325/2655] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:02:28 2022] DELETE /identity/v3/projects/586e394b58204dcc86bd39e6383cebb3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:02:28.434244 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598d229-7c6a-46bb-85d3-a8d6e42908d8 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:28.434773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598d229-7c6a-46bb-85d3-a8d6e42908d8 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:28.434773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598d229-7c6a-46bb-85d3-a8d6e42908d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:28.454721 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-5598d229-7c6a-46bb-85d3-a8d6e42908d8 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:02:28.456012 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-5598d229-7c6a-46bb-85d3-a8d6e42908d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:28.516989 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1331/2656] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:02:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:02:28.527170 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c6b22-9388-480e-afdc-b2d72b37933e None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:28.527483 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c6b22-9388-480e-afdc-b2d72b37933e None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:28.527757 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c6b22-9388-480e-afdc-b2d72b37933e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:28.549102 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-8a6c6b22-9388-480e-afdc-b2d72b37933e None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:02:28.550320 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-8a6c6b22-9388-480e-afdc-b2d72b37933e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:28.559015 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1326/2657] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:02:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 06:02:28.563456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598d229-7c6a-46bb-85d3-a8d6e42908d8 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:28.573298 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598d229-7c6a-46bb-85d3-a8d6e42908d8 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:28.578098 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d3615-e2ff-4952-acb7-5d5a002e33f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:28.578746 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d3615-e2ff-4952-acb7-5d5a002e33f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:28.579023 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d3615-e2ff-4952-acb7-5d5a002e33f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:28.579331 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d3615-e2ff-4952-acb7-5d5a002e33f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:28.580067 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d3615-e2ff-4952-acb7-5d5a002e33f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 06:02:28.580365 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d3615-e2ff-4952-acb7-5d5a002e33f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:28.581957 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d3615-e2ff-4952-acb7-5d5a002e33f2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:28.593627 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1332/2658] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 06:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 06:02:28.597821 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c6b22-9388-480e-afdc-b2d72b37933e None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:28.607836 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c6b22-9388-480e-afdc-b2d72b37933e None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:28.612931 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d68171-c69a-47b2-996b-10f2b723c4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:28.613580 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d68171-c69a-47b2-996b-10f2b723c4bd admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:28.613863 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d68171-c69a-47b2-996b-10f2b723c4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:28.614140 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d68171-c69a-47b2-996b-10f2b723c4bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:28.614825 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d68171-c69a-47b2-996b-10f2b723c4bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:28.616769 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d68171-c69a-47b2-996b-10f2b723c4bd admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:28.645873 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1327/2659] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:02:28 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:02:28.650027 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d3615-e2ff-4952-acb7-5d5a002e33f2 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:28.660994 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d3615-e2ff-4952-acb7-5d5a002e33f2 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:28.678705 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:28.726080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c0bce-3cd4-487f-b434-137393e6d44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:28.726747 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c0bce-3cd4-487f-b434-137393e6d44a admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:28.727028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c0bce-3cd4-487f-b434-137393e6d44a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:28.727323 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c0bce-3cd4-487f-b434-137393e6d44a admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:28.728317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c0bce-3cd4-487f-b434-137393e6d44a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:28.730256 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c0bce-3cd4-487f-b434-137393e6d44a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:28.755584 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1333/2660] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:02:28 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:02:28.756903 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d68171-c69a-47b2-996b-10f2b723c4bd admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:28.767489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d68171-c69a-47b2-996b-10f2b723c4bd admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:28.772310 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01e548-0c3a-4c36-964a-6d0a68ace15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:28.772971 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01e548-0c3a-4c36-964a-6d0a68ace15b admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:28.773296 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01e548-0c3a-4c36-964a-6d0a68ace15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:28.773571 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01e548-0c3a-4c36-964a-6d0a68ace15b admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:28.774316 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01e548-0c3a-4c36-964a-6d0a68ace15b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:28.776104 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01e548-0c3a-4c36-964a-6d0a68ace15b admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:28.786994 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1328/2661] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:02:28.791028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c0bce-3cd4-487f-b434-137393e6d44a admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:28.801231 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c0bce-3cd4-487f-b434-137393e6d44a admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:28.805832 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f78df7-9bcb-4b9e-af95-adffb879659d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:28.806510 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f78df7-9bcb-4b9e-af95-adffb879659d admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:28.806795 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f78df7-9bcb-4b9e-af95-adffb879659d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:28.807071 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f78df7-9bcb-4b9e-af95-adffb879659d admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:28.807841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f78df7-9bcb-4b9e-af95-adffb879659d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:28.809422 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f78df7-9bcb-4b9e-af95-adffb879659d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:28.819656 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1334/2662] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:02:28.823884 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01e548-0c3a-4c36-964a-6d0a68ace15b admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:28.834133 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01e548-0c3a-4c36-964a-6d0a68ace15b admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:28.838842 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de541a40-0168-45f1-af0d-cc3df182af17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:28.839825 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de541a40-0168-45f1-af0d-cc3df182af17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:28.840161 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de541a40-0168-45f1-af0d-cc3df182af17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:28.840608 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de541a40-0168-45f1-af0d-cc3df182af17 admin admin] PATH_INFO: `/v3/projects/dd86086d8ae84817a72d6817da5358b5/users/b22f0b92554e41aea3dc4624a4334032/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:28.856370 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de541a40-0168-45f1-af0d-cc3df182af17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd86086d8ae84817a72d6817da5358b5, user_id=b22f0b92554e41aea3dc4624a4334032, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:28.859041 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de541a40-0168-45f1-af0d-cc3df182af17 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:28.873971 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1329/2663] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:02:28 2022] PUT /identity/v3/projects/dd86086d8ae84817a72d6817da5358b5/users/b22f0b92554e41aea3dc4624a4334032/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 06:02:28.879255 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604667d-ee6d-437b-a481-265abdd3f036 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:28.879581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604667d-ee6d-437b-a481-265abdd3f036 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:28.879895 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604667d-ee6d-437b-a481-265abdd3f036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:28.898783 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-0604667d-ee6d-437b-a481-265abdd3f036 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:02:28.900025 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0604667d-ee6d-437b-a481-265abdd3f036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:28.965248 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1335/2664] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:02:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:02:28.975318 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de541a40-0168-45f1-af0d-cc3df182af17 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:28.977067 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-de541a40-0168-45f1-af0d-cc3df182af17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:29.041283 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de541a40-0168-45f1-af0d-cc3df182af17 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:29.047674 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c48c1-e5ee-43ab-8ea3-d7782faed533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:29.048434 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c48c1-e5ee-43ab-8ea3-d7782faed533 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:29.048739 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c48c1-e5ee-43ab-8ea3-d7782faed533 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:29.049027 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c48c1-e5ee-43ab-8ea3-d7782faed533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:29.059159 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c48c1-e5ee-43ab-8ea3-d7782faed533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:29.060655 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c48c1-e5ee-43ab-8ea3-d7782faed533 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:29.077464 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1330/2665] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:02:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:02:33.180430 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba4a90-2173-4371-ba48-31e893a9f9e6 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:33.180985 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba4a90-2173-4371-ba48-31e893a9f9e6 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:33.180985 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba4a90-2173-4371-ba48-31e893a9f9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:33.207761 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d7ba4a90-2173-4371-ba48-31e893a9f9e6 None None] MFA Rules not processed for user `b22f0b92554e41aea3dc4624a4334032`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:02:33.208969 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d7ba4a90-2173-4371-ba48-31e893a9f9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:33.274692 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1336/2666] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:02:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:02:33.289316 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c48c1-e5ee-43ab-8ea3-d7782faed533 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:33.290860 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-0b4c48c1-e5ee-43ab-8ea3-d7782faed533 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:33.374501 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c48c1-e5ee-43ab-8ea3-d7782faed533 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:33.380392 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a673b7e-d007-4384-9b04-2d57d505359b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:33.381684 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a673b7e-d007-4384-9b04-2d57d505359b service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:33.381993 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a673b7e-d007-4384-9b04-2d57d505359b service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:33.382268 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a673b7e-d007-4384-9b04-2d57d505359b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:33.391585 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a673b7e-d007-4384-9b04-2d57d505359b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:33.393373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a673b7e-d007-4384-9b04-2d57d505359b service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:33.402653 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1331/2667] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:02:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:02:33.868944 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba4a90-2173-4371-ba48-31e893a9f9e6 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:33.870637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d7ba4a90-2173-4371-ba48-31e893a9f9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:33.884422 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba4a90-2173-4371-ba48-31e893a9f9e6 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:33.889798 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53095aa-134a-4dcd-993c-137db27fc41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:33.890871 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53095aa-134a-4dcd-993c-137db27fc41f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:33.891156 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53095aa-134a-4dcd-993c-137db27fc41f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:33.891465 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53095aa-134a-4dcd-993c-137db27fc41f admin admin] PATH_INFO: `/v3/users/38119074eaac47c7b6cafa323b74adf5` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:33.892679 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53095aa-134a-4dcd-993c-137db27fc41f admin admin] RBAC: Authorizing `identity:delete_user(user_id=38119074eaac47c7b6cafa323b74adf5)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:33.894652 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53095aa-134a-4dcd-993c-137db27fc41f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:33.920159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:33.962512 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b53095aa-134a-4dcd-993c-137db27fc41f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38119074eaac47c7b6cafa323b74adf5'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:33.978226 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b53095aa-134a-4dcd-993c-137db27fc41f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38119074eaac47c7b6cafa323b74adf5'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:33.987483 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b53095aa-134a-4dcd-993c-137db27fc41f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38119074eaac47c7b6cafa323b74adf5'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:33.988512 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b53095aa-134a-4dcd-993c-137db27fc41f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38119074eaac47c7b6cafa323b74adf5'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:34.003954 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-b53095aa-134a-4dcd-993c-137db27fc41f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38119074eaac47c7b6cafa323b74adf5'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:34.010537 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1337/2668] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:02:33 2022] DELETE /identity/v3/users/38119074eaac47c7b6cafa323b74adf5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 06:02:34.015066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60197a46-6e7c-43f9-99f7-3721c572bf7d None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:34.016085 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60197a46-6e7c-43f9-99f7-3721c572bf7d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:34.016085 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60197a46-6e7c-43f9-99f7-3721c572bf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:34.055288 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-60197a46-6e7c-43f9-99f7-3721c572bf7d None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:02:34.056533 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-60197a46-6e7c-43f9-99f7-3721c572bf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:34.063677 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:34.139584 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1332/2669] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:02:34.149812 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53095aa-134a-4dcd-993c-137db27fc41f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:34.151451 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b53095aa-134a-4dcd-993c-137db27fc41f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:34.223640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53095aa-134a-4dcd-993c-137db27fc41f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:34.228133 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e8430-2185-4b4c-b417-410d8514f0a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:34.228923 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e8430-2185-4b4c-b417-410d8514f0a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:34.229274 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e8430-2185-4b4c-b417-410d8514f0a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:34.229614 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e8430-2185-4b4c-b417-410d8514f0a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:34.241443 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e8430-2185-4b4c-b417-410d8514f0a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:34.243066 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e8430-2185-4b4c-b417-410d8514f0a2 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:34.255990 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1338/2670] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:02:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:02:34.566654 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60197a46-6e7c-43f9-99f7-3721c572bf7d None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:34.568160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-60197a46-6e7c-43f9-99f7-3721c572bf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:34.584253 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60197a46-6e7c-43f9-99f7-3721c572bf7d None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:34.589731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49156f34-62e9-480e-8a31-e8339f1d70b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:34.591521 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49156f34-62e9-480e-8a31-e8339f1d70b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:34.591884 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49156f34-62e9-480e-8a31-e8339f1d70b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:34.592705 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49156f34-62e9-480e-8a31-e8339f1d70b7 admin admin] PATH_INFO: `/v3/projects/9147ad3f11cf4d15a96b2638f1ca9379` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:34.594130 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49156f34-62e9-480e-8a31-e8339f1d70b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9147ad3f11cf4d15a96b2638f1ca9379)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:34.596776 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49156f34-62e9-480e-8a31-e8339f1d70b7 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:34.650214 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-49156f34-62e9-480e-8a31-e8339f1d70b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9147ad3f11cf4d15a96b2638f1ca9379', 'request_id': 'req-49156f34-62e9-480e-8a31-e8339f1d70b7'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:34.658604 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-49156f34-62e9-480e-8a31-e8339f1d70b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9147ad3f11cf4d15a96b2638f1ca9379', 'request_id': 'req-49156f34-62e9-480e-8a31-e8339f1d70b7'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:34.666827 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-49156f34-62e9-480e-8a31-e8339f1d70b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9147ad3f11cf4d15a96b2638f1ca9379', 'request_id': 'req-49156f34-62e9-480e-8a31-e8339f1d70b7'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:34.680750 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-49156f34-62e9-480e-8a31-e8339f1d70b7 admin admin] The token cache is being invalidate because project 9147ad3f11cf4d15a96b2638f1ca9379 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:02:34.681043 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-49156f34-62e9-480e-8a31-e8339f1d70b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:34.681691 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-49156f34-62e9-480e-8a31-e8339f1d70b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:34.683539 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1333/2671] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:02:34 2022] DELETE /identity/v3/projects/9147ad3f11cf4d15a96b2638f1ca9379 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:02:34.687164 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e8430-2185-4b4c-b417-410d8514f0a2 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:34.708691 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e8430-2185-4b4c-b417-410d8514f0a2 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:34.781421 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e35ad5-01be-4817-9511-34e925704b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:34.782446 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e35ad5-01be-4817-9511-34e925704b7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:34.782731 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e35ad5-01be-4817-9511-34e925704b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:34.783011 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e35ad5-01be-4817-9511-34e925704b7a admin admin] PATH_INFO: `/v3/users/254b11d950f8440db8a74b2eeccf4a52` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:34.784322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e35ad5-01be-4817-9511-34e925704b7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=254b11d950f8440db8a74b2eeccf4a52)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:34.786249 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e35ad5-01be-4817-9511-34e925704b7a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:34.834884 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:34.837425 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-05e35ad5-01be-4817-9511-34e925704b7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '254b11d950f8440db8a74b2eeccf4a52'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:34.846840 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-05e35ad5-01be-4817-9511-34e925704b7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '254b11d950f8440db8a74b2eeccf4a52'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:34.856423 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-05e35ad5-01be-4817-9511-34e925704b7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '254b11d950f8440db8a74b2eeccf4a52'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:34.857077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-05e35ad5-01be-4817-9511-34e925704b7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '254b11d950f8440db8a74b2eeccf4a52'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:34.870766 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-05e35ad5-01be-4817-9511-34e925704b7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '254b11d950f8440db8a74b2eeccf4a52'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:34.876890 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1339/2672] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:02:34 2022] DELETE /identity/v3/users/254b11d950f8440db8a74b2eeccf4a52 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 06:02:35.097776 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59dad73-d539-468c-bd42-6a29c38a0e8b None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:35.098036 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59dad73-d539-468c-bd42-6a29c38a0e8b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:35.098331 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59dad73-d539-468c-bd42-6a29c38a0e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:35.117852 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-a59dad73-d539-468c-bd42-6a29c38a0e8b None None] MFA Rules not processed for user `b22f0b92554e41aea3dc4624a4334032`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:02:35.119136 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-a59dad73-d539-468c-bd42-6a29c38a0e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:35.169297 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e35ad5-01be-4817-9511-34e925704b7a admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:35.171310 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-05e35ad5-01be-4817-9511-34e925704b7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:35.187411 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1334/2673] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:02:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 06:02:35.266144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e35ad5-01be-4817-9511-34e925704b7a admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:35.271651 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65a025-7c9c-49a2-9903-e3afc3196b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:35.272705 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65a025-7c9c-49a2-9903-e3afc3196b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:35.273087 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65a025-7c9c-49a2-9903-e3afc3196b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:35.273464 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65a025-7c9c-49a2-9903-e3afc3196b2c admin admin] PATH_INFO: `/v3/projects/32b53714fc57420b9925d76b61d82da6` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:35.274828 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65a025-7c9c-49a2-9903-e3afc3196b2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=32b53714fc57420b9925d76b61d82da6)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:35.276922 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65a025-7c9c-49a2-9903-e3afc3196b2c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:35.349788 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-df65a025-7c9c-49a2-9903-e3afc3196b2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32b53714fc57420b9925d76b61d82da6', 'request_id': 'req-df65a025-7c9c-49a2-9903-e3afc3196b2c'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:35.356931 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-df65a025-7c9c-49a2-9903-e3afc3196b2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32b53714fc57420b9925d76b61d82da6', 'request_id': 'req-df65a025-7c9c-49a2-9903-e3afc3196b2c'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:35.367042 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-df65a025-7c9c-49a2-9903-e3afc3196b2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32b53714fc57420b9925d76b61d82da6', 'request_id': 'req-df65a025-7c9c-49a2-9903-e3afc3196b2c'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:35.379861 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-df65a025-7c9c-49a2-9903-e3afc3196b2c admin admin] The token cache is being invalidate because project 32b53714fc57420b9925d76b61d82da6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:02:35.380216 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-df65a025-7c9c-49a2-9903-e3afc3196b2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:35.380854 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-df65a025-7c9c-49a2-9903-e3afc3196b2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:35.383249 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1340/2674] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:02:35 2022] DELETE /identity/v3/projects/32b53714fc57420b9925d76b61d82da6 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 06:02:35.388871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cc790-7c9d-4d2a-8412-b5ef18fb64e6 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:35.389170 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cc790-7c9d-4d2a-8412-b5ef18fb64e6 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:35.389428 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cc790-7c9d-4d2a-8412-b5ef18fb64e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:35.408326 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-3e1cc790-7c9d-4d2a-8412-b5ef18fb64e6 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:02:35.409556 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-3e1cc790-7c9d-4d2a-8412-b5ef18fb64e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:35.445837 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:35.476390 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1335/2675] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:02:35.484861 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040bef5-66a8-4751-80bf-30c72776c810 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:35.485074 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040bef5-66a8-4751-80bf-30c72776c810 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:35.485352 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040bef5-66a8-4751-80bf-30c72776c810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:35.507101 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d040bef5-66a8-4751-80bf-30c72776c810 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:02:35.508425 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d040bef5-66a8-4751-80bf-30c72776c810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:35.517738 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1341/2676] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:02:35.523657 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1cc790-7c9d-4d2a-8412-b5ef18fb64e6 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:35.541482 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1cc790-7c9d-4d2a-8412-b5ef18fb64e6 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:35.546806 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64139c-557d-4202-b8c7-993637b5c304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:35.546964 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040bef5-66a8-4751-80bf-30c72776c810 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:35.547069 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64139c-557d-4202-b8c7-993637b5c304 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:35.547379 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64139c-557d-4202-b8c7-993637b5c304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:35.547946 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64139c-557d-4202-b8c7-993637b5c304 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:35.548381 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64139c-557d-4202-b8c7-993637b5c304 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 06:02:35.548691 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64139c-557d-4202-b8c7-993637b5c304 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:35.548796 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d040bef5-66a8-4751-80bf-30c72776c810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:35.550794 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64139c-557d-4202-b8c7-993637b5c304 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:35.563782 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1336/2677] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 06:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 06:02:35.567369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64139c-557d-4202-b8c7-993637b5c304 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:35.580349 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64139c-557d-4202-b8c7-993637b5c304 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:35.586012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f71a6-4bdb-4e77-948b-47c096ad127f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:35.592543 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f71a6-4bdb-4e77-948b-47c096ad127f admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:35.594055 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f71a6-4bdb-4e77-948b-47c096ad127f admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:35.594509 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f71a6-4bdb-4e77-948b-47c096ad127f admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:35.597758 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f71a6-4bdb-4e77-948b-47c096ad127f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:35.601998 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f71a6-4bdb-4e77-948b-47c096ad127f admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:35.612876 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:35.619506 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040bef5-66a8-4751-80bf-30c72776c810 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:35.625832 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dfb729-904a-4555-96b1-1c15f6679135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:35.626905 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dfb729-904a-4555-96b1-1c15f6679135 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:35.630930 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dfb729-904a-4555-96b1-1c15f6679135 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:35.631358 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dfb729-904a-4555-96b1-1c15f6679135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:35.633481 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-61dfb729-904a-4555-96b1-1c15f6679135 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:35.645476 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dfb729-904a-4555-96b1-1c15f6679135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:35.647086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dfb729-904a-4555-96b1-1c15f6679135 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:35.656446 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1342/2678] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:02:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:02:35.660726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1337/2679] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:02:35 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:02:35.665000 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dfb729-904a-4555-96b1-1c15f6679135 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:35.685154 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dfb729-904a-4555-96b1-1c15f6679135 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:35.753926 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd3181-a303-41d7-9a7d-26f18ec53877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:35.754697 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd3181-a303-41d7-9a7d-26f18ec53877 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:35.754984 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd3181-a303-41d7-9a7d-26f18ec53877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:35.755291 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd3181-a303-41d7-9a7d-26f18ec53877 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:35.757281 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd3181-a303-41d7-9a7d-26f18ec53877 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:35.759830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd3181-a303-41d7-9a7d-26f18ec53877 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:35.789689 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1343/2680] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:02:35 2022] POST /identity/v3/users => generated 292 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:02:35.793153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f71a6-4bdb-4e77-948b-47c096ad127f admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:35.804110 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f71a6-4bdb-4e77-948b-47c096ad127f admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:35.809727 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e39a93-34c9-4083-9173-b7a737e745af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:35.810414 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e39a93-34c9-4083-9173-b7a737e745af admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:35.810698 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e39a93-34c9-4083-9173-b7a737e745af admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:35.810971 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e39a93-34c9-4083-9173-b7a737e745af admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:35.811737 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e39a93-34c9-4083-9173-b7a737e745af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:35.813485 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e39a93-34c9-4083-9173-b7a737e745af admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:35.825542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1338/2681] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:02:35.829088 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd3181-a303-41d7-9a7d-26f18ec53877 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:35.839545 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd3181-a303-41d7-9a7d-26f18ec53877 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:35.845100 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcd7eb-f8a2-4014-a612-36c92c1af7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:35.845789 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcd7eb-f8a2-4014-a612-36c92c1af7bc admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:35.846854 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcd7eb-f8a2-4014-a612-36c92c1af7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:35.846854 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcd7eb-f8a2-4014-a612-36c92c1af7bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:35.847096 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcd7eb-f8a2-4014-a612-36c92c1af7bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:35.848746 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcd7eb-f8a2-4014-a612-36c92c1af7bc admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:35.860355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1344/2682] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:02:35.864426 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e39a93-34c9-4083-9173-b7a737e745af admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:35.882371 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e39a93-34c9-4083-9173-b7a737e745af admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:35.891885 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d66081-4e4a-42c4-bf06-7cbb31ef4182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:35.892956 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d66081-4e4a-42c4-bf06-7cbb31ef4182 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:35.893249 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d66081-4e4a-42c4-bf06-7cbb31ef4182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:35.893529 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d66081-4e4a-42c4-bf06-7cbb31ef4182 admin admin] PATH_INFO: `/v3/projects/4e8c6f9b2d024fcbb7d779b45f7c6f1b/users/97d2c010f7464c7289387ece2658ad20/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:35.913053 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d66081-4e4a-42c4-bf06-7cbb31ef4182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e8c6f9b2d024fcbb7d779b45f7c6f1b, user_id=97d2c010f7464c7289387ece2658ad20, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:35.916156 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d66081-4e4a-42c4-bf06-7cbb31ef4182 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:35.934332 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1339/2683] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:02:35 2022] PUT /identity/v3/projects/4e8c6f9b2d024fcbb7d779b45f7c6f1b/users/97d2c010f7464c7289387ece2658ad20/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:02:35.946098 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24ae9c-bd04-45b6-82b5-44666bb0d16b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:35.946457 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24ae9c-bd04-45b6-82b5-44666bb0d16b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:35.946812 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24ae9c-bd04-45b6-82b5-44666bb0d16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:35.977109 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6d24ae9c-bd04-45b6-82b5-44666bb0d16b None None] MFA Rules not processed for user `97d2c010f7464c7289387ece2658ad20`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:02:35.978847 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6d24ae9c-bd04-45b6-82b5-44666bb0d16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:36.085712 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d66081-4e4a-42c4-bf06-7cbb31ef4182 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:36.091121 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1345/2684] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:02:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:02:36.168991 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d66081-4e4a-42c4-bf06-7cbb31ef4182 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:36.174983 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90d7e1-5c53-4883-af9b-3dbab869d393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:36.175690 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90d7e1-5c53-4883-af9b-3dbab869d393 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:36.176116 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90d7e1-5c53-4883-af9b-3dbab869d393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:36.176399 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90d7e1-5c53-4883-af9b-3dbab869d393 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:36.177094 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90d7e1-5c53-4883-af9b-3dbab869d393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:36.179037 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90d7e1-5c53-4883-af9b-3dbab869d393 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:36.206955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1340/2685] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:02:36 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:02:36.211092 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24ae9c-bd04-45b6-82b5-44666bb0d16b None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:36.223242 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24ae9c-bd04-45b6-82b5-44666bb0d16b None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:36.285537 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:36.292798 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8a157-0a63-4851-a1fd-c5d514cc9877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:36.293723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8a157-0a63-4851-a1fd-c5d514cc9877 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:36.294085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8a157-0a63-4851-a1fd-c5d514cc9877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:36.294685 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8a157-0a63-4851-a1fd-c5d514cc9877 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:36.296004 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8a157-0a63-4851-a1fd-c5d514cc9877 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:36.298139 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8a157-0a63-4851-a1fd-c5d514cc9877 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:36.326737 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1346/2686] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:02:36 2022] POST /identity/v3/users => generated 296 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 06:02:36.328098 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90d7e1-5c53-4883-af9b-3dbab869d393 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:36.339751 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90d7e1-5c53-4883-af9b-3dbab869d393 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:36.347344 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64015a26-8b20-4518-b30d-d4b1cd26c4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:36.348039 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64015a26-8b20-4518-b30d-d4b1cd26c4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:36.348320 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64015a26-8b20-4518-b30d-d4b1cd26c4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:36.348589 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64015a26-8b20-4518-b30d-d4b1cd26c4f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:36.349356 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64015a26-8b20-4518-b30d-d4b1cd26c4f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:36.351532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64015a26-8b20-4518-b30d-d4b1cd26c4f5 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:36.367801 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1341/2687] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:02:36.370304 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8a157-0a63-4851-a1fd-c5d514cc9877 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:36.383993 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8a157-0a63-4851-a1fd-c5d514cc9877 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:36.397979 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd24aa-80f2-4089-9a54-f9bfebbb94c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:36.398972 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd24aa-80f2-4089-9a54-f9bfebbb94c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:36.399369 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd24aa-80f2-4089-9a54-f9bfebbb94c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:36.399704 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd24aa-80f2-4089-9a54-f9bfebbb94c1 admin admin] PATH_INFO: `/v3/projects/6fa8fc78f70645b692e8ee9c39cf1084/users/cd7a6884588f4fcdad6dd699b464ea1b/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:36.419661 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd24aa-80f2-4089-9a54-f9bfebbb94c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fa8fc78f70645b692e8ee9c39cf1084, user_id=cd7a6884588f4fcdad6dd699b464ea1b, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:36.422723 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd24aa-80f2-4089-9a54-f9bfebbb94c1 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:36.443232 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1347/2688] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:02:36 2022] PUT /identity/v3/projects/6fa8fc78f70645b692e8ee9c39cf1084/users/cd7a6884588f4fcdad6dd699b464ea1b/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:02:36.444502 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64015a26-8b20-4518-b30d-d4b1cd26c4f5 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:36.460276 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64015a26-8b20-4518-b30d-d4b1cd26c4f5 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:36.522442 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:36.548510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1c8cb-9680-450a-9588-81acd87d4ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:36.549199 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1c8cb-9680-450a-9588-81acd87d4ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:36.549484 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1c8cb-9680-450a-9588-81acd87d4ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:36.549761 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1c8cb-9680-450a-9588-81acd87d4ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:36.550497 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1c8cb-9680-450a-9588-81acd87d4ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:36.552910 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1c8cb-9680-450a-9588-81acd87d4ff3 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:36.566472 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1342/2689] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:02:36.571481 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd24aa-80f2-4089-9a54-f9bfebbb94c1 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:36.589610 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd24aa-80f2-4089-9a54-f9bfebbb94c1 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:36.595172 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02b9e5-21b9-4ec1-a646-442e4ccb25fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:36.596135 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02b9e5-21b9-4ec1-a646-442e4ccb25fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:36.596446 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02b9e5-21b9-4ec1-a646-442e4ccb25fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:36.596734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02b9e5-21b9-4ec1-a646-442e4ccb25fc admin admin] PATH_INFO: `/v3/projects/6fa8fc78f70645b692e8ee9c39cf1084/users/cd7a6884588f4fcdad6dd699b464ea1b/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:36.598993 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02b9e5-21b9-4ec1-a646-442e4ccb25fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fa8fc78f70645b692e8ee9c39cf1084, user_id=cd7a6884588f4fcdad6dd699b464ea1b, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:36.602575 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02b9e5-21b9-4ec1-a646-442e4ccb25fc admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:36.623225 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1348/2690] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:02:36 2022] PUT /identity/v3/projects/6fa8fc78f70645b692e8ee9c39cf1084/users/cd7a6884588f4fcdad6dd699b464ea1b/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:02:36.630087 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a80f9-dc17-4522-a925-d1e37d133026 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:36.631110 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a80f9-dc17-4522-a925-d1e37d133026 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:36.631563 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a80f9-dc17-4522-a925-d1e37d133026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:36.674555 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-260a80f9-dc17-4522-a925-d1e37d133026 None None] MFA Rules not processed for user `cd7a6884588f4fcdad6dd699b464ea1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:02:36.676241 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-260a80f9-dc17-4522-a925-d1e37d133026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:36.828624 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1343/2691] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:02:36 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:02:36.841109 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02b9e5-21b9-4ec1-a646-442e4ccb25fc admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:36.842974 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4d02b9e5-21b9-4ec1-a646-442e4ccb25fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:36.909865 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02b9e5-21b9-4ec1-a646-442e4ccb25fc admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:36.913752 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6b01f-0d0a-406d-979a-6b09888996de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:36.914570 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6b01f-0d0a-406d-979a-6b09888996de service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:36.914922 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6b01f-0d0a-406d-979a-6b09888996de service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:36.915298 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6b01f-0d0a-406d-979a-6b09888996de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:36.927645 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab6b01f-0d0a-406d-979a-6b09888996de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:36.929269 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab6b01f-0d0a-406d-979a-6b09888996de service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:36.940735 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1349/2692] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:02:36 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:02:37.016811 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a80f9-dc17-4522-a925-d1e37d133026 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:37.026691 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a80f9-dc17-4522-a925-d1e37d133026 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:37.030571 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105050b-3b7b-47ce-ac8a-87aea5571efb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:37.031323 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105050b-3b7b-47ce-ac8a-87aea5571efb service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:37.031602 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105050b-3b7b-47ce-ac8a-87aea5571efb service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:37.031872 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105050b-3b7b-47ce-ac8a-87aea5571efb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:37.092230 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105050b-3b7b-47ce-ac8a-87aea5571efb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:37.093777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105050b-3b7b-47ce-ac8a-87aea5571efb service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:37.103426 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1344/2693] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:02:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:02:37.439722 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6b01f-0d0a-406d-979a-6b09888996de service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:37.511737 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6b01f-0d0a-406d-979a-6b09888996de service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:37.517356 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a8c6f-bb3c-461f-8480-12c6c0f0b3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:37.518242 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a8c6f-bb3c-461f-8480-12c6c0f0b3c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:37.518530 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a8c6f-bb3c-461f-8480-12c6c0f0b3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:37.518803 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a8c6f-bb3c-461f-8480-12c6c0f0b3c0 admin admin] PATH_INFO: `/v3/users/97d2c010f7464c7289387ece2658ad20` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:37.520218 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a8c6f-bb3c-461f-8480-12c6c0f0b3c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97d2c010f7464c7289387ece2658ad20)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:37.522014 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a8c6f-bb3c-461f-8480-12c6c0f0b3c0 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:37.581222 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-642a8c6f-bb3c-461f-8480-12c6c0f0b3c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97d2c010f7464c7289387ece2658ad20'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:37.587352 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:37.590102 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-642a8c6f-bb3c-461f-8480-12c6c0f0b3c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97d2c010f7464c7289387ece2658ad20'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:37.606335 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-642a8c6f-bb3c-461f-8480-12c6c0f0b3c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97d2c010f7464c7289387ece2658ad20'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:37.607738 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-642a8c6f-bb3c-461f-8480-12c6c0f0b3c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97d2c010f7464c7289387ece2658ad20'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:37.628508 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-642a8c6f-bb3c-461f-8480-12c6c0f0b3c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97d2c010f7464c7289387ece2658ad20'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:37.647072 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1350/2694] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:02:37 2022] DELETE /identity/v3/users/97d2c010f7464c7289387ece2658ad20 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:02:37.651653 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc28025-fc68-42ae-afa9-c5d92a75df6a None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:37.652115 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc28025-fc68-42ae-afa9-c5d92a75df6a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:37.652415 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc28025-fc68-42ae-afa9-c5d92a75df6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:37.676964 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-cdc28025-fc68-42ae-afa9-c5d92a75df6a None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:02:37.678256 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-cdc28025-fc68-42ae-afa9-c5d92a75df6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:37.761151 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1345/2695] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:02:37.772922 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a8c6f-bb3c-461f-8480-12c6c0f0b3c0 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:37.774786 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-642a8c6f-bb3c-461f-8480-12c6c0f0b3c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:37.848021 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a8c6f-bb3c-461f-8480-12c6c0f0b3c0 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:37.857094 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6f91c-5301-4e51-a7d5-6e9bdbb85481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:37.857901 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6f91c-5301-4e51-a7d5-6e9bdbb85481 service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:37.858182 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6f91c-5301-4e51-a7d5-6e9bdbb85481 service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:37.858453 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6f91c-5301-4e51-a7d5-6e9bdbb85481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:37.869932 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6f91c-5301-4e51-a7d5-6e9bdbb85481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:37.871425 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6f91c-5301-4e51-a7d5-6e9bdbb85481 service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:37.887970 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1351/2696] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:02:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:02:38.363347 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc28025-fc68-42ae-afa9-c5d92a75df6a None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:38.364808 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-cdc28025-fc68-42ae-afa9-c5d92a75df6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:38.374063 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=100 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:38.379074 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc28025-fc68-42ae-afa9-c5d92a75df6a None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:38.384333 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b4512-9584-45c7-80e0-997fc70f672e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:38.385381 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b4512-9584-45c7-80e0-997fc70f672e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:38.385792 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b4512-9584-45c7-80e0-997fc70f672e admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:38.386153 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b4512-9584-45c7-80e0-997fc70f672e admin admin] PATH_INFO: `/v3/projects/4e8c6f9b2d024fcbb7d779b45f7c6f1b` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:38.387781 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b4512-9584-45c7-80e0-997fc70f672e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e8c6f9b2d024fcbb7d779b45f7c6f1b)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:38.390203 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b4512-9584-45c7-80e0-997fc70f672e admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:38.451930 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fa2b4512-9584-45c7-80e0-997fc70f672e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e8c6f9b2d024fcbb7d779b45f7c6f1b', 'request_id': 'req-fa2b4512-9584-45c7-80e0-997fc70f672e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:38.461390 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fa2b4512-9584-45c7-80e0-997fc70f672e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e8c6f9b2d024fcbb7d779b45f7c6f1b', 'request_id': 'req-fa2b4512-9584-45c7-80e0-997fc70f672e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:38.469131 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fa2b4512-9584-45c7-80e0-997fc70f672e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e8c6f9b2d024fcbb7d779b45f7c6f1b', 'request_id': 'req-fa2b4512-9584-45c7-80e0-997fc70f672e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:38.481540 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fa2b4512-9584-45c7-80e0-997fc70f672e admin admin] The token cache is being invalidate because project 4e8c6f9b2d024fcbb7d779b45f7c6f1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:02:38.481883 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fa2b4512-9584-45c7-80e0-997fc70f672e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:38.482562 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-fa2b4512-9584-45c7-80e0-997fc70f672e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:38.491066 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1346/2697] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:02:38 2022] DELETE /identity/v3/projects/4e8c6f9b2d024fcbb7d779b45f7c6f1b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:02:38.493052 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6f91c-5301-4e51-a7d5-6e9bdbb85481 service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:38.506014 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6f91c-5301-4e51-a7d5-6e9bdbb85481 service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:38.569636 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b066e-dcc8-4f00-b75d-28192df8df61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:38.570827 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b066e-dcc8-4f00-b75d-28192df8df61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:38.571114 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b066e-dcc8-4f00-b75d-28192df8df61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:38.571415 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b066e-dcc8-4f00-b75d-28192df8df61 admin admin] PATH_INFO: `/v3/users/cd7a6884588f4fcdad6dd699b464ea1b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:38.572663 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b066e-dcc8-4f00-b75d-28192df8df61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd7a6884588f4fcdad6dd699b464ea1b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:38.574715 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b066e-dcc8-4f00-b75d-28192df8df61 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:38.623842 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5f9b066e-dcc8-4f00-b75d-28192df8df61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd7a6884588f4fcdad6dd699b464ea1b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:38.630709 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5f9b066e-dcc8-4f00-b75d-28192df8df61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd7a6884588f4fcdad6dd699b464ea1b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:38.638207 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5f9b066e-dcc8-4f00-b75d-28192df8df61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd7a6884588f4fcdad6dd699b464ea1b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:38.638849 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5f9b066e-dcc8-4f00-b75d-28192df8df61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd7a6884588f4fcdad6dd699b464ea1b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:38.651159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:38.655144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-5f9b066e-dcc8-4f00-b75d-28192df8df61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd7a6884588f4fcdad6dd699b464ea1b'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:38.663722 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1352/2698] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:02:38 2022] DELETE /identity/v3/users/cd7a6884588f4fcdad6dd699b464ea1b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:02:39.118707 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b4512-9584-45c7-80e0-997fc70f672e admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:39.120490 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-fa2b4512-9584-45c7-80e0-997fc70f672e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:39.136446 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b4512-9584-45c7-80e0-997fc70f672e admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:39.205670 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc2b6e-1754-451e-b45a-98737ddb7e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:39.206724 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc2b6e-1754-451e-b45a-98737ddb7e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:39.207009 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc2b6e-1754-451e-b45a-98737ddb7e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:39.207516 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc2b6e-1754-451e-b45a-98737ddb7e94 admin admin] PATH_INFO: `/v3/projects/6fa8fc78f70645b692e8ee9c39cf1084` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:39.208803 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc2b6e-1754-451e-b45a-98737ddb7e94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fa8fc78f70645b692e8ee9c39cf1084)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:39.210925 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc2b6e-1754-451e-b45a-98737ddb7e94 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:39.263100 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7fcc2b6e-1754-451e-b45a-98737ddb7e94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fa8fc78f70645b692e8ee9c39cf1084', 'request_id': 'req-7fcc2b6e-1754-451e-b45a-98737ddb7e94'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:39.272899 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7fcc2b6e-1754-451e-b45a-98737ddb7e94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fa8fc78f70645b692e8ee9c39cf1084', 'request_id': 'req-7fcc2b6e-1754-451e-b45a-98737ddb7e94'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:39.280944 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7fcc2b6e-1754-451e-b45a-98737ddb7e94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fa8fc78f70645b692e8ee9c39cf1084', 'request_id': 'req-7fcc2b6e-1754-451e-b45a-98737ddb7e94'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:39.292209 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7fcc2b6e-1754-451e-b45a-98737ddb7e94 admin admin] The token cache is being invalidate because project 6fa8fc78f70645b692e8ee9c39cf1084 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:02:39.292495 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7fcc2b6e-1754-451e-b45a-98737ddb7e94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:39.293151 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-7fcc2b6e-1754-451e-b45a-98737ddb7e94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:39.294734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1347/2699] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:02:39 2022] DELETE /identity/v3/projects/6fa8fc78f70645b692e8ee9c39cf1084 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:02:39.300085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06b25d-c70a-4521-b355-d47bf935744a None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:39.300486 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06b25d-c70a-4521-b355-d47bf935744a None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:39.300922 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06b25d-c70a-4521-b355-d47bf935744a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:39.319371 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-ed06b25d-c70a-4521-b355-d47bf935744a None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:02:39.320669 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ed06b25d-c70a-4521-b355-d47bf935744a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:39.392372 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1353/2700] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:02:39.395518 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2f3c2-eede-4c73-a2b8-9af6c9a01aef None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:39.396972 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2f3c2-eede-4c73-a2b8-9af6c9a01aef None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:39.397342 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2f3c2-eede-4c73-a2b8-9af6c9a01aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:39.417625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-24f2f3c2-eede-4c73-a2b8-9af6c9a01aef None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:02:39.418862 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-24f2f3c2-eede-4c73-a2b8-9af6c9a01aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:39.428743 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1348/2701] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:02:39.432979 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06b25d-c70a-4521-b355-d47bf935744a None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:39.442603 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06b25d-c70a-4521-b355-d47bf935744a None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:39.447124 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd904f9c-58c7-44bb-9606-4257b0383eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:39.447837 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd904f9c-58c7-44bb-9606-4257b0383eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:39.448121 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd904f9c-58c7-44bb-9606-4257b0383eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:39.448395 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd904f9c-58c7-44bb-9606-4257b0383eb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:39.449115 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd904f9c-58c7-44bb-9606-4257b0383eb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 06:02:39.449416 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd904f9c-58c7-44bb-9606-4257b0383eb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:39.451067 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd904f9c-58c7-44bb-9606-4257b0383eb1 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:39.466579 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1354/2702] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 06:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 06:02:39.468092 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2f3c2-eede-4c73-a2b8-9af6c9a01aef None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:39.477902 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2f3c2-eede-4c73-a2b8-9af6c9a01aef None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:39.482512 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd0089-79ee-49ac-a241-3763073b0d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:39.483316 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd0089-79ee-49ac-a241-3763073b0d21 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:39.483576 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd0089-79ee-49ac-a241-3763073b0d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:39.483858 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd0089-79ee-49ac-a241-3763073b0d21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:39.484622 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecd0089-79ee-49ac-a241-3763073b0d21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:39.486543 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecd0089-79ee-49ac-a241-3763073b0d21 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:39.495752 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:39.519255 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1349/2703] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:02:39 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:02:39.522144 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd904f9c-58c7-44bb-9606-4257b0383eb1 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:39.533519 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd904f9c-58c7-44bb-9606-4257b0383eb1 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:39.607365 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc4383-2627-4957-9628-9f0f9ea14217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:39.608151 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc4383-2627-4957-9628-9f0f9ea14217 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:39.608442 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc4383-2627-4957-9628-9f0f9ea14217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:39.608717 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc4383-2627-4957-9628-9f0f9ea14217 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:39.609420 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc4383-2627-4957-9628-9f0f9ea14217 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:39.611509 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc4383-2627-4957-9628-9f0f9ea14217 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:39.633395 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1355/2704] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:02:39 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:02:39.637611 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd0089-79ee-49ac-a241-3763073b0d21 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:39.648574 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd0089-79ee-49ac-a241-3763073b0d21 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:39.653699 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461ca70-f7d1-4d05-a8fc-ae18f94fb0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:39.654396 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461ca70-f7d1-4d05-a8fc-ae18f94fb0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:39.654685 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461ca70-f7d1-4d05-a8fc-ae18f94fb0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:39.654993 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461ca70-f7d1-4d05-a8fc-ae18f94fb0e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:39.655924 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6461ca70-f7d1-4d05-a8fc-ae18f94fb0e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:39.657567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6461ca70-f7d1-4d05-a8fc-ae18f94fb0e2 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:39.670083 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1350/2705] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:02:39.674160 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc4383-2627-4957-9628-9f0f9ea14217 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:39.686479 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc4383-2627-4957-9628-9f0f9ea14217 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:39.692804 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da987c-46ac-4856-9721-1ab76977ebcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:39.693530 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da987c-46ac-4856-9721-1ab76977ebcb admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:39.693793 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da987c-46ac-4856-9721-1ab76977ebcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:39.694093 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da987c-46ac-4856-9721-1ab76977ebcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:39.694859 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da987c-46ac-4856-9721-1ab76977ebcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:39.696550 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da987c-46ac-4856-9721-1ab76977ebcb admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:39.708411 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1356/2706] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:02:39.713093 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461ca70-f7d1-4d05-a8fc-ae18f94fb0e2 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:39.725762 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461ca70-f7d1-4d05-a8fc-ae18f94fb0e2 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:39.731573 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072310c-4afa-45b0-aeed-436b9847f8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:39.732575 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072310c-4afa-45b0-aeed-436b9847f8b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:39.732859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072310c-4afa-45b0-aeed-436b9847f8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:39.733104 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072310c-4afa-45b0-aeed-436b9847f8b2 admin admin] PATH_INFO: `/v3/projects/a1efc9b5b6794b7b899179daeb3147d3/users/a650c161e62a4ec88fd7b23f7b73de02/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:39.754049 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5072310c-4afa-45b0-aeed-436b9847f8b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1efc9b5b6794b7b899179daeb3147d3, user_id=a650c161e62a4ec88fd7b23f7b73de02, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:39.759507 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5072310c-4afa-45b0-aeed-436b9847f8b2 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:39.778796 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1351/2707] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:02:39 2022] PUT /identity/v3/projects/a1efc9b5b6794b7b899179daeb3147d3/users/a650c161e62a4ec88fd7b23f7b73de02/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:02:39.867754 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764e1bf-6c7a-4358-b6da-ddd5ab8607ff None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:39.868066 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764e1bf-6c7a-4358-b6da-ddd5ab8607ff None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:39.868365 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764e1bf-6c7a-4358-b6da-ddd5ab8607ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:39.900197 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-b764e1bf-6c7a-4358-b6da-ddd5ab8607ff None None] MFA Rules not processed for user `a650c161e62a4ec88fd7b23f7b73de02`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:02:39.901360 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b764e1bf-6c7a-4358-b6da-ddd5ab8607ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:39.953203 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:39.973793 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1357/2708] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:02:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:02:39.979129 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072310c-4afa-45b0-aeed-436b9847f8b2 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:40.042364 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072310c-4afa-45b0-aeed-436b9847f8b2 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:40.047701 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b512d7-b1a8-4ca1-8fa9-7045af62e4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:40.048191 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b512d7-b1a8-4ca1-8fa9-7045af62e4cf admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:40.048475 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b512d7-b1a8-4ca1-8fa9-7045af62e4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:40.048748 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b512d7-b1a8-4ca1-8fa9-7045af62e4cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:40.049434 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b512d7-b1a8-4ca1-8fa9-7045af62e4cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:40.051392 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b512d7-b1a8-4ca1-8fa9-7045af62e4cf admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:40.077999 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1352/2709] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:02:39 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:02:40.082235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764e1bf-6c7a-4358-b6da-ddd5ab8607ff None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:40.093167 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764e1bf-6c7a-4358-b6da-ddd5ab8607ff None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:40.157451 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b4487-c410-4ce1-9278-c99ce97d7acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:40.158086 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b4487-c410-4ce1-9278-c99ce97d7acd admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:40.158365 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b4487-c410-4ce1-9278-c99ce97d7acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:40.158648 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b4487-c410-4ce1-9278-c99ce97d7acd admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:40.159388 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b4487-c410-4ce1-9278-c99ce97d7acd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:40.161501 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b4487-c410-4ce1-9278-c99ce97d7acd admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:40.194541 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1358/2710] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:02:40 2022] POST /identity/v3/users => generated 297 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:02:40.195932 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b512d7-b1a8-4ca1-8fa9-7045af62e4cf admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:40.207116 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b512d7-b1a8-4ca1-8fa9-7045af62e4cf admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:40.213251 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781741e-e42b-49a8-b3ff-b743649bd326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:40.213956 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781741e-e42b-49a8-b3ff-b743649bd326 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:40.214235 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781741e-e42b-49a8-b3ff-b743649bd326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:40.214476 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781741e-e42b-49a8-b3ff-b743649bd326 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:40.215242 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781741e-e42b-49a8-b3ff-b743649bd326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:40.216925 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781741e-e42b-49a8-b3ff-b743649bd326 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:40.229722 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1353/2711] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 06:02:40.234255 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b4487-c410-4ce1-9278-c99ce97d7acd admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:40.244988 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b4487-c410-4ce1-9278-c99ce97d7acd admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:40.250302 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c14ecd-835c-4da7-a243-30f4171cdef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:40.251233 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c14ecd-835c-4da7-a243-30f4171cdef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:40.251519 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c14ecd-835c-4da7-a243-30f4171cdef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:40.251797 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c14ecd-835c-4da7-a243-30f4171cdef4 admin admin] PATH_INFO: `/v3/projects/acb0a4cd88804bc29b78d3f9f0f7ec22/users/7c01b56e69e84e22addeb2709d60999e/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:40.267942 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c14ecd-835c-4da7-a243-30f4171cdef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acb0a4cd88804bc29b78d3f9f0f7ec22, user_id=7c01b56e69e84e22addeb2709d60999e, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:40.270686 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c14ecd-835c-4da7-a243-30f4171cdef4 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:40.285766 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1359/2712] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:02:40 2022] PUT /identity/v3/projects/acb0a4cd88804bc29b78d3f9f0f7ec22/users/7c01b56e69e84e22addeb2709d60999e/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:02:40.289771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781741e-e42b-49a8-b3ff-b743649bd326 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:40.300462 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781741e-e42b-49a8-b3ff-b743649bd326 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:40.359771 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2fcd4-95e0-44e1-ad1f-01e308fbb3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:40.361144 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2fcd4-95e0-44e1-ad1f-01e308fbb3bf admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:40.361429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2fcd4-95e0-44e1-ad1f-01e308fbb3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:40.361700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2fcd4-95e0-44e1-ad1f-01e308fbb3bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:40.362428 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2fcd4-95e0-44e1-ad1f-01e308fbb3bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:40.364109 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2fcd4-95e0-44e1-ad1f-01e308fbb3bf admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:40.377282 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1354/2713] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:02:40.381375 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c14ecd-835c-4da7-a243-30f4171cdef4 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:40.392291 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c14ecd-835c-4da7-a243-30f4171cdef4 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:40.397112 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2d7d2-a48e-4849-9c17-995ae526e303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:40.398018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2d7d2-a48e-4849-9c17-995ae526e303 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:40.398300 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2d7d2-a48e-4849-9c17-995ae526e303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:40.398575 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2d7d2-a48e-4849-9c17-995ae526e303 admin admin] PATH_INFO: `/v3/projects/acb0a4cd88804bc29b78d3f9f0f7ec22/users/7c01b56e69e84e22addeb2709d60999e/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:40.400560 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2d7d2-a48e-4849-9c17-995ae526e303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acb0a4cd88804bc29b78d3f9f0f7ec22, user_id=7c01b56e69e84e22addeb2709d60999e, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:40.403307 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2d7d2-a48e-4849-9c17-995ae526e303 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:40.413830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1360/2714] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:02:40 2022] PUT /identity/v3/projects/acb0a4cd88804bc29b78d3f9f0f7ec22/users/7c01b56e69e84e22addeb2709d60999e/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:02:40.424274 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca433b-01ff-457c-867e-eafb29f16a04 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:40.424530 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca433b-01ff-457c-867e-eafb29f16a04 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:40.424804 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca433b-01ff-457c-867e-eafb29f16a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:40.455247 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d7ca433b-01ff-457c-867e-eafb29f16a04 None None] MFA Rules not processed for user `7c01b56e69e84e22addeb2709d60999e`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:02:40.456543 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d7ca433b-01ff-457c-867e-eafb29f16a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:40.470473 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:40.538144 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1355/2715] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:02:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:02:40.549229 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2d7d2-a48e-4849-9c17-995ae526e303 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:40.550929 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-32d2d7d2-a48e-4849-9c17-995ae526e303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:40.613697 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2d7d2-a48e-4849-9c17-995ae526e303 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:40.617751 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca416994-b16b-4d78-ad3f-df8e965f5ad7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:40.618461 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca416994-b16b-4d78-ad3f-df8e965f5ad7 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:40.618744 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca416994-b16b-4d78-ad3f-df8e965f5ad7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:40.619023 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca416994-b16b-4d78-ad3f-df8e965f5ad7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:40.674321 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:40.676569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca416994-b16b-4d78-ad3f-df8e965f5ad7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:40.678196 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca416994-b16b-4d78-ad3f-df8e965f5ad7 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:40.690469 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1361/2716] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:02:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:02:44.955439 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca433b-01ff-457c-867e-eafb29f16a04 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:44.957686 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d7ca433b-01ff-457c-867e-eafb29f16a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:44.973416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca433b-01ff-457c-867e-eafb29f16a04 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:44.978388 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5f7f6-167a-4cee-9287-5be93b1776ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:44.979053 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5f7f6-167a-4cee-9287-5be93b1776ac service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:44.979393 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5f7f6-167a-4cee-9287-5be93b1776ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:44.979664 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5f7f6-167a-4cee-9287-5be93b1776ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:44.990496 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5f7f6-167a-4cee-9287-5be93b1776ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:44.991959 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5f7f6-167a-4cee-9287-5be93b1776ac service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:45.001852 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1356/2717] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:02:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:02:46.686543 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca416994-b16b-4d78-ad3f-df8e965f5ad7 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:46.688233 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-ca416994-b16b-4d78-ad3f-df8e965f5ad7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:46.771320 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca416994-b16b-4d78-ad3f-df8e965f5ad7 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:46.777010 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc09105-8e8f-4142-b824-c6449ccdd305 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:46.777678 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc09105-8e8f-4142-b824-c6449ccdd305 service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:46.777962 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc09105-8e8f-4142-b824-c6449ccdd305 service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:46.778241 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc09105-8e8f-4142-b824-c6449ccdd305 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:46.780225 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-dfc09105-8e8f-4142-b824-c6449ccdd305 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:46.793692 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc09105-8e8f-4142-b824-c6449ccdd305 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:46.795345 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc09105-8e8f-4142-b824-c6449ccdd305 service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:46.807456 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1362/2718] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:02:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:02:49.916269 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5f7f6-167a-4cee-9287-5be93b1776ac service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:49.981141 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5f7f6-167a-4cee-9287-5be93b1776ac service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:49.986189 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dac43e-3d59-492d-a708-8f7236cbc643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:49.987062 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dac43e-3d59-492d-a708-8f7236cbc643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:49.987372 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dac43e-3d59-492d-a708-8f7236cbc643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:49.987647 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dac43e-3d59-492d-a708-8f7236cbc643 admin admin] PATH_INFO: `/v3/users/a650c161e62a4ec88fd7b23f7b73de02` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:49.988878 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dac43e-3d59-492d-a708-8f7236cbc643 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a650c161e62a4ec88fd7b23f7b73de02)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:49.990802 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dac43e-3d59-492d-a708-8f7236cbc643 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:50.041566 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-10dac43e-3d59-492d-a708-8f7236cbc643 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a650c161e62a4ec88fd7b23f7b73de02'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:50.042222 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-10dac43e-3d59-492d-a708-8f7236cbc643 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a650c161e62a4ec88fd7b23f7b73de02'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:50.050924 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-10dac43e-3d59-492d-a708-8f7236cbc643 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a650c161e62a4ec88fd7b23f7b73de02'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:50.051492 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-10dac43e-3d59-492d-a708-8f7236cbc643 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a650c161e62a4ec88fd7b23f7b73de02'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:50.063824 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-10dac43e-3d59-492d-a708-8f7236cbc643 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a650c161e62a4ec88fd7b23f7b73de02'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:50.076166 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1357/2719] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:02:49 2022] DELETE /identity/v3/users/a650c161e62a4ec88fd7b23f7b73de02 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:02:50.080942 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fc4db-c00b-4282-8ac2-545e848d9799 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:50.081455 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fc4db-c00b-4282-8ac2-545e848d9799 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:50.081455 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fc4db-c00b-4282-8ac2-545e848d9799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:50.100235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-b89fc4db-c00b-4282-8ac2-545e848d9799 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:02:50.101458 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b89fc4db-c00b-4282-8ac2-545e848d9799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:50.163540 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1363/2720] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:02:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 06:02:50.173478 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dac43e-3d59-492d-a708-8f7236cbc643 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:50.175068 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-10dac43e-3d59-492d-a708-8f7236cbc643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:50.194748 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:50.235481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dac43e-3d59-492d-a708-8f7236cbc643 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:50.239221 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408dc5e2-b7c8-4c6d-a9d0-88f19ca96301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:50.239897 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408dc5e2-b7c8-4c6d-a9d0-88f19ca96301 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:50.240185 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408dc5e2-b7c8-4c6d-a9d0-88f19ca96301 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:50.240461 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408dc5e2-b7c8-4c6d-a9d0-88f19ca96301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:50.249647 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408dc5e2-b7c8-4c6d-a9d0-88f19ca96301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:50.251096 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408dc5e2-b7c8-4c6d-a9d0-88f19ca96301 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:50.260557 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1358/2721] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:02:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:02:50.539883 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fc4db-c00b-4282-8ac2-545e848d9799 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:50.541464 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b89fc4db-c00b-4282-8ac2-545e848d9799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:50.559665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fc4db-c00b-4282-8ac2-545e848d9799 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:50.564895 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06725bce-6211-4e20-a2ea-82ef80fb4cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:50.565730 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06725bce-6211-4e20-a2ea-82ef80fb4cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:50.566015 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06725bce-6211-4e20-a2ea-82ef80fb4cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:50.566259 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06725bce-6211-4e20-a2ea-82ef80fb4cd0 admin admin] PATH_INFO: `/v3/projects/a1efc9b5b6794b7b899179daeb3147d3` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:50.567625 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06725bce-6211-4e20-a2ea-82ef80fb4cd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1efc9b5b6794b7b899179daeb3147d3)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:50.569585 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06725bce-6211-4e20-a2ea-82ef80fb4cd0 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:50.623824 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-06725bce-6211-4e20-a2ea-82ef80fb4cd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1efc9b5b6794b7b899179daeb3147d3', 'request_id': 'req-06725bce-6211-4e20-a2ea-82ef80fb4cd0'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:50.630559 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-06725bce-6211-4e20-a2ea-82ef80fb4cd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1efc9b5b6794b7b899179daeb3147d3', 'request_id': 'req-06725bce-6211-4e20-a2ea-82ef80fb4cd0'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:50.639606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-06725bce-6211-4e20-a2ea-82ef80fb4cd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1efc9b5b6794b7b899179daeb3147d3', 'request_id': 'req-06725bce-6211-4e20-a2ea-82ef80fb4cd0'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:50.649665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-06725bce-6211-4e20-a2ea-82ef80fb4cd0 admin admin] The token cache is being invalidate because project a1efc9b5b6794b7b899179daeb3147d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:02:50.649950 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-06725bce-6211-4e20-a2ea-82ef80fb4cd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:50.650574 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-06725bce-6211-4e20-a2ea-82ef80fb4cd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:50.652205 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1364/2722] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:02:50 2022] DELETE /identity/v3/projects/a1efc9b5b6794b7b899179daeb3147d3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:02:50.656571 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408dc5e2-b7c8-4c6d-a9d0-88f19ca96301 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:50.666652 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408dc5e2-b7c8-4c6d-a9d0-88f19ca96301 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:50.728997 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213abef9-f236-438c-af9d-41ebd19a4e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:50.729892 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213abef9-f236-438c-af9d-41ebd19a4e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:50.730169 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213abef9-f236-438c-af9d-41ebd19a4e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:50.730468 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213abef9-f236-438c-af9d-41ebd19a4e72 admin admin] PATH_INFO: `/v3/users/7c01b56e69e84e22addeb2709d60999e` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:50.731783 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213abef9-f236-438c-af9d-41ebd19a4e72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c01b56e69e84e22addeb2709d60999e)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:50.733733 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213abef9-f236-438c-af9d-41ebd19a4e72 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:50.784028 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-213abef9-f236-438c-af9d-41ebd19a4e72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c01b56e69e84e22addeb2709d60999e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:50.784707 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-213abef9-f236-438c-af9d-41ebd19a4e72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c01b56e69e84e22addeb2709d60999e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:50.792991 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-213abef9-f236-438c-af9d-41ebd19a4e72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c01b56e69e84e22addeb2709d60999e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:50.793660 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-213abef9-f236-438c-af9d-41ebd19a4e72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c01b56e69e84e22addeb2709d60999e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:50.805891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-213abef9-f236-438c-af9d-41ebd19a4e72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c01b56e69e84e22addeb2709d60999e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:50.818936 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1359/2723] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:02:50 2022] DELETE /identity/v3/users/7c01b56e69e84e22addeb2709d60999e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:02:51.103006 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06725bce-6211-4e20-a2ea-82ef80fb4cd0 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:51.104734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-06725bce-6211-4e20-a2ea-82ef80fb4cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:51.114695 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:51.123601 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06725bce-6211-4e20-a2ea-82ef80fb4cd0 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:51.184184 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d835c57-c2a4-4b64-8377-56ec50ca1788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:51.185089 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d835c57-c2a4-4b64-8377-56ec50ca1788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:51.185349 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d835c57-c2a4-4b64-8377-56ec50ca1788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:51.185648 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d835c57-c2a4-4b64-8377-56ec50ca1788 admin admin] PATH_INFO: `/v3/projects/acb0a4cd88804bc29b78d3f9f0f7ec22` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:51.186877 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d835c57-c2a4-4b64-8377-56ec50ca1788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acb0a4cd88804bc29b78d3f9f0f7ec22)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:51.188851 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d835c57-c2a4-4b64-8377-56ec50ca1788 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:51.245830 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9d835c57-c2a4-4b64-8377-56ec50ca1788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acb0a4cd88804bc29b78d3f9f0f7ec22', 'request_id': 'req-9d835c57-c2a4-4b64-8377-56ec50ca1788'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:51.252036 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9d835c57-c2a4-4b64-8377-56ec50ca1788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acb0a4cd88804bc29b78d3f9f0f7ec22', 'request_id': 'req-9d835c57-c2a4-4b64-8377-56ec50ca1788'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:51.261748 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9d835c57-c2a4-4b64-8377-56ec50ca1788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acb0a4cd88804bc29b78d3f9f0f7ec22', 'request_id': 'req-9d835c57-c2a4-4b64-8377-56ec50ca1788'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:51.273035 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9d835c57-c2a4-4b64-8377-56ec50ca1788 admin admin] The token cache is being invalidate because project acb0a4cd88804bc29b78d3f9f0f7ec22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:02:51.273320 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9d835c57-c2a4-4b64-8377-56ec50ca1788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:51.274018 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9d835c57-c2a4-4b64-8377-56ec50ca1788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:02:51.275750 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1365/2724] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:02:51 2022] DELETE /identity/v3/projects/acb0a4cd88804bc29b78d3f9f0f7ec22 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:02:51.282117 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c60f6-8972-4ab1-a396-b098f1fd35b6 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:51.282653 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c60f6-8972-4ab1-a396-b098f1fd35b6 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:51.282653 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c60f6-8972-4ab1-a396-b098f1fd35b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:51.302312 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-0f7c60f6-8972-4ab1-a396-b098f1fd35b6 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:02:51.303541 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-0f7c60f6-8972-4ab1-a396-b098f1fd35b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:51.336555 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:51.367576 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1360/2725] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:02:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:02:51.379549 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038c394-1ce5-4804-8762-ea07ea49101d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:51.379875 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038c394-1ce5-4804-8762-ea07ea49101d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:51.380154 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038c394-1ce5-4804-8762-ea07ea49101d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:51.400890 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-4038c394-1ce5-4804-8762-ea07ea49101d None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:02:51.402061 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4038c394-1ce5-4804-8762-ea07ea49101d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:51.410933 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1366/2726] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:02:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:02:51.415428 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c60f6-8972-4ab1-a396-b098f1fd35b6 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:51.426096 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c60f6-8972-4ab1-a396-b098f1fd35b6 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:51.432032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafd4ed-5d6e-4b15-80f8-7e1b6e05084f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:51.432718 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafd4ed-5d6e-4b15-80f8-7e1b6e05084f admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:51.433004 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafd4ed-5d6e-4b15-80f8-7e1b6e05084f admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:51.433281 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafd4ed-5d6e-4b15-80f8-7e1b6e05084f admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:51.434016 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aafd4ed-5d6e-4b15-80f8-7e1b6e05084f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 06:02:51.434322 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aafd4ed-5d6e-4b15-80f8-7e1b6e05084f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:51.435980 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aafd4ed-5d6e-4b15-80f8-7e1b6e05084f admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:51.448525 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1361/2727] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 06:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 06:02:51.453101 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038c394-1ce5-4804-8762-ea07ea49101d None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:51.462601 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038c394-1ce5-4804-8762-ea07ea49101d None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:51.467988 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fc6bc-82ba-499c-8698-7ef2ed3868f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:51.468654 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fc6bc-82ba-499c-8698-7ef2ed3868f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:51.468936 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fc6bc-82ba-499c-8698-7ef2ed3868f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:51.469209 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fc6bc-82ba-499c-8698-7ef2ed3868f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:51.469908 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5fc6bc-82ba-499c-8698-7ef2ed3868f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:51.471926 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5fc6bc-82ba-499c-8698-7ef2ed3868f1 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:51.499953 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1367/2728] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:02:51 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 06:02:51.506757 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafd4ed-5d6e-4b15-80f8-7e1b6e05084f admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:51.520473 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafd4ed-5d6e-4b15-80f8-7e1b6e05084f admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:51.581790 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a6b18-737b-4dbb-8604-120e89866770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:51.582445 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a6b18-737b-4dbb-8604-120e89866770 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:51.582859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a6b18-737b-4dbb-8604-120e89866770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:51.583000 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a6b18-737b-4dbb-8604-120e89866770 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:51.583822 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a6b18-737b-4dbb-8604-120e89866770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:51.585766 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a6b18-737b-4dbb-8604-120e89866770 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:51.608658 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1362/2729] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:02:51 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:02:51.612691 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fc6bc-82ba-499c-8698-7ef2ed3868f1 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:51.623485 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fc6bc-82ba-499c-8698-7ef2ed3868f1 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:51.628895 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181bcf2-790a-4b98-90d3-c87da6b43718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:51.629552 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181bcf2-790a-4b98-90d3-c87da6b43718 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:51.629828 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181bcf2-790a-4b98-90d3-c87da6b43718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:51.630096 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181bcf2-790a-4b98-90d3-c87da6b43718 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:51.630809 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181bcf2-790a-4b98-90d3-c87da6b43718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:51.632555 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181bcf2-790a-4b98-90d3-c87da6b43718 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:51.643639 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1368/2730] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:02:51.647532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a6b18-737b-4dbb-8604-120e89866770 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:51.657644 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a6b18-737b-4dbb-8604-120e89866770 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:51.662611 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae6274-bae6-47f8-a0c7-7a0eec561234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:51.663294 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae6274-bae6-47f8-a0c7-7a0eec561234 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:51.663585 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae6274-bae6-47f8-a0c7-7a0eec561234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:51.663857 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae6274-bae6-47f8-a0c7-7a0eec561234 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:51.664573 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae6274-bae6-47f8-a0c7-7a0eec561234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:51.666161 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae6274-bae6-47f8-a0c7-7a0eec561234 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:51.676214 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1363/2731] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 06:02:51.680263 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181bcf2-790a-4b98-90d3-c87da6b43718 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:51.691010 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181bcf2-790a-4b98-90d3-c87da6b43718 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:51.696894 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd103c-2c46-42e9-88a7-4086a87cdb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:51.697768 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd103c-2c46-42e9-88a7-4086a87cdb73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:51.698045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd103c-2c46-42e9-88a7-4086a87cdb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:51.698317 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd103c-2c46-42e9-88a7-4086a87cdb73 admin admin] PATH_INFO: `/v3/projects/3eed9408291446acad3552212a685b49/users/945c56e8dd4d4ae7a668be2a10429dba/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:51.712768 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd103c-2c46-42e9-88a7-4086a87cdb73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eed9408291446acad3552212a685b49, user_id=945c56e8dd4d4ae7a668be2a10429dba, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:51.715451 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd103c-2c46-42e9-88a7-4086a87cdb73 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:51.729710 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1369/2732] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:02:51 2022] PUT /identity/v3/projects/3eed9408291446acad3552212a685b49/users/945c56e8dd4d4ae7a668be2a10429dba/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:02:51.741286 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc7270-7aff-4d60-8e34-fb3b81797ee0 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:51.741562 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc7270-7aff-4d60-8e34-fb3b81797ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:51.741832 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc7270-7aff-4d60-8e34-fb3b81797ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:51.769137 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-d8dc7270-7aff-4d60-8e34-fb3b81797ee0 None None] MFA Rules not processed for user `945c56e8dd4d4ae7a668be2a10429dba`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:02:51.770351 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d8dc7270-7aff-4d60-8e34-fb3b81797ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:51.836792 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1364/2733] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:02:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:02:51.848174 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd103c-2c46-42e9-88a7-4086a87cdb73 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:02:51.850251 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e6cd103c-2c46-42e9-88a7-4086a87cdb73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:02:51.885916 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:02:51.932376 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd103c-2c46-42e9-88a7-4086a87cdb73 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:02:51.936174 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d5e0c-392d-49be-b63b-e43a5cc9311e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77f0477631724d7f9c8ba752ba27866d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:02:51.936860 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d5e0c-392d-49be-b63b-e43a5cc9311e service glance] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:02:51.937143 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d5e0c-392d-49be-b63b-e43a5cc9311e service glance] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:02:51.937417 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d5e0c-392d-49be-b63b-e43a5cc9311e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:02:51.946006 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d5e0c-392d-49be-b63b-e43a5cc9311e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:02:51.947484 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d5e0c-392d-49be-b63b-e43a5cc9311e service glance] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:02:51.956915 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1370/2734] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:02:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:03:01.834009 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=82,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:03:01.952681 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=21 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:03:05.374265 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc7270-7aff-4d60-8e34-fb3b81797ee0 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:03:05.442032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc7270-7aff-4d60-8e34-fb3b81797ee0 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:03:05.447916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78517bef-d6a8-4fbf-bec9-2cd68bc40629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:03:05.448814 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78517bef-d6a8-4fbf-bec9-2cd68bc40629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:03:05.449098 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78517bef-d6a8-4fbf-bec9-2cd68bc40629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:03:05.449372 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78517bef-d6a8-4fbf-bec9-2cd68bc40629 admin admin] PATH_INFO: `/v3/users/945c56e8dd4d4ae7a668be2a10429dba` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:03:05.450681 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78517bef-d6a8-4fbf-bec9-2cd68bc40629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=945c56e8dd4d4ae7a668be2a10429dba)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:03:05.452853 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78517bef-d6a8-4fbf-bec9-2cd68bc40629 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:03:05.506376 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-78517bef-d6a8-4fbf-bec9-2cd68bc40629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '945c56e8dd4d4ae7a668be2a10429dba'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:03:05.507072 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-78517bef-d6a8-4fbf-bec9-2cd68bc40629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '945c56e8dd4d4ae7a668be2a10429dba'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:03:05.515866 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-78517bef-d6a8-4fbf-bec9-2cd68bc40629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '945c56e8dd4d4ae7a668be2a10429dba'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:03:05.516572 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-78517bef-d6a8-4fbf-bec9-2cd68bc40629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '945c56e8dd4d4ae7a668be2a10429dba'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:03:05.529078 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-78517bef-d6a8-4fbf-bec9-2cd68bc40629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '945c56e8dd4d4ae7a668be2a10429dba'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:03:05.541672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1365/2735] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:03:05 2022] DELETE /identity/v3/users/945c56e8dd4d4ae7a668be2a10429dba => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:03:05.546322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae424b-3a86-47d3-816b-b5649c02fb03 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:03:05.546766 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae424b-3a86-47d3-816b-b5649c02fb03 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:03:05.546867 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae424b-3a86-47d3-816b-b5649c02fb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:03:05.564672 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-36ae424b-3a86-47d3-816b-b5649c02fb03 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:03:05.565859 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-36ae424b-3a86-47d3-816b-b5649c02fb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:03:05.627051 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1371/2736] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:03:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:03:05.638536 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78517bef-d6a8-4fbf-bec9-2cd68bc40629 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:03:05.640326 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-78517bef-d6a8-4fbf-bec9-2cd68bc40629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:03:05.702780 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78517bef-d6a8-4fbf-bec9-2cd68bc40629 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:03:05.709044 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957bc60-6d88-457c-9f52-5e2fe0276e04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:03:05.709700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957bc60-6d88-457c-9f52-5e2fe0276e04 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:03:05.709977 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957bc60-6d88-457c-9f52-5e2fe0276e04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:03:05.710247 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957bc60-6d88-457c-9f52-5e2fe0276e04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:03:05.720785 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957bc60-6d88-457c-9f52-5e2fe0276e04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:03:05.722248 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957bc60-6d88-457c-9f52-5e2fe0276e04 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:03:05.732663 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1366/2737] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:03:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:03:06.010390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae424b-3a86-47d3-816b-b5649c02fb03 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:03:06.011954 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-36ae424b-3a86-47d3-816b-b5649c02fb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:03:06.026006 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae424b-3a86-47d3-816b-b5649c02fb03 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:03:06.031797 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e25ce-ba45-4346-9e83-8a122f962939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:03:06.032679 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e25ce-ba45-4346-9e83-8a122f962939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:03:06.032967 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e25ce-ba45-4346-9e83-8a122f962939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:03:06.033332 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e25ce-ba45-4346-9e83-8a122f962939 admin admin] PATH_INFO: `/v3/projects/3eed9408291446acad3552212a685b49` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:03:06.034508 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e25ce-ba45-4346-9e83-8a122f962939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eed9408291446acad3552212a685b49)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:03:06.036811 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e25ce-ba45-4346-9e83-8a122f962939 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:03:06.086366 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-860e25ce-ba45-4346-9e83-8a122f962939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eed9408291446acad3552212a685b49', 'request_id': 'req-860e25ce-ba45-4346-9e83-8a122f962939'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:03:06.092893 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-860e25ce-ba45-4346-9e83-8a122f962939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eed9408291446acad3552212a685b49', 'request_id': 'req-860e25ce-ba45-4346-9e83-8a122f962939'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:03:06.102182 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-860e25ce-ba45-4346-9e83-8a122f962939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eed9408291446acad3552212a685b49', 'request_id': 'req-860e25ce-ba45-4346-9e83-8a122f962939'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:03:06.114666 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-860e25ce-ba45-4346-9e83-8a122f962939 admin admin] The token cache is being invalidate because project 3eed9408291446acad3552212a685b49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:03:06.114964 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-860e25ce-ba45-4346-9e83-8a122f962939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:03:06.115674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-860e25ce-ba45-4346-9e83-8a122f962939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:03:06.117546 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1372/2738] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:03:06 2022] DELETE /identity/v3/projects/3eed9408291446acad3552212a685b49 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:03:06.122434 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bce3fa-eb16-4982-879f-f677941a9ed4 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:03:06.122806 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bce3fa-eb16-4982-879f-f677941a9ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:03:06.123123 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bce3fa-eb16-4982-879f-f677941a9ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:03:06.142387 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-99bce3fa-eb16-4982-879f-f677941a9ed4 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:03:06.143559 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-99bce3fa-eb16-4982-879f-f677941a9ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:03:06.162165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:03:06.207695 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1367/2739] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:03:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:03:06.215896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54805be-f57a-4259-90b6-645fd54eecd1 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:03:06.216183 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54805be-f57a-4259-90b6-645fd54eecd1 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:03:06.216466 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54805be-f57a-4259-90b6-645fd54eecd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:03:06.235826 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-c54805be-f57a-4259-90b6-645fd54eecd1 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:03:06.237019 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c54805be-f57a-4259-90b6-645fd54eecd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:03:06.245191 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1373/2740] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:03:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:03:06.249650 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bce3fa-eb16-4982-879f-f677941a9ed4 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:03:06.259481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bce3fa-eb16-4982-879f-f677941a9ed4 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:03:06.264292 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518bdeff-cc34-46ce-b88c-e7b804a4e13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:03:06.264949 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bdeff-cc34-46ce-b88c-e7b804a4e13a admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:03:06.265233 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bdeff-cc34-46ce-b88c-e7b804a4e13a admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:03:06.265510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bdeff-cc34-46ce-b88c-e7b804a4e13a admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:03:06.266243 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518bdeff-cc34-46ce-b88c-e7b804a4e13a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 06:03:06.266544 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518bdeff-cc34-46ce-b88c-e7b804a4e13a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:03:06.268187 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518bdeff-cc34-46ce-b88c-e7b804a4e13a admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:03:06.280073 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1368/2741] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 06:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 06:03:06.284754 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54805be-f57a-4259-90b6-645fd54eecd1 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:03:06.295651 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54805be-f57a-4259-90b6-645fd54eecd1 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:03:06.301110 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7b303-6f86-4a18-a3d7-03328bbd8d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:03:06.301809 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7b303-6f86-4a18-a3d7-03328bbd8d66 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:03:06.302089 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7b303-6f86-4a18-a3d7-03328bbd8d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:03:06.302392 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7b303-6f86-4a18-a3d7-03328bbd8d66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:03:06.303083 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c7b303-6f86-4a18-a3d7-03328bbd8d66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:03:06.305198 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c7b303-6f86-4a18-a3d7-03328bbd8d66 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:03:06.338978 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1374/2742] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:03:06 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 06:03:06.340292 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518bdeff-cc34-46ce-b88c-e7b804a4e13a admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:03:06.350560 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518bdeff-cc34-46ce-b88c-e7b804a4e13a admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:03:06.411677 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d361339-0789-412a-8f7a-28ca81509d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:03:06.412388 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d361339-0789-412a-8f7a-28ca81509d52 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:03:06.412650 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d361339-0789-412a-8f7a-28ca81509d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:03:06.412893 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d361339-0789-412a-8f7a-28ca81509d52 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:03:06.413571 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d361339-0789-412a-8f7a-28ca81509d52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:03:06.415615 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d361339-0789-412a-8f7a-28ca81509d52 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:03:06.436659 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1369/2743] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:03:06 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:03:06.440883 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7b303-6f86-4a18-a3d7-03328bbd8d66 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:03:06.451676 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7b303-6f86-4a18-a3d7-03328bbd8d66 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:03:06.456609 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa3c7a-e1ec-4d87-824c-f17ce0f88b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:03:06.457274 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa3c7a-e1ec-4d87-824c-f17ce0f88b55 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:03:06.457551 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa3c7a-e1ec-4d87-824c-f17ce0f88b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:03:06.457817 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa3c7a-e1ec-4d87-824c-f17ce0f88b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:03:06.458626 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa3c7a-e1ec-4d87-824c-f17ce0f88b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:03:06.460276 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa3c7a-e1ec-4d87-824c-f17ce0f88b55 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:03:06.471003 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1375/2744] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:03:06.474887 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d361339-0789-412a-8f7a-28ca81509d52 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:03:06.485561 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d361339-0789-412a-8f7a-28ca81509d52 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:03:06.491762 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c269f-04cd-4e67-851d-c96245bcfbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:03:06.492433 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c269f-04cd-4e67-851d-c96245bcfbbe admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:03:06.492715 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c269f-04cd-4e67-851d-c96245bcfbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:03:06.493016 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c269f-04cd-4e67-851d-c96245bcfbbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:03:06.493780 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c269f-04cd-4e67-851d-c96245bcfbbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:03:06.495430 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c269f-04cd-4e67-851d-c96245bcfbbe admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:03:06.506436 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1370/2745] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:03:06.510722 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa3c7a-e1ec-4d87-824c-f17ce0f88b55 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:03:06.521043 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa3c7a-e1ec-4d87-824c-f17ce0f88b55 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:03:06.526136 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d92b05-8a38-4341-88db-cd9e5524a686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:03:06.527038 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d92b05-8a38-4341-88db-cd9e5524a686 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:03:06.527350 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d92b05-8a38-4341-88db-cd9e5524a686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:03:06.527623 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d92b05-8a38-4341-88db-cd9e5524a686 admin admin] PATH_INFO: `/v3/projects/05e9b289bc3f418594256beab15dec27/users/9985446fe9f84dfe892ba3763cea7b3b/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:03:06.543274 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d92b05-8a38-4341-88db-cd9e5524a686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05e9b289bc3f418594256beab15dec27, user_id=9985446fe9f84dfe892ba3763cea7b3b, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:03:06.545948 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d92b05-8a38-4341-88db-cd9e5524a686 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:03:06.559781 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1376/2746] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:03:06 2022] PUT /identity/v3/projects/05e9b289bc3f418594256beab15dec27/users/9985446fe9f84dfe892ba3763cea7b3b/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:03:06.571790 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155702f-582b-48c6-8fd0-c3d96cb29e75 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:03:06.572086 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155702f-582b-48c6-8fd0-c3d96cb29e75 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:03:06.572364 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155702f-582b-48c6-8fd0-c3d96cb29e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:03:06.600351 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-6155702f-582b-48c6-8fd0-c3d96cb29e75 None None] MFA Rules not processed for user `9985446fe9f84dfe892ba3763cea7b3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:03:06.602306 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-6155702f-582b-48c6-8fd0-c3d96cb29e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:03:06.674290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1371/2747] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:03:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:03:06.685164 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d92b05-8a38-4341-88db-cd9e5524a686 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:03:06.687130 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-c0d92b05-8a38-4341-88db-cd9e5524a686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:03:06.708931 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:03:06.745602 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d92b05-8a38-4341-88db-cd9e5524a686 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:03:06.749335 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6e887-1019-489e-ab0c-7e9829fd4ebe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:03:06.750010 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6e887-1019-489e-ab0c-7e9829fd4ebe service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:03:06.750286 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6e887-1019-489e-ab0c-7e9829fd4ebe service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:03:06.750555 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6e887-1019-489e-ab0c-7e9829fd4ebe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:03:06.760564 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6e887-1019-489e-ab0c-7e9829fd4ebe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:03:06.762691 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6e887-1019-489e-ab0c-7e9829fd4ebe service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:03:06.772674 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1377/2748] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:03:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:03:16.671445 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:03:16.711369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155702f-582b-48c6-8fd0-c3d96cb29e75 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:03:16.769106 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=17 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:03:16.795939 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155702f-582b-48c6-8fd0-c3d96cb29e75 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:03:16.800534 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db8933-dc41-40a0-b9fd-ec2aa74c7f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:03:16.801425 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db8933-dc41-40a0-b9fd-ec2aa74c7f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:03:16.801704 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db8933-dc41-40a0-b9fd-ec2aa74c7f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:03:16.801977 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db8933-dc41-40a0-b9fd-ec2aa74c7f7a admin admin] PATH_INFO: `/v3/users/9985446fe9f84dfe892ba3763cea7b3b` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:03:16.803194 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db8933-dc41-40a0-b9fd-ec2aa74c7f7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9985446fe9f84dfe892ba3763cea7b3b)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:03:16.805169 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db8933-dc41-40a0-b9fd-ec2aa74c7f7a admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:03:16.871649 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f2db8933-dc41-40a0-b9fd-ec2aa74c7f7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9985446fe9f84dfe892ba3763cea7b3b'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:03:16.872605 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f2db8933-dc41-40a0-b9fd-ec2aa74c7f7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9985446fe9f84dfe892ba3763cea7b3b'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:03:16.882520 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f2db8933-dc41-40a0-b9fd-ec2aa74c7f7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9985446fe9f84dfe892ba3763cea7b3b'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:03:16.883135 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f2db8933-dc41-40a0-b9fd-ec2aa74c7f7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9985446fe9f84dfe892ba3763cea7b3b'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:03:16.896206 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-f2db8933-dc41-40a0-b9fd-ec2aa74c7f7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9985446fe9f84dfe892ba3763cea7b3b'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:03:16.908660 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1372/2749] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:03:16 2022] DELETE /identity/v3/users/9985446fe9f84dfe892ba3763cea7b3b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:03:16.913233 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df3d6f-e0ba-4f28-a316-c84b47947058 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:03:16.913516 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df3d6f-e0ba-4f28-a316-c84b47947058 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:03:16.913791 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df3d6f-e0ba-4f28-a316-c84b47947058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:03:16.931680 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-f5df3d6f-e0ba-4f28-a316-c84b47947058 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:03:16.933007 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f5df3d6f-e0ba-4f28-a316-c84b47947058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:03:16.992577 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1378/2750] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:03:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:03:17.004916 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db8933-dc41-40a0-b9fd-ec2aa74c7f7a admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:03:17.006399 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-f2db8933-dc41-40a0-b9fd-ec2aa74c7f7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:03:17.065022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db8933-dc41-40a0-b9fd-ec2aa74c7f7a admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:03:17.069895 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdeb7b-9693-4340-9bb2-e6aefc70b64c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:03:17.070601 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdeb7b-9693-4340-9bb2-e6aefc70b64c service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:03:17.070994 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdeb7b-9693-4340-9bb2-e6aefc70b64c service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:03:17.071310 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdeb7b-9693-4340-9bb2-e6aefc70b64c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:03:17.081692 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacdeb7b-9693-4340-9bb2-e6aefc70b64c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:03:17.083207 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacdeb7b-9693-4340-9bb2-e6aefc70b64c service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:03:17.093082 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1373/2751] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:03:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:03:17.366051 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df3d6f-e0ba-4f28-a316-c84b47947058 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:03:17.367660 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f5df3d6f-e0ba-4f28-a316-c84b47947058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:03:17.379879 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df3d6f-e0ba-4f28-a316-c84b47947058 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:03:17.385345 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2776f-b79c-425a-b86a-4f2091d47497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:03:17.386426 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2776f-b79c-425a-b86a-4f2091d47497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:03:17.386716 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2776f-b79c-425a-b86a-4f2091d47497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:03:17.386996 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2776f-b79c-425a-b86a-4f2091d47497 admin admin] PATH_INFO: `/v3/projects/05e9b289bc3f418594256beab15dec27` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:03:17.388238 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2776f-b79c-425a-b86a-4f2091d47497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05e9b289bc3f418594256beab15dec27)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:03:17.390286 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2776f-b79c-425a-b86a-4f2091d47497 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:03:17.443816 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-12c2776f-b79c-425a-b86a-4f2091d47497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05e9b289bc3f418594256beab15dec27', 'request_id': 'req-12c2776f-b79c-425a-b86a-4f2091d47497'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:03:17.451039 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-12c2776f-b79c-425a-b86a-4f2091d47497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05e9b289bc3f418594256beab15dec27', 'request_id': 'req-12c2776f-b79c-425a-b86a-4f2091d47497'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:03:17.459131 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-12c2776f-b79c-425a-b86a-4f2091d47497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05e9b289bc3f418594256beab15dec27', 'request_id': 'req-12c2776f-b79c-425a-b86a-4f2091d47497'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:03:17.469677 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-12c2776f-b79c-425a-b86a-4f2091d47497 admin admin] The token cache is being invalidate because project 05e9b289bc3f418594256beab15dec27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:03:17.469965 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-12c2776f-b79c-425a-b86a-4f2091d47497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:03:17.470606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-12c2776f-b79c-425a-b86a-4f2091d47497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:03:17.472223 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1379/2752] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:03:17 2022] DELETE /identity/v3/projects/05e9b289bc3f418594256beab15dec27 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:03:26.858577 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5ed44-f5df-48d0-93fd-faedd3bf71d7 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:03:26.859138 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5ed44-f5df-48d0-93fd-faedd3bf71d7 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:03:26.859138 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5ed44-f5df-48d0-93fd-faedd3bf71d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:03:26.877460 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-4ba5ed44-f5df-48d0-93fd-faedd3bf71d7 None None] MFA Rules not processed for user `b22f0b92554e41aea3dc4624a4334032`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:03:26.878662 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-4ba5ed44-f5df-48d0-93fd-faedd3bf71d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:03:26.895294 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:03:26.937330 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1374/2753] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:03:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:03:27.466682 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:03:36.930063 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=15 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:04:07.321608 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2776f-b79c-425a-b86a-4f2091d47497 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:04:07.324002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-12c2776f-b79c-425a-b86a-4f2091d47497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:04:07.401045 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2776f-b79c-425a-b86a-4f2091d47497 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:04:07.406419 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271149db-d3b2-41c5-b243-f7e5a5e8f1e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260f58535f4e46a197d00276d37fd515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:04:07.407065 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271149db-d3b2-41c5-b243-f7e5a5e8f1e6 service placement] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:04:07.407377 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271149db-d3b2-41c5-b243-f7e5a5e8f1e6 service placement] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:04:07.407640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271149db-d3b2-41c5-b243-f7e5a5e8f1e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:04:07.409554 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-271149db-d3b2-41c5-b243-f7e5a5e8f1e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:04:07.421496 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271149db-d3b2-41c5-b243-f7e5a5e8f1e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:04:07.423091 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271149db-d3b2-41c5-b243-f7e5a5e8f1e6 service placement] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:04:07.437685 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1380/2754] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:04:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:04:17.428831 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=32 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:04:27.499759 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1132bb-6174-47ba-af37-607ac4cb3873 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:04:27.500363 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1132bb-6174-47ba-af37-607ac4cb3873 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:04:27.500363 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1132bb-6174-47ba-af37-607ac4cb3873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:04:27.518645 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-4d1132bb-6174-47ba-af37-607ac4cb3873 None None] MFA Rules not processed for user `b22f0b92554e41aea3dc4624a4334032`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:04:27.520008 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-4d1132bb-6174-47ba-af37-607ac4cb3873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:04:27.527741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1375/2755] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:04:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:04:37.513447 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:04:50.133565 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271149db-d3b2-41c5-b243-f7e5a5e8f1e6 service placement] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:04:50.135097 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-271149db-d3b2-41c5-b243-f7e5a5e8f1e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:04:50.203570 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271149db-d3b2-41c5-b243-f7e5a5e8f1e6 service placement] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:04:50.208019 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebcb09-4401-4ff7-ae4f-ff0fe2c0f204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:04:50.208889 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebcb09-4401-4ff7-ae4f-ff0fe2c0f204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:04:50.209167 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebcb09-4401-4ff7-ae4f-ff0fe2c0f204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:04:50.209437 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebcb09-4401-4ff7-ae4f-ff0fe2c0f204 admin admin] PATH_INFO: `/v3/users/48f8e070f93240119ac3ba6f20edf1e6` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:04:50.210592 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ebcb09-4401-4ff7-ae4f-ff0fe2c0f204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48f8e070f93240119ac3ba6f20edf1e6)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:04:50.212533 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ebcb09-4401-4ff7-ae4f-ff0fe2c0f204 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:04:50.258536 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a4ebcb09-4401-4ff7-ae4f-ff0fe2c0f204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48f8e070f93240119ac3ba6f20edf1e6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:04:50.265233 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a4ebcb09-4401-4ff7-ae4f-ff0fe2c0f204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48f8e070f93240119ac3ba6f20edf1e6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:04:50.273408 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a4ebcb09-4401-4ff7-ae4f-ff0fe2c0f204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48f8e070f93240119ac3ba6f20edf1e6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:04:50.273986 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a4ebcb09-4401-4ff7-ae4f-ff0fe2c0f204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48f8e070f93240119ac3ba6f20edf1e6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:04:50.285957 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a4ebcb09-4401-4ff7-ae4f-ff0fe2c0f204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48f8e070f93240119ac3ba6f20edf1e6'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:04:50.292785 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1381/2756] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:04:50 2022] DELETE /identity/v3/users/48f8e070f93240119ac3ba6f20edf1e6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:04:50.467873 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1132bb-6174-47ba-af37-607ac4cb3873 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:04:50.479761 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1132bb-6174-47ba-af37-607ac4cb3873 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:04:50.538811 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c0e6f-2e96-498e-9169-fe09f16aa32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:04:50.539846 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c0e6f-2e96-498e-9169-fe09f16aa32f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:04:50.540039 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c0e6f-2e96-498e-9169-fe09f16aa32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:04:50.540301 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c0e6f-2e96-498e-9169-fe09f16aa32f admin admin] PATH_INFO: `/v3/projects/8c6f85dcc05643bd875994a6635a2aeb` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:04:50.542022 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c0e6f-2e96-498e-9169-fe09f16aa32f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c6f85dcc05643bd875994a6635a2aeb)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:04:50.544969 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c0e6f-2e96-498e-9169-fe09f16aa32f admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:04:50.594341 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e44c0e6f-2e96-498e-9169-fe09f16aa32f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c6f85dcc05643bd875994a6635a2aeb', 'request_id': 'req-e44c0e6f-2e96-498e-9169-fe09f16aa32f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:04:50.603817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e44c0e6f-2e96-498e-9169-fe09f16aa32f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c6f85dcc05643bd875994a6635a2aeb', 'request_id': 'req-e44c0e6f-2e96-498e-9169-fe09f16aa32f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:04:50.610833 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e44c0e6f-2e96-498e-9169-fe09f16aa32f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c6f85dcc05643bd875994a6635a2aeb', 'request_id': 'req-e44c0e6f-2e96-498e-9169-fe09f16aa32f'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:04:50.622004 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e44c0e6f-2e96-498e-9169-fe09f16aa32f admin admin] The token cache is being invalidate because project 8c6f85dcc05643bd875994a6635a2aeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:04:50.622293 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e44c0e6f-2e96-498e-9169-fe09f16aa32f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:04:50.622981 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-e44c0e6f-2e96-498e-9169-fe09f16aa32f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:04:50.624640 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1376/2757] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:04:50 2022] DELETE /identity/v3/projects/8c6f85dcc05643bd875994a6635a2aeb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:04:50.628895 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebcb09-4401-4ff7-ae4f-ff0fe2c0f204 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:04:50.630338 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a4ebcb09-4401-4ff7-ae4f-ff0fe2c0f204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:04:50.644102 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebcb09-4401-4ff7-ae4f-ff0fe2c0f204 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:04:50.704160 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe3669-884a-4851-a1ec-0fd7b5f5fa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:04:50.705034 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe3669-884a-4851-a1ec-0fd7b5f5fa96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:04:50.705287 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe3669-884a-4851-a1ec-0fd7b5f5fa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:04:50.705593 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe3669-884a-4851-a1ec-0fd7b5f5fa96 admin admin] PATH_INFO: `/v3/users/9dd821111a5d4759b37153a1d53c77d4` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:04:50.707464 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe3669-884a-4851-a1ec-0fd7b5f5fa96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dd821111a5d4759b37153a1d53c77d4)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:04:50.709401 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe3669-884a-4851-a1ec-0fd7b5f5fa96 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:04:50.733416 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:04:50.762606 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8efe3669-884a-4851-a1ec-0fd7b5f5fa96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dd821111a5d4759b37153a1d53c77d4'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:04:50.769344 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8efe3669-884a-4851-a1ec-0fd7b5f5fa96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dd821111a5d4759b37153a1d53c77d4'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:04:50.777029 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8efe3669-884a-4851-a1ec-0fd7b5f5fa96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dd821111a5d4759b37153a1d53c77d4'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:04:50.777631 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8efe3669-884a-4851-a1ec-0fd7b5f5fa96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dd821111a5d4759b37153a1d53c77d4'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:04:50.789078 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-8efe3669-884a-4851-a1ec-0fd7b5f5fa96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dd821111a5d4759b37153a1d53c77d4'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:04:50.795199 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1382/2758] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:04:50 2022] DELETE /identity/v3/users/9dd821111a5d4759b37153a1d53c77d4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 06:04:50.983702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c0e6f-2e96-498e-9169-fe09f16aa32f admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:04:50.985184 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-e44c0e6f-2e96-498e-9169-fe09f16aa32f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:04:50.998431 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c0e6f-2e96-498e-9169-fe09f16aa32f admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:04:51.057513 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e961533-ee5f-4c64-9725-487496b92c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:04:51.058412 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e961533-ee5f-4c64-9725-487496b92c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:04:51.058695 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e961533-ee5f-4c64-9725-487496b92c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:04:51.058973 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e961533-ee5f-4c64-9725-487496b92c37 admin admin] PATH_INFO: `/v3/projects/0873793ef3ab483f860468b6d0103693` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:04:51.060222 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e961533-ee5f-4c64-9725-487496b92c37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0873793ef3ab483f860468b6d0103693)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:04:51.062136 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e961533-ee5f-4c64-9725-487496b92c37 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:04:51.097697 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:04:51.111667 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0e961533-ee5f-4c64-9725-487496b92c37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0873793ef3ab483f860468b6d0103693', 'request_id': 'req-0e961533-ee5f-4c64-9725-487496b92c37'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:04:51.121479 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0e961533-ee5f-4c64-9725-487496b92c37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0873793ef3ab483f860468b6d0103693', 'request_id': 'req-0e961533-ee5f-4c64-9725-487496b92c37'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:04:51.128583 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0e961533-ee5f-4c64-9725-487496b92c37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0873793ef3ab483f860468b6d0103693', 'request_id': 'req-0e961533-ee5f-4c64-9725-487496b92c37'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:04:51.140686 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0e961533-ee5f-4c64-9725-487496b92c37 admin admin] The token cache is being invalidate because project 0873793ef3ab483f860468b6d0103693 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:04:51.141014 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0e961533-ee5f-4c64-9725-487496b92c37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:04:51.141751 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0e961533-ee5f-4c64-9725-487496b92c37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:04:51.143558 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1377/2759] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:04:50 2022] DELETE /identity/v3/projects/0873793ef3ab483f860468b6d0103693 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:05:00.791732 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:05:01.137322 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:05:23.954361 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86af47-c9a4-4364-b8bd-2d00d5207e03 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:05:23.954906 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86af47-c9a4-4364-b8bd-2d00d5207e03 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:05:23.955080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86af47-c9a4-4364-b8bd-2d00d5207e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:05:23.972640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-eb86af47-c9a4-4364-b8bd-2d00d5207e03 None None] MFA Rules not processed for user `b22f0b92554e41aea3dc4624a4334032`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:05:23.974249 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-eb86af47-c9a4-4364-b8bd-2d00d5207e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:05:24.028995 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1383/2760] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:05:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 06:05:34.021687 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=25 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:08.976456 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e961533-ee5f-4c64-9725-487496b92c37 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:08.978012 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-0e961533-ee5f-4c64-9725-487496b92c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:09.040387 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e961533-ee5f-4c64-9725-487496b92c37 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:09.045167 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609a8dd-3379-4781-8904-eb0e5ca76397 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:09.045878 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609a8dd-3379-4781-8904-eb0e5ca76397 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:09.046105 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609a8dd-3379-4781-8904-eb0e5ca76397 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:09.046371 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609a8dd-3379-4781-8904-eb0e5ca76397 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:09.048718 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d609a8dd-3379-4781-8904-eb0e5ca76397 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:09.120087 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609a8dd-3379-4781-8904-eb0e5ca76397 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:09.121433 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609a8dd-3379-4781-8904-eb0e5ca76397 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:09.132558 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1378/2761] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:06:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:06:10.692079 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86af47-c9a4-4364-b8bd-2d00d5207e03 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:10.693591 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-eb86af47-c9a4-4364-b8bd-2d00d5207e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:10.705773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86af47-c9a4-4364-b8bd-2d00d5207e03 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:10.709141 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4f7cd-7556-45fd-87bf-a0bdafbf5660 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:10.709789 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4f7cd-7556-45fd-87bf-a0bdafbf5660 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:10.710066 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4f7cd-7556-45fd-87bf-a0bdafbf5660 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:10.710340 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4f7cd-7556-45fd-87bf-a0bdafbf5660 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:10.712569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a5f4f7cd-7556-45fd-87bf-a0bdafbf5660 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:10.726235 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4f7cd-7556-45fd-87bf-a0bdafbf5660 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:10.728632 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4f7cd-7556-45fd-87bf-a0bdafbf5660 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:10.740356 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1384/2762] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:06:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:06:19.127420 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=54 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:20.735114 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=6 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:23.473014 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609a8dd-3379-4781-8904-eb0e5ca76397 service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:23.474553 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d609a8dd-3379-4781-8904-eb0e5ca76397 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:23.542038 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609a8dd-3379-4781-8904-eb0e5ca76397 service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:23.546519 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8645a-7aad-4b82-9bd2-5ffbbeae63c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:23.547459 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8645a-7aad-4b82-9bd2-5ffbbeae63c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:23.547734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8645a-7aad-4b82-9bd2-5ffbbeae63c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:23.548039 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8645a-7aad-4b82-9bd2-5ffbbeae63c8 admin admin] PATH_INFO: `/v3/users/b22f0b92554e41aea3dc4624a4334032` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:23.549227 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd8645a-7aad-4b82-9bd2-5ffbbeae63c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b22f0b92554e41aea3dc4624a4334032)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:23.551317 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd8645a-7aad-4b82-9bd2-5ffbbeae63c8 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:23.598998 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3cd8645a-7aad-4b82-9bd2-5ffbbeae63c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b22f0b92554e41aea3dc4624a4334032'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:23.599654 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3cd8645a-7aad-4b82-9bd2-5ffbbeae63c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b22f0b92554e41aea3dc4624a4334032'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:23.608791 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3cd8645a-7aad-4b82-9bd2-5ffbbeae63c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b22f0b92554e41aea3dc4624a4334032'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:23.609430 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3cd8645a-7aad-4b82-9bd2-5ffbbeae63c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b22f0b92554e41aea3dc4624a4334032'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:23.620995 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-3cd8645a-7aad-4b82-9bd2-5ffbbeae63c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b22f0b92554e41aea3dc4624a4334032'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:23.632764 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1379/2763] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:06:23 2022] DELETE /identity/v3/users/b22f0b92554e41aea3dc4624a4334032 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:06:23.816205 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4f7cd-7556-45fd-87bf-a0bdafbf5660 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:23.832382 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4f7cd-7556-45fd-87bf-a0bdafbf5660 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:23.900500 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc483a-8096-489d-b872-8d1fdff6de22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:23.901381 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc483a-8096-489d-b872-8d1fdff6de22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:23.901696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc483a-8096-489d-b872-8d1fdff6de22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:23.901955 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc483a-8096-489d-b872-8d1fdff6de22 admin admin] PATH_INFO: `/v3/projects/dd86086d8ae84817a72d6817da5358b5` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:23.903323 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc483a-8096-489d-b872-8d1fdff6de22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd86086d8ae84817a72d6817da5358b5)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:23.905291 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc483a-8096-489d-b872-8d1fdff6de22 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:23.953463 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dbfc483a-8096-489d-b872-8d1fdff6de22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd86086d8ae84817a72d6817da5358b5', 'request_id': 'req-dbfc483a-8096-489d-b872-8d1fdff6de22'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:23.959583 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dbfc483a-8096-489d-b872-8d1fdff6de22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd86086d8ae84817a72d6817da5358b5', 'request_id': 'req-dbfc483a-8096-489d-b872-8d1fdff6de22'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:23.967747 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dbfc483a-8096-489d-b872-8d1fdff6de22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd86086d8ae84817a72d6817da5358b5', 'request_id': 'req-dbfc483a-8096-489d-b872-8d1fdff6de22'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:23.978946 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dbfc483a-8096-489d-b872-8d1fdff6de22 admin admin] The token cache is being invalidate because project dd86086d8ae84817a72d6817da5358b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:06:23.979302 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dbfc483a-8096-489d-b872-8d1fdff6de22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:23.979991 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dbfc483a-8096-489d-b872-8d1fdff6de22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:23.981590 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1385/2764] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:06:23 2022] DELETE /identity/v3/projects/dd86086d8ae84817a72d6817da5358b5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:06:23.986740 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4393c6-3b0c-4c86-9ddb-bde3bb041573 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:23.987032 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4393c6-3b0c-4c86-9ddb-bde3bb041573 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:23.987345 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4393c6-3b0c-4c86-9ddb-bde3bb041573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:24.005298 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-dd4393c6-3b0c-4c86-9ddb-bde3bb041573 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:06:24.006508 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-dd4393c6-3b0c-4c86-9ddb-bde3bb041573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:24.071541 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1380/2765] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 06:06:24.080285 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd477f-23fd-4594-a92e-cb7c05fefb9d None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:24.080573 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd477f-23fd-4594-a92e-cb7c05fefb9d None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:24.080851 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd477f-23fd-4594-a92e-cb7c05fefb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:24.100338 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-6bcd477f-23fd-4594-a92e-cb7c05fefb9d None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:06:24.101585 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6bcd477f-23fd-4594-a92e-cb7c05fefb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:24.110080 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1386/2766] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:06:24.114558 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4393c6-3b0c-4c86-9ddb-bde3bb041573 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:24.124778 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4393c6-3b0c-4c86-9ddb-bde3bb041573 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:24.130017 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4273de-9021-4110-b48b-a4641b78425c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:24.130672 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4273de-9021-4110-b48b-a4641b78425c admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:24.130956 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4273de-9021-4110-b48b-a4641b78425c admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:24.131245 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4273de-9021-4110-b48b-a4641b78425c admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:24.131965 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4273de-9021-4110-b48b-a4641b78425c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 06:06:24.132302 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4273de-9021-4110-b48b-a4641b78425c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:24.133938 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4273de-9021-4110-b48b-a4641b78425c admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:24.145530 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1381/2767] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 06:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 06:06:24.149588 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd477f-23fd-4594-a92e-cb7c05fefb9d None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:24.158850 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd477f-23fd-4594-a92e-cb7c05fefb9d None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:24.163725 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a756c8-87ec-4c67-86a7-0a07ff955e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:24.164366 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a756c8-87ec-4c67-86a7-0a07ff955e3b admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:24.164645 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a756c8-87ec-4c67-86a7-0a07ff955e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:24.164916 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a756c8-87ec-4c67-86a7-0a07ff955e3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:24.165596 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a756c8-87ec-4c67-86a7-0a07ff955e3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:24.167526 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a756c8-87ec-4c67-86a7-0a07ff955e3b admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:24.195076 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1387/2768] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:06:24 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 06:06:24.199150 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4273de-9021-4110-b48b-a4641b78425c admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:24.209498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4273de-9021-4110-b48b-a4641b78425c admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:24.213141 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:24.268312 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fb834-20a7-4c43-8ed5-b4ea52cf1e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:24.268973 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fb834-20a7-4c43-8ed5-b4ea52cf1e78 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:24.269254 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fb834-20a7-4c43-8ed5-b4ea52cf1e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:24.269527 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fb834-20a7-4c43-8ed5-b4ea52cf1e78 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:24.270437 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fb834-20a7-4c43-8ed5-b4ea52cf1e78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:24.272411 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fb834-20a7-4c43-8ed5-b4ea52cf1e78 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:24.293314 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1382/2769] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:06:24 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:06:24.297521 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a756c8-87ec-4c67-86a7-0a07ff955e3b admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:24.308008 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a756c8-87ec-4c67-86a7-0a07ff955e3b admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:24.312745 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c24f9-ad77-40c0-9939-76583a37bb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:24.313399 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c24f9-ad77-40c0-9939-76583a37bb53 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:24.313678 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c24f9-ad77-40c0-9939-76583a37bb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:24.313945 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c24f9-ad77-40c0-9939-76583a37bb53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:24.314657 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c24f9-ad77-40c0-9939-76583a37bb53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:24.316273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c24f9-ad77-40c0-9939-76583a37bb53 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:24.326565 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1388/2770] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:06:24.330326 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fb834-20a7-4c43-8ed5-b4ea52cf1e78 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:24.340308 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fb834-20a7-4c43-8ed5-b4ea52cf1e78 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:24.345180 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0387e0d-07e6-4800-9702-767424cbd9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:24.345827 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0387e0d-07e6-4800-9702-767424cbd9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:24.346104 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0387e0d-07e6-4800-9702-767424cbd9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:24.346705 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0387e0d-07e6-4800-9702-767424cbd9b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:24.347469 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0387e0d-07e6-4800-9702-767424cbd9b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:24.349164 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0387e0d-07e6-4800-9702-767424cbd9b4 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:24.358975 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1383/2771] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:06:24.363077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c24f9-ad77-40c0-9939-76583a37bb53 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:24.372939 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c24f9-ad77-40c0-9939-76583a37bb53 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:24.378159 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf6341-282d-431d-9341-4217faf8d7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:24.379104 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf6341-282d-431d-9341-4217faf8d7e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:24.379438 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf6341-282d-431d-9341-4217faf8d7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:24.379663 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf6341-282d-431d-9341-4217faf8d7e1 admin admin] PATH_INFO: `/v3/projects/7ab360a49abe4ad08b18a51cb96fcdbd/users/1b5df852f9e44f6b95468b5beb3e5c45/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:24.395370 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf6341-282d-431d-9341-4217faf8d7e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ab360a49abe4ad08b18a51cb96fcdbd, user_id=1b5df852f9e44f6b95468b5beb3e5c45, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:24.398146 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf6341-282d-431d-9341-4217faf8d7e1 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:24.414335 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1389/2772] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:06:24 2022] PUT /identity/v3/projects/7ab360a49abe4ad08b18a51cb96fcdbd/users/1b5df852f9e44f6b95468b5beb3e5c45/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 06:06:24.424787 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c61af-77bc-4672-a582-7d6aff4955f6 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:24.425082 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c61af-77bc-4672-a582-7d6aff4955f6 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:24.425362 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c61af-77bc-4672-a582-7d6aff4955f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:24.453537 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-499c61af-77bc-4672-a582-7d6aff4955f6 None None] MFA Rules not processed for user `1b5df852f9e44f6b95468b5beb3e5c45`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:06:24.454746 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-499c61af-77bc-4672-a582-7d6aff4955f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:24.526845 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1384/2773] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:06:24 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 06:06:24.538058 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf6341-282d-431d-9341-4217faf8d7e1 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:24.540105 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-45cf6341-282d-431d-9341-4217faf8d7e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:24.572300 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:24.602750 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf6341-282d-431d-9341-4217faf8d7e1 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:24.606621 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5841f8-9c6c-448f-8a15-780e8601b22b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:24.607293 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5841f8-9c6c-448f-8a15-780e8601b22b service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:24.607595 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5841f8-9c6c-448f-8a15-780e8601b22b service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:24.607869 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5841f8-9c6c-448f-8a15-780e8601b22b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:24.616465 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5841f8-9c6c-448f-8a15-780e8601b22b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:24.617940 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5841f8-9c6c-448f-8a15-780e8601b22b service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:24.626707 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1390/2774] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:06:24 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:06:33.104093 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c61af-77bc-4672-a582-7d6aff4955f6 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:33.174460 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c61af-77bc-4672-a582-7d6aff4955f6 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:33.180676 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f2761-33f3-4e5e-8368-b038476f6f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:33.181560 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f2761-33f3-4e5e-8368-b038476f6f6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:33.181840 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f2761-33f3-4e5e-8368-b038476f6f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:33.182110 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f2761-33f3-4e5e-8368-b038476f6f6a admin admin] PATH_INFO: `/v3/users/1b5df852f9e44f6b95468b5beb3e5c45` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:33.183380 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f2761-33f3-4e5e-8368-b038476f6f6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b5df852f9e44f6b95468b5beb3e5c45)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:33.185322 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f2761-33f3-4e5e-8368-b038476f6f6a admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:33.202901 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:33.240698 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4f5f2761-33f3-4e5e-8368-b038476f6f6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b5df852f9e44f6b95468b5beb3e5c45'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:33.241362 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4f5f2761-33f3-4e5e-8368-b038476f6f6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b5df852f9e44f6b95468b5beb3e5c45'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:33.249416 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4f5f2761-33f3-4e5e-8368-b038476f6f6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b5df852f9e44f6b95468b5beb3e5c45'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:33.250262 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4f5f2761-33f3-4e5e-8368-b038476f6f6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b5df852f9e44f6b95468b5beb3e5c45'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:33.265492 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4f5f2761-33f3-4e5e-8368-b038476f6f6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b5df852f9e44f6b95468b5beb3e5c45'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:33.278707 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1385/2775] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:06:33 2022] DELETE /identity/v3/users/1b5df852f9e44f6b95468b5beb3e5c45 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:06:33.283582 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991515f-7598-472c-8666-9fff35b0c244 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:33.284111 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991515f-7598-472c-8666-9fff35b0c244 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:33.284111 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991515f-7598-472c-8666-9fff35b0c244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:33.302503 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-2991515f-7598-472c-8666-9fff35b0c244 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:06:33.303777 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2991515f-7598-472c-8666-9fff35b0c244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:33.372600 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1391/2776] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:06:33.382993 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f2761-33f3-4e5e-8368-b038476f6f6a admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:33.384532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-4f5f2761-33f3-4e5e-8368-b038476f6f6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:33.446156 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f2761-33f3-4e5e-8368-b038476f6f6a admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:33.450986 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f6e3e-ab80-4f7c-bf67-0f3e371bd6ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:33.451877 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f6e3e-ab80-4f7c-bf67-0f3e371bd6ac service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:33.452382 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f6e3e-ab80-4f7c-bf67-0f3e371bd6ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:33.452854 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f6e3e-ab80-4f7c-bf67-0f3e371bd6ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:33.467140 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f6e3e-ab80-4f7c-bf67-0f3e371bd6ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:33.469498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f6e3e-ab80-4f7c-bf67-0f3e371bd6ac service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:33.485042 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1386/2777] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:06:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:06:33.791007 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991515f-7598-472c-8666-9fff35b0c244 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:33.792548 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-2991515f-7598-472c-8666-9fff35b0c244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:33.808108 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991515f-7598-472c-8666-9fff35b0c244 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:33.814870 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcdeaac-af6e-404a-8bb2-93c814ff0622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:33.816017 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdeaac-af6e-404a-8bb2-93c814ff0622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:33.816158 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdeaac-af6e-404a-8bb2-93c814ff0622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:33.816417 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdeaac-af6e-404a-8bb2-93c814ff0622 admin admin] PATH_INFO: `/v3/projects/7ab360a49abe4ad08b18a51cb96fcdbd` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:33.818061 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcdeaac-af6e-404a-8bb2-93c814ff0622 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ab360a49abe4ad08b18a51cb96fcdbd)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:33.820183 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcdeaac-af6e-404a-8bb2-93c814ff0622 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:33.871127 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9bcdeaac-af6e-404a-8bb2-93c814ff0622 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ab360a49abe4ad08b18a51cb96fcdbd', 'request_id': 'req-9bcdeaac-af6e-404a-8bb2-93c814ff0622'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:33.877481 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9bcdeaac-af6e-404a-8bb2-93c814ff0622 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ab360a49abe4ad08b18a51cb96fcdbd', 'request_id': 'req-9bcdeaac-af6e-404a-8bb2-93c814ff0622'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:33.885728 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9bcdeaac-af6e-404a-8bb2-93c814ff0622 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ab360a49abe4ad08b18a51cb96fcdbd', 'request_id': 'req-9bcdeaac-af6e-404a-8bb2-93c814ff0622'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:33.896065 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9bcdeaac-af6e-404a-8bb2-93c814ff0622 admin admin] The token cache is being invalidate because project 7ab360a49abe4ad08b18a51cb96fcdbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:06:33.896291 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9bcdeaac-af6e-404a-8bb2-93c814ff0622 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:33.896907 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9bcdeaac-af6e-404a-8bb2-93c814ff0622 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:33.898451 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1392/2778] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:06:33 2022] DELETE /identity/v3/projects/7ab360a49abe4ad08b18a51cb96fcdbd => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:06:33.903437 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66697a-4f30-45c1-adf6-c9247f93b437 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:33.903734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66697a-4f30-45c1-adf6-c9247f93b437 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:33.904048 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66697a-4f30-45c1-adf6-c9247f93b437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:33.922310 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-3f66697a-4f30-45c1-adf6-c9247f93b437 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:06:33.923622 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-3f66697a-4f30-45c1-adf6-c9247f93b437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:33.995612 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1387/2779] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:06:34.007406 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdf70a-7c05-460a-bfb5-e76eb90f7291 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:34.007697 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdf70a-7c05-460a-bfb5-e76eb90f7291 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:34.007972 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdf70a-7c05-460a-bfb5-e76eb90f7291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:34.027194 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-e2cdf70a-7c05-460a-bfb5-e76eb90f7291 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:06:34.028429 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e2cdf70a-7c05-460a-bfb5-e76eb90f7291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:34.037631 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1393/2780] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:06:34.042200 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66697a-4f30-45c1-adf6-c9247f93b437 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:34.053722 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66697a-4f30-45c1-adf6-c9247f93b437 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:34.061733 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85bdcb-8e47-4ff3-b96e-d256d09b3497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:34.062864 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85bdcb-8e47-4ff3-b96e-d256d09b3497 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:34.063394 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85bdcb-8e47-4ff3-b96e-d256d09b3497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:34.063888 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85bdcb-8e47-4ff3-b96e-d256d09b3497 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:34.065405 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85bdcb-8e47-4ff3-b96e-d256d09b3497 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 06:06:34.065755 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85bdcb-8e47-4ff3-b96e-d256d09b3497 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:34.067710 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85bdcb-8e47-4ff3-b96e-d256d09b3497 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:34.082981 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1388/2781] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 06:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 06:06:34.088371 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdf70a-7c05-460a-bfb5-e76eb90f7291 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:34.103482 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdf70a-7c05-460a-bfb5-e76eb90f7291 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:34.109442 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fde90-bf05-49dd-873d-504ac5676ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:34.110099 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fde90-bf05-49dd-873d-504ac5676ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:34.110379 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fde90-bf05-49dd-873d-504ac5676ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:34.110649 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fde90-bf05-49dd-873d-504ac5676ff3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:34.111360 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fde90-bf05-49dd-873d-504ac5676ff3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:34.113329 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fde90-bf05-49dd-873d-504ac5676ff3 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:34.141077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1394/2782] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:06:34 2022] POST /identity/v3/projects => generated 401 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:06:34.148409 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85bdcb-8e47-4ff3-b96e-d256d09b3497 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:34.165097 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85bdcb-8e47-4ff3-b96e-d256d09b3497 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:34.187780 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:34.228125 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec624c-0c8a-4867-9b53-21339716b266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:34.228837 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec624c-0c8a-4867-9b53-21339716b266 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:34.229161 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec624c-0c8a-4867-9b53-21339716b266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:34.229458 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec624c-0c8a-4867-9b53-21339716b266 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:34.230216 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec624c-0c8a-4867-9b53-21339716b266 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:34.232393 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec624c-0c8a-4867-9b53-21339716b266 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:34.254603 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1389/2783] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:06:34 2022] POST /identity/v3/users => generated 301 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:06:34.259492 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fde90-bf05-49dd-873d-504ac5676ff3 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:34.275052 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fde90-bf05-49dd-873d-504ac5676ff3 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:34.280714 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf7fa4-f992-4166-9b6a-7283f3ca40f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:34.281378 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf7fa4-f992-4166-9b6a-7283f3ca40f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:34.281654 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf7fa4-f992-4166-9b6a-7283f3ca40f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:34.281921 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf7fa4-f992-4166-9b6a-7283f3ca40f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:34.282630 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf7fa4-f992-4166-9b6a-7283f3ca40f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:34.284262 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf7fa4-f992-4166-9b6a-7283f3ca40f8 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:34.296487 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1395/2784] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:06:34.300924 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec624c-0c8a-4867-9b53-21339716b266 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:34.311821 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec624c-0c8a-4867-9b53-21339716b266 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:34.317402 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae927519-a61a-4125-90c8-b4bfd8eb7560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:34.318070 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae927519-a61a-4125-90c8-b4bfd8eb7560 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:34.318354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae927519-a61a-4125-90c8-b4bfd8eb7560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:34.318632 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae927519-a61a-4125-90c8-b4bfd8eb7560 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:34.319405 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae927519-a61a-4125-90c8-b4bfd8eb7560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:34.321043 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae927519-a61a-4125-90c8-b4bfd8eb7560 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:34.331621 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1390/2785] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:06:34.335934 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf7fa4-f992-4166-9b6a-7283f3ca40f8 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:34.346324 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf7fa4-f992-4166-9b6a-7283f3ca40f8 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:34.351779 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f59ce-6797-4b4f-bc51-cfcf3815f8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:34.352743 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f59ce-6797-4b4f-bc51-cfcf3815f8b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:34.353030 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f59ce-6797-4b4f-bc51-cfcf3815f8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:34.353318 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f59ce-6797-4b4f-bc51-cfcf3815f8b4 admin admin] PATH_INFO: `/v3/projects/19ba5854880148b48e576c2a08ed4104/users/87e5db52535040c7a4190d3c8b7446af/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:34.365968 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:34.371507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f59ce-6797-4b4f-bc51-cfcf3815f8b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19ba5854880148b48e576c2a08ed4104, user_id=87e5db52535040c7a4190d3c8b7446af, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:34.374914 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f59ce-6797-4b4f-bc51-cfcf3815f8b4 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:34.390441 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1396/2786] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:06:34 2022] PUT /identity/v3/projects/19ba5854880148b48e576c2a08ed4104/users/87e5db52535040c7a4190d3c8b7446af/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:06:34.402213 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ac70f-3b9f-41e9-8a4a-c28a226f25b6 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:34.402439 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ac70f-3b9f-41e9-8a4a-c28a226f25b6 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:34.402716 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ac70f-3b9f-41e9-8a4a-c28a226f25b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:34.429481 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-bc4ac70f-3b9f-41e9-8a4a-c28a226f25b6 None None] MFA Rules not processed for user `87e5db52535040c7a4190d3c8b7446af`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:06:34.430816 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-bc4ac70f-3b9f-41e9-8a4a-c28a226f25b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:34.497986 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1391/2787] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:06:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:06:34.502545 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f59ce-6797-4b4f-bc51-cfcf3815f8b4 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:34.564777 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f59ce-6797-4b4f-bc51-cfcf3815f8b4 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:34.570790 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc6702-fec3-490c-b692-196be1819a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:34.571843 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc6702-fec3-490c-b692-196be1819a22 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:34.572332 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc6702-fec3-490c-b692-196be1819a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:34.572807 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc6702-fec3-490c-b692-196be1819a22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:34.574008 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc6702-fec3-490c-b692-196be1819a22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:34.576500 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc6702-fec3-490c-b692-196be1819a22 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:34.606896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1397/2788] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:06:34 2022] POST /identity/v3/projects => generated 401 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:06:34.612837 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ac70f-3b9f-41e9-8a4a-c28a226f25b6 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:34.623615 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ac70f-3b9f-41e9-8a4a-c28a226f25b6 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:34.681685 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8099d1-0b55-4149-baff-ce34f8e28c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:34.682289 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8099d1-0b55-4149-baff-ce34f8e28c72 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:34.682574 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8099d1-0b55-4149-baff-ce34f8e28c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:34.682853 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8099d1-0b55-4149-baff-ce34f8e28c72 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:34.683622 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8099d1-0b55-4149-baff-ce34f8e28c72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:34.685596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8099d1-0b55-4149-baff-ce34f8e28c72 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:34.706687 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1392/2789] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:06:34 2022] POST /identity/v3/users => generated 307 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 06:06:34.710832 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc6702-fec3-490c-b692-196be1819a22 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:34.721211 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc6702-fec3-490c-b692-196be1819a22 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:34.726355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bedde4-7cae-40c2-80f3-9da0a6e30a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:34.727084 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bedde4-7cae-40c2-80f3-9da0a6e30a32 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:34.727407 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bedde4-7cae-40c2-80f3-9da0a6e30a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:34.727687 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bedde4-7cae-40c2-80f3-9da0a6e30a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:34.728408 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bedde4-7cae-40c2-80f3-9da0a6e30a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:34.730026 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bedde4-7cae-40c2-80f3-9da0a6e30a32 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:34.740573 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1398/2790] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:06:34.744504 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8099d1-0b55-4149-baff-ce34f8e28c72 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:34.754432 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8099d1-0b55-4149-baff-ce34f8e28c72 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:34.759404 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56301f9f-30c6-4cb9-bfc6-77869b45815b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:34.760282 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56301f9f-30c6-4cb9-bfc6-77869b45815b admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:34.760564 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56301f9f-30c6-4cb9-bfc6-77869b45815b admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:34.760841 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56301f9f-30c6-4cb9-bfc6-77869b45815b admin admin] PATH_INFO: `/v3/projects/5345bc4afece43909f660afa55c40328/users/21e5ec7c6c4f4f9db36b6c5fbaba9f40/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:34.776605 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56301f9f-30c6-4cb9-bfc6-77869b45815b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5345bc4afece43909f660afa55c40328, user_id=21e5ec7c6c4f4f9db36b6c5fbaba9f40, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:34.779385 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56301f9f-30c6-4cb9-bfc6-77869b45815b admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:34.789668 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:34.795796 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1393/2791] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:06:34 2022] PUT /identity/v3/projects/5345bc4afece43909f660afa55c40328/users/21e5ec7c6c4f4f9db36b6c5fbaba9f40/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:06:34.799640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bedde4-7cae-40c2-80f3-9da0a6e30a32 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:34.809695 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bedde4-7cae-40c2-80f3-9da0a6e30a32 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:34.869028 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c7ffd-1a39-4d67-a315-b589a094d8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:34.869698 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c7ffd-1a39-4d67-a315-b589a094d8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:34.869982 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c7ffd-1a39-4d67-a315-b589a094d8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:34.870257 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c7ffd-1a39-4d67-a315-b589a094d8b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:34.870975 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c7ffd-1a39-4d67-a315-b589a094d8b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:34.872634 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c7ffd-1a39-4d67-a315-b589a094d8b0 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:34.882524 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1399/2792] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:06:34.886670 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56301f9f-30c6-4cb9-bfc6-77869b45815b admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:34.897342 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56301f9f-30c6-4cb9-bfc6-77869b45815b admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:34.902707 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd91dd-46f1-43f5-bb40-4c83f94957b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:34.903657 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd91dd-46f1-43f5-bb40-4c83f94957b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:34.903926 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd91dd-46f1-43f5-bb40-4c83f94957b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:34.904199 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd91dd-46f1-43f5-bb40-4c83f94957b4 admin admin] PATH_INFO: `/v3/projects/5345bc4afece43909f660afa55c40328/users/21e5ec7c6c4f4f9db36b6c5fbaba9f40/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:34.906368 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd91dd-46f1-43f5-bb40-4c83f94957b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5345bc4afece43909f660afa55c40328, user_id=21e5ec7c6c4f4f9db36b6c5fbaba9f40, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:34.909121 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd91dd-46f1-43f5-bb40-4c83f94957b4 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:34.920363 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1394/2793] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:06:34 2022] PUT /identity/v3/projects/5345bc4afece43909f660afa55c40328/users/21e5ec7c6c4f4f9db36b6c5fbaba9f40/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:06:34.930730 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f7f3d-fa40-4523-af4d-cd84ce1371c0 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:34.931047 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f7f3d-fa40-4523-af4d-cd84ce1371c0 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:34.931355 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f7f3d-fa40-4523-af4d-cd84ce1371c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:34.959338 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-f65f7f3d-fa40-4523-af4d-cd84ce1371c0 None None] MFA Rules not processed for user `21e5ec7c6c4f4f9db36b6c5fbaba9f40`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:06:34.960513 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f65f7f3d-fa40-4523-af4d-cd84ce1371c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:35.007507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:35.030234 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1400/2794] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:06:34 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:06:35.041237 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd91dd-46f1-43f5-bb40-4c83f94957b4 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:35.043500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-47dd91dd-46f1-43f5-bb40-4c83f94957b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:35.106361 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd91dd-46f1-43f5-bb40-4c83f94957b4 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:35.110515 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cfc30-d6df-4e9c-89c2-eeb1e2ce5c8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:35.111172 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cfc30-d6df-4e9c-89c2-eeb1e2ce5c8c service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:35.111490 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cfc30-d6df-4e9c-89c2-eeb1e2ce5c8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:35.111769 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cfc30-d6df-4e9c-89c2-eeb1e2ce5c8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:35.121200 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4cfc30-d6df-4e9c-89c2-eeb1e2ce5c8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:35.122636 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4cfc30-d6df-4e9c-89c2-eeb1e2ce5c8c service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:35.132485 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1395/2795] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:06:35 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:06:35.211468 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f7f3d-fa40-4523-af4d-cd84ce1371c0 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:35.221391 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f7f3d-fa40-4523-af4d-cd84ce1371c0 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:35.226122 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d52e0-4189-4300-a7e1-4efa5e2f4891 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:35.226772 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d52e0-4189-4300-a7e1-4efa5e2f4891 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:35.227050 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d52e0-4189-4300-a7e1-4efa5e2f4891 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:35.227381 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d52e0-4189-4300-a7e1-4efa5e2f4891 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:35.286878 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d52e0-4189-4300-a7e1-4efa5e2f4891 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:35.288454 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d52e0-4189-4300-a7e1-4efa5e2f4891 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:35.297738 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1401/2796] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:06:35 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:06:39.404964 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cfc30-d6df-4e9c-89c2-eeb1e2ce5c8c service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:39.472378 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cfc30-d6df-4e9c-89c2-eeb1e2ce5c8c service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:39.477253 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f3be8-9217-49b1-83ae-a80ecb044c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:39.478135 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f3be8-9217-49b1-83ae-a80ecb044c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:39.478420 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f3be8-9217-49b1-83ae-a80ecb044c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:39.478702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f3be8-9217-49b1-83ae-a80ecb044c27 admin admin] PATH_INFO: `/v3/users/87e5db52535040c7a4190d3c8b7446af` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:39.479949 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f3be8-9217-49b1-83ae-a80ecb044c27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87e5db52535040c7a4190d3c8b7446af)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:39.481892 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f3be8-9217-49b1-83ae-a80ecb044c27 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:39.534127 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-498f3be8-9217-49b1-83ae-a80ecb044c27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87e5db52535040c7a4190d3c8b7446af'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:39.534794 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-498f3be8-9217-49b1-83ae-a80ecb044c27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87e5db52535040c7a4190d3c8b7446af'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:39.543651 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-498f3be8-9217-49b1-83ae-a80ecb044c27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87e5db52535040c7a4190d3c8b7446af'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:39.544287 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-498f3be8-9217-49b1-83ae-a80ecb044c27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87e5db52535040c7a4190d3c8b7446af'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:39.556346 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-498f3be8-9217-49b1-83ae-a80ecb044c27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87e5db52535040c7a4190d3c8b7446af'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:39.568596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1396/2797] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:06:39 2022] DELETE /identity/v3/users/87e5db52535040c7a4190d3c8b7446af => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:06:39.573422 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf85c6-f696-4822-bf5b-778e424735c8 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:39.573955 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf85c6-f696-4822-bf5b-778e424735c8 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:39.573955 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf85c6-f696-4822-bf5b-778e424735c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:39.591285 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-66cf85c6-f696-4822-bf5b-778e424735c8 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:06:39.592491 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-66cf85c6-f696-4822-bf5b-778e424735c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:39.653770 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1402/2798] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:06:39.663810 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f3be8-9217-49b1-83ae-a80ecb044c27 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:39.665500 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-498f3be8-9217-49b1-83ae-a80ecb044c27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:39.679824 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:39.728179 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f3be8-9217-49b1-83ae-a80ecb044c27 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:39.732041 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83312b2-698d-439f-9cee-965e79766cf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:39.732688 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83312b2-698d-439f-9cee-965e79766cf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:39.732967 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83312b2-698d-439f-9cee-965e79766cf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:39.733238 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83312b2-698d-439f-9cee-965e79766cf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:39.742235 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83312b2-698d-439f-9cee-965e79766cf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:39.743777 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83312b2-698d-439f-9cee-965e79766cf2 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:39.753151 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1397/2799] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:06:40.041183 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf85c6-f696-4822-bf5b-778e424735c8 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:40.042627 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-66cf85c6-f696-4822-bf5b-778e424735c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:40.054573 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf85c6-f696-4822-bf5b-778e424735c8 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:40.059323 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85a102-c021-4573-a3a0-b875b35ace90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:40.060211 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85a102-c021-4573-a3a0-b875b35ace90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:40.060496 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85a102-c021-4573-a3a0-b875b35ace90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:40.060772 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85a102-c021-4573-a3a0-b875b35ace90 admin admin] PATH_INFO: `/v3/projects/19ba5854880148b48e576c2a08ed4104` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:40.062254 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85a102-c021-4573-a3a0-b875b35ace90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19ba5854880148b48e576c2a08ed4104)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:40.064081 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85a102-c021-4573-a3a0-b875b35ace90 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:40.111640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-af85a102-c021-4573-a3a0-b875b35ace90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19ba5854880148b48e576c2a08ed4104', 'request_id': 'req-af85a102-c021-4573-a3a0-b875b35ace90'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:40.117547 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-af85a102-c021-4573-a3a0-b875b35ace90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19ba5854880148b48e576c2a08ed4104', 'request_id': 'req-af85a102-c021-4573-a3a0-b875b35ace90'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:40.124766 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-af85a102-c021-4573-a3a0-b875b35ace90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19ba5854880148b48e576c2a08ed4104', 'request_id': 'req-af85a102-c021-4573-a3a0-b875b35ace90'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:40.135060 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-af85a102-c021-4573-a3a0-b875b35ace90 admin admin] The token cache is being invalidate because project 19ba5854880148b48e576c2a08ed4104 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:06:40.135378 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-af85a102-c021-4573-a3a0-b875b35ace90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:40.136053 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-af85a102-c021-4573-a3a0-b875b35ace90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:40.137643 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1403/2800] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:06:40 2022] DELETE /identity/v3/projects/19ba5854880148b48e576c2a08ed4104 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:06:40.141684 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83312b2-698d-439f-9cee-965e79766cf2 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:40.152211 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83312b2-698d-439f-9cee-965e79766cf2 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:40.218473 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc74bc5-0efb-4fde-9f7a-3be8692d6d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:40.219390 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc74bc5-0efb-4fde-9f7a-3be8692d6d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:40.219675 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc74bc5-0efb-4fde-9f7a-3be8692d6d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:40.219951 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc74bc5-0efb-4fde-9f7a-3be8692d6d8a admin admin] PATH_INFO: `/v3/users/21e5ec7c6c4f4f9db36b6c5fbaba9f40` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:40.221193 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc74bc5-0efb-4fde-9f7a-3be8692d6d8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=21e5ec7c6c4f4f9db36b6c5fbaba9f40)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:40.223496 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc74bc5-0efb-4fde-9f7a-3be8692d6d8a admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:40.269629 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-1dc74bc5-0efb-4fde-9f7a-3be8692d6d8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21e5ec7c6c4f4f9db36b6c5fbaba9f40'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:40.270308 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-1dc74bc5-0efb-4fde-9f7a-3be8692d6d8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21e5ec7c6c4f4f9db36b6c5fbaba9f40'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:40.279172 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-1dc74bc5-0efb-4fde-9f7a-3be8692d6d8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21e5ec7c6c4f4f9db36b6c5fbaba9f40'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:40.279804 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-1dc74bc5-0efb-4fde-9f7a-3be8692d6d8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21e5ec7c6c4f4f9db36b6c5fbaba9f40'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:40.292406 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-1dc74bc5-0efb-4fde-9f7a-3be8692d6d8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21e5ec7c6c4f4f9db36b6c5fbaba9f40'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:40.304671 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1398/2801] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:06:40 2022] DELETE /identity/v3/users/21e5ec7c6c4f4f9db36b6c5fbaba9f40 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:06:40.594640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85a102-c021-4573-a3a0-b875b35ace90 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:40.596391 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-af85a102-c021-4573-a3a0-b875b35ace90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:40.613011 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85a102-c021-4573-a3a0-b875b35ace90 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:40.617836 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:40.675383 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3a5f9-f713-4931-b4b9-dc2372df9812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:40.676158 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3a5f9-f713-4931-b4b9-dc2372df9812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:40.676431 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3a5f9-f713-4931-b4b9-dc2372df9812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:40.676699 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3a5f9-f713-4931-b4b9-dc2372df9812 admin admin] PATH_INFO: `/v3/projects/5345bc4afece43909f660afa55c40328` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:40.677998 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3a5f9-f713-4931-b4b9-dc2372df9812 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5345bc4afece43909f660afa55c40328)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:40.679951 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3a5f9-f713-4931-b4b9-dc2372df9812 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:40.726861 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a8d3a5f9-f713-4931-b4b9-dc2372df9812 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5345bc4afece43909f660afa55c40328', 'request_id': 'req-a8d3a5f9-f713-4931-b4b9-dc2372df9812'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:40.733177 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a8d3a5f9-f713-4931-b4b9-dc2372df9812 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5345bc4afece43909f660afa55c40328', 'request_id': 'req-a8d3a5f9-f713-4931-b4b9-dc2372df9812'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:40.741969 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a8d3a5f9-f713-4931-b4b9-dc2372df9812 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5345bc4afece43909f660afa55c40328', 'request_id': 'req-a8d3a5f9-f713-4931-b4b9-dc2372df9812'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:40.752382 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a8d3a5f9-f713-4931-b4b9-dc2372df9812 admin admin] The token cache is being invalidate because project 5345bc4afece43909f660afa55c40328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:06:40.752677 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a8d3a5f9-f713-4931-b4b9-dc2372df9812 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:40.753308 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-a8d3a5f9-f713-4931-b4b9-dc2372df9812 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:40.754848 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1404/2802] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:06:40 2022] DELETE /identity/v3/projects/5345bc4afece43909f660afa55c40328 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:06:40.760006 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a1298-5c90-4be4-8b52-34d8c82774ef None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:40.760487 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a1298-5c90-4be4-8b52-34d8c82774ef None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:40.760600 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a1298-5c90-4be4-8b52-34d8c82774ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:40.780611 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-175a1298-5c90-4be4-8b52-34d8c82774ef None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:06:40.781835 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-175a1298-5c90-4be4-8b52-34d8c82774ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:40.811136 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:40.849930 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1399/2803] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:06:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:06:40.857911 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d4efe-809a-406a-a08c-987b5c6d97cf None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:40.858197 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d4efe-809a-406a-a08c-987b5c6d97cf None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:40.858469 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d4efe-809a-406a-a08c-987b5c6d97cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:40.877896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-e08d4efe-809a-406a-a08c-987b5c6d97cf None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:06:40.879097 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e08d4efe-809a-406a-a08c-987b5c6d97cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:40.890000 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1405/2804] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:06:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:06:40.894373 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a1298-5c90-4be4-8b52-34d8c82774ef None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:40.905117 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a1298-5c90-4be4-8b52-34d8c82774ef None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:40.911133 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c809649-4f23-43a6-b9b6-9681f6c99a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:40.911835 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c809649-4f23-43a6-b9b6-9681f6c99a01 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:40.912114 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c809649-4f23-43a6-b9b6-9681f6c99a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:40.912386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c809649-4f23-43a6-b9b6-9681f6c99a01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:40.913120 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c809649-4f23-43a6-b9b6-9681f6c99a01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 06:06:40.913421 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c809649-4f23-43a6-b9b6-9681f6c99a01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:40.915122 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c809649-4f23-43a6-b9b6-9681f6c99a01 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:40.927978 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1400/2805] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 06:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 06:06:40.933302 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d4efe-809a-406a-a08c-987b5c6d97cf None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:40.943200 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d4efe-809a-406a-a08c-987b5c6d97cf None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:40.949224 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f219383-620f-44c9-9c59-87dc9ba3310f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:40.949940 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f219383-620f-44c9-9c59-87dc9ba3310f admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:40.950209 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f219383-620f-44c9-9c59-87dc9ba3310f admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:40.950470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f219383-620f-44c9-9c59-87dc9ba3310f admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:40.951153 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f219383-620f-44c9-9c59-87dc9ba3310f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:40.953094 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f219383-620f-44c9-9c59-87dc9ba3310f admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:40.981637 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1406/2806] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:06:40 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:06:40.985902 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c809649-4f23-43a6-b9b6-9681f6c99a01 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:40.996517 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c809649-4f23-43a6-b9b6-9681f6c99a01 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:41.055468 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098560e-2134-41d6-8732-cb8faddc93ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:41.056230 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098560e-2134-41d6-8732-cb8faddc93ae admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:41.056519 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098560e-2134-41d6-8732-cb8faddc93ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:41.056799 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098560e-2134-41d6-8732-cb8faddc93ae admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:41.057504 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098560e-2134-41d6-8732-cb8faddc93ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:41.059462 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098560e-2134-41d6-8732-cb8faddc93ae admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:41.085784 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1401/2807] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:06:40 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:06:41.087501 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f219383-620f-44c9-9c59-87dc9ba3310f admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:41.098928 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f219383-620f-44c9-9c59-87dc9ba3310f admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:41.105326 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600fb835-36db-4ed4-8eee-b22ae02b7e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:41.105997 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fb835-36db-4ed4-8eee-b22ae02b7e3c admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:41.106280 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fb835-36db-4ed4-8eee-b22ae02b7e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:41.106552 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fb835-36db-4ed4-8eee-b22ae02b7e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:41.107309 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600fb835-36db-4ed4-8eee-b22ae02b7e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:41.108930 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600fb835-36db-4ed4-8eee-b22ae02b7e3c admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:41.121072 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1407/2808] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 06:06:41.125175 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098560e-2134-41d6-8732-cb8faddc93ae admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:41.135781 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098560e-2134-41d6-8732-cb8faddc93ae admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:41.141540 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883bda70-f8c3-467d-9ef6-6b3c8d7a6254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:41.142201 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bda70-f8c3-467d-9ef6-6b3c8d7a6254 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:41.142489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bda70-f8c3-467d-9ef6-6b3c8d7a6254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:41.142756 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bda70-f8c3-467d-9ef6-6b3c8d7a6254 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:41.143519 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883bda70-f8c3-467d-9ef6-6b3c8d7a6254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:41.145122 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883bda70-f8c3-467d-9ef6-6b3c8d7a6254 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:41.155938 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1402/2809] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:06:41.159927 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600fb835-36db-4ed4-8eee-b22ae02b7e3c admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:41.170079 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600fb835-36db-4ed4-8eee-b22ae02b7e3c admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:41.175287 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba625c-89ca-44a1-a67d-3123d34897b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:41.176160 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba625c-89ca-44a1-a67d-3123d34897b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:41.176438 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba625c-89ca-44a1-a67d-3123d34897b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:41.176736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba625c-89ca-44a1-a67d-3123d34897b0 admin admin] PATH_INFO: `/v3/projects/6f03cb6dafdf47f098d0579b06e2c6c0/users/e5ad2d9e95404d08b1cecb64be0c3a78/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:41.192023 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba625c-89ca-44a1-a67d-3123d34897b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f03cb6dafdf47f098d0579b06e2c6c0, user_id=e5ad2d9e95404d08b1cecb64be0c3a78, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:41.194702 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba625c-89ca-44a1-a67d-3123d34897b0 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:41.211714 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1408/2810] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:06:41 2022] PUT /identity/v3/projects/6f03cb6dafdf47f098d0579b06e2c6c0/users/e5ad2d9e95404d08b1cecb64be0c3a78/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:06:41.223602 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe0de5-d554-48a6-9364-7d4422edf77f None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:41.223888 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe0de5-d554-48a6-9364-7d4422edf77f None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:41.224161 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe0de5-d554-48a6-9364-7d4422edf77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:41.253344 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-31fe0de5-d554-48a6-9364-7d4422edf77f None None] MFA Rules not processed for user `e5ad2d9e95404d08b1cecb64be0c3a78`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:06:41.254576 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-31fe0de5-d554-48a6-9364-7d4422edf77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:41.331592 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1403/2811] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:06:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:06:41.336250 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba625c-89ca-44a1-a67d-3123d34897b0 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:41.383242 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:41.420572 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba625c-89ca-44a1-a67d-3123d34897b0 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:41.426297 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe22ee-1b94-4a8b-8bcc-0936e6e6eee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:41.426964 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe22ee-1b94-4a8b-8bcc-0936e6e6eee9 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:41.427273 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe22ee-1b94-4a8b-8bcc-0936e6e6eee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:41.427561 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe22ee-1b94-4a8b-8bcc-0936e6e6eee9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:41.428204 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe22ee-1b94-4a8b-8bcc-0936e6e6eee9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:41.430152 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe22ee-1b94-4a8b-8bcc-0936e6e6eee9 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:41.459041 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1409/2812] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:06:41 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:06:41.463318 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe0de5-d554-48a6-9364-7d4422edf77f None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:41.474830 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe0de5-d554-48a6-9364-7d4422edf77f None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:41.495705 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:41.536692 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0775cd-e527-47e0-b4b7-5e3fccc89472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:41.537361 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0775cd-e527-47e0-b4b7-5e3fccc89472 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:41.537646 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0775cd-e527-47e0-b4b7-5e3fccc89472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:41.537924 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0775cd-e527-47e0-b4b7-5e3fccc89472 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:41.538625 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0775cd-e527-47e0-b4b7-5e3fccc89472 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:41.540665 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0775cd-e527-47e0-b4b7-5e3fccc89472 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:41.567995 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1404/2813] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:06:41 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:06:41.572443 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe22ee-1b94-4a8b-8bcc-0936e6e6eee9 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:41.582763 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe22ee-1b94-4a8b-8bcc-0936e6e6eee9 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:41.587759 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2f61e-c93a-4865-ba15-a919079be1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:41.588415 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2f61e-c93a-4865-ba15-a919079be1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:41.588696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2f61e-c93a-4865-ba15-a919079be1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:41.588969 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2f61e-c93a-4865-ba15-a919079be1f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:41.589695 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2f61e-c93a-4865-ba15-a919079be1f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:41.591336 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2f61e-c93a-4865-ba15-a919079be1f6 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:41.602164 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1410/2814] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:06:41.606741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0775cd-e527-47e0-b4b7-5e3fccc89472 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:41.617652 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0775cd-e527-47e0-b4b7-5e3fccc89472 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:41.623619 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdb1d5-90a8-4db4-af0c-330110a38f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:41.624542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdb1d5-90a8-4db4-af0c-330110a38f81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:41.624828 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdb1d5-90a8-4db4-af0c-330110a38f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:41.625105 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdb1d5-90a8-4db4-af0c-330110a38f81 admin admin] PATH_INFO: `/v3/projects/9f01f9a77dc74d4b89d0a4c456553914/users/a040f144347148ebb6e002175e734631/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:41.641035 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fdb1d5-90a8-4db4-af0c-330110a38f81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f01f9a77dc74d4b89d0a4c456553914, user_id=a040f144347148ebb6e002175e734631, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:41.643755 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fdb1d5-90a8-4db4-af0c-330110a38f81 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:41.659143 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1405/2815] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:06:41 2022] PUT /identity/v3/projects/9f01f9a77dc74d4b89d0a4c456553914/users/a040f144347148ebb6e002175e734631/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:06:41.663239 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2f61e-c93a-4865-ba15-a919079be1f6 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:41.673679 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2f61e-c93a-4865-ba15-a919079be1f6 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:41.731626 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46671b5-6898-4d71-9139-167408495cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:41.732318 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46671b5-6898-4d71-9139-167408495cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:41.732599 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46671b5-6898-4d71-9139-167408495cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:41.732869 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46671b5-6898-4d71-9139-167408495cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:41.733597 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46671b5-6898-4d71-9139-167408495cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:41.735229 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46671b5-6898-4d71-9139-167408495cd8 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:41.745186 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1411/2816] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:06:41.749707 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdb1d5-90a8-4db4-af0c-330110a38f81 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:41.764327 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdb1d5-90a8-4db4-af0c-330110a38f81 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:41.771293 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92003804-27f3-41aa-922f-287040899caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:41.772739 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92003804-27f3-41aa-922f-287040899caa admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:41.773269 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92003804-27f3-41aa-922f-287040899caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:41.773780 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92003804-27f3-41aa-922f-287040899caa admin admin] PATH_INFO: `/v3/projects/9f01f9a77dc74d4b89d0a4c456553914/users/a040f144347148ebb6e002175e734631/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:41.776443 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92003804-27f3-41aa-922f-287040899caa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f01f9a77dc74d4b89d0a4c456553914, user_id=a040f144347148ebb6e002175e734631, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:41.779119 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92003804-27f3-41aa-922f-287040899caa admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:41.792238 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1406/2817] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:06:41 2022] PUT /identity/v3/projects/9f01f9a77dc74d4b89d0a4c456553914/users/a040f144347148ebb6e002175e734631/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:06:41.802866 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d495e-5ccd-48c6-b549-b4ccd133485c None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:41.803158 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d495e-5ccd-48c6-b549-b4ccd133485c None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:41.803459 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d495e-5ccd-48c6-b549-b4ccd133485c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:41.831094 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-4d0d495e-5ccd-48c6-b549-b4ccd133485c None None] MFA Rules not processed for user `a040f144347148ebb6e002175e734631`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:06:41.832333 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4d0d495e-5ccd-48c6-b549-b4ccd133485c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:41.903529 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1412/2818] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:06:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:06:41.914586 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92003804-27f3-41aa-922f-287040899caa admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:41.916507 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-92003804-27f3-41aa-922f-287040899caa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:41.981489 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92003804-27f3-41aa-922f-287040899caa admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:41.985708 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098d5c4-2a1d-4403-9a52-6db99d639e54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:41.986366 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098d5c4-2a1d-4403-9a52-6db99d639e54 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:41.986659 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098d5c4-2a1d-4403-9a52-6db99d639e54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:41.986941 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098d5c4-2a1d-4403-9a52-6db99d639e54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:41.996386 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098d5c4-2a1d-4403-9a52-6db99d639e54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:41.997846 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098d5c4-2a1d-4403-9a52-6db99d639e54 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:42.007377 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1407/2819] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:06:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:06:42.118603 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d495e-5ccd-48c6-b549-b4ccd133485c None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:42.129275 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d495e-5ccd-48c6-b549-b4ccd133485c None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:42.133436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94fecb-e9b9-4f6d-a38d-dfff62cf96d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:42.134041 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94fecb-e9b9-4f6d-a38d-dfff62cf96d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:42.134321 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94fecb-e9b9-4f6d-a38d-dfff62cf96d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:42.134598 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94fecb-e9b9-4f6d-a38d-dfff62cf96d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:42.162522 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:42.196618 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94fecb-e9b9-4f6d-a38d-dfff62cf96d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:42.198082 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94fecb-e9b9-4f6d-a38d-dfff62cf96d0 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:42.206991 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1413/2820] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:06:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:06:44.811780 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098d5c4-2a1d-4403-9a52-6db99d639e54 service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:44.879952 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098d5c4-2a1d-4403-9a52-6db99d639e54 service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:44.884908 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb86f07-113d-4191-b782-36490ca1e77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:44.885809 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb86f07-113d-4191-b782-36490ca1e77f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:44.886090 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb86f07-113d-4191-b782-36490ca1e77f admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:44.886369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb86f07-113d-4191-b782-36490ca1e77f admin admin] PATH_INFO: `/v3/users/e5ad2d9e95404d08b1cecb64be0c3a78` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:44.887708 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb86f07-113d-4191-b782-36490ca1e77f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5ad2d9e95404d08b1cecb64be0c3a78)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:44.889696 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb86f07-113d-4191-b782-36490ca1e77f admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:44.912254 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:44.939626 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4fb86f07-113d-4191-b782-36490ca1e77f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5ad2d9e95404d08b1cecb64be0c3a78'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:44.940336 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4fb86f07-113d-4191-b782-36490ca1e77f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5ad2d9e95404d08b1cecb64be0c3a78'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:44.948785 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4fb86f07-113d-4191-b782-36490ca1e77f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5ad2d9e95404d08b1cecb64be0c3a78'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:44.949447 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4fb86f07-113d-4191-b782-36490ca1e77f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5ad2d9e95404d08b1cecb64be0c3a78'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:44.961506 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4fb86f07-113d-4191-b782-36490ca1e77f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5ad2d9e95404d08b1cecb64be0c3a78'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:44.974287 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1408/2821] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:06:44 2022] DELETE /identity/v3/users/e5ad2d9e95404d08b1cecb64be0c3a78 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:06:44.979078 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8716e-2643-4e5b-b928-3547a83635e2 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:44.979601 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8716e-2643-4e5b-b928-3547a83635e2 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:44.979726 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8716e-2643-4e5b-b928-3547a83635e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:44.997085 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-4ee8716e-2643-4e5b-b928-3547a83635e2 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:06:44.998278 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4ee8716e-2643-4e5b-b928-3547a83635e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:45.059196 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1414/2822] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:06:45.072532 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb86f07-113d-4191-b782-36490ca1e77f admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:45.074068 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-4fb86f07-113d-4191-b782-36490ca1e77f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:45.134774 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb86f07-113d-4191-b782-36490ca1e77f admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:45.139055 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6383142-6abe-46ad-91db-f943f956bd17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:45.139740 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6383142-6abe-46ad-91db-f943f956bd17 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:45.140018 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6383142-6abe-46ad-91db-f943f956bd17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:45.140292 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6383142-6abe-46ad-91db-f943f956bd17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:45.150941 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6383142-6abe-46ad-91db-f943f956bd17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:45.152445 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6383142-6abe-46ad-91db-f943f956bd17 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:45.161947 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1409/2823] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:06:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:06:45.447336 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8716e-2643-4e5b-b928-3547a83635e2 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:45.448841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-4ee8716e-2643-4e5b-b928-3547a83635e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:45.463063 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8716e-2643-4e5b-b928-3547a83635e2 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:45.469479 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdaa570-1c80-479b-a216-6dcfec194ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:45.470365 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdaa570-1c80-479b-a216-6dcfec194ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:45.470689 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdaa570-1c80-479b-a216-6dcfec194ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:45.470905 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdaa570-1c80-479b-a216-6dcfec194ac8 admin admin] PATH_INFO: `/v3/projects/6f03cb6dafdf47f098d0579b06e2c6c0` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:45.472513 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdaa570-1c80-479b-a216-6dcfec194ac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f03cb6dafdf47f098d0579b06e2c6c0)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:45.474470 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdaa570-1c80-479b-a216-6dcfec194ac8 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:45.522307 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9bdaa570-1c80-479b-a216-6dcfec194ac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f03cb6dafdf47f098d0579b06e2c6c0', 'request_id': 'req-9bdaa570-1c80-479b-a216-6dcfec194ac8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:45.531090 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9bdaa570-1c80-479b-a216-6dcfec194ac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f03cb6dafdf47f098d0579b06e2c6c0', 'request_id': 'req-9bdaa570-1c80-479b-a216-6dcfec194ac8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:45.540436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9bdaa570-1c80-479b-a216-6dcfec194ac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f03cb6dafdf47f098d0579b06e2c6c0', 'request_id': 'req-9bdaa570-1c80-479b-a216-6dcfec194ac8'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:45.551665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9bdaa570-1c80-479b-a216-6dcfec194ac8 admin admin] The token cache is being invalidate because project 6f03cb6dafdf47f098d0579b06e2c6c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:06:45.551948 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9bdaa570-1c80-479b-a216-6dcfec194ac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:45.552645 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-9bdaa570-1c80-479b-a216-6dcfec194ac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:45.554292 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1415/2824] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:06:45 2022] DELETE /identity/v3/projects/6f03cb6dafdf47f098d0579b06e2c6c0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:06:45.558633 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6383142-6abe-46ad-91db-f943f956bd17 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:45.568789 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6383142-6abe-46ad-91db-f943f956bd17 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:45.630784 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930d163-7cd0-47f9-956c-1f132f9f8ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:45.631793 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930d163-7cd0-47f9-956c-1f132f9f8ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:45.632076 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930d163-7cd0-47f9-956c-1f132f9f8ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:45.632350 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930d163-7cd0-47f9-956c-1f132f9f8ea8 admin admin] PATH_INFO: `/v3/users/a040f144347148ebb6e002175e734631` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:45.633612 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930d163-7cd0-47f9-956c-1f132f9f8ea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a040f144347148ebb6e002175e734631)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:45.635656 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930d163-7cd0-47f9-956c-1f132f9f8ea8 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:45.680445 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:45.683567 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0930d163-7cd0-47f9-956c-1f132f9f8ea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a040f144347148ebb6e002175e734631'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:45.684431 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0930d163-7cd0-47f9-956c-1f132f9f8ea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a040f144347148ebb6e002175e734631'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:45.692064 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0930d163-7cd0-47f9-956c-1f132f9f8ea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a040f144347148ebb6e002175e734631'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:45.693036 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0930d163-7cd0-47f9-956c-1f132f9f8ea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a040f144347148ebb6e002175e734631'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:45.704985 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0930d163-7cd0-47f9-956c-1f132f9f8ea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a040f144347148ebb6e002175e734631'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:45.718956 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1410/2825] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:06:45 2022] DELETE /identity/v3/users/a040f144347148ebb6e002175e734631 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:06:46.005792 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdaa570-1c80-479b-a216-6dcfec194ac8 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:46.007990 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-9bdaa570-1c80-479b-a216-6dcfec194ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:46.021219 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdaa570-1c80-479b-a216-6dcfec194ac8 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:46.067329 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:46.078433 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5315e-dc59-423d-bb8c-4f0aaa676753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:46.079328 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5315e-dc59-423d-bb8c-4f0aaa676753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:46.079796 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5315e-dc59-423d-bb8c-4f0aaa676753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:46.080236 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5315e-dc59-423d-bb8c-4f0aaa676753 admin admin] PATH_INFO: `/v3/projects/9f01f9a77dc74d4b89d0a4c456553914` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:46.081458 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5315e-dc59-423d-bb8c-4f0aaa676753 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f01f9a77dc74d4b89d0a4c456553914)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:46.083440 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5315e-dc59-423d-bb8c-4f0aaa676753 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:46.130668 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dcf5315e-dc59-423d-bb8c-4f0aaa676753 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f01f9a77dc74d4b89d0a4c456553914', 'request_id': 'req-dcf5315e-dc59-423d-bb8c-4f0aaa676753'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:46.137067 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dcf5315e-dc59-423d-bb8c-4f0aaa676753 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f01f9a77dc74d4b89d0a4c456553914', 'request_id': 'req-dcf5315e-dc59-423d-bb8c-4f0aaa676753'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:46.145683 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dcf5315e-dc59-423d-bb8c-4f0aaa676753 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f01f9a77dc74d4b89d0a4c456553914', 'request_id': 'req-dcf5315e-dc59-423d-bb8c-4f0aaa676753'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:46.156579 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dcf5315e-dc59-423d-bb8c-4f0aaa676753 admin admin] The token cache is being invalidate because project 9f01f9a77dc74d4b89d0a4c456553914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:06:46.156863 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dcf5315e-dc59-423d-bb8c-4f0aaa676753 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:46.157526 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-dcf5315e-dc59-423d-bb8c-4f0aaa676753 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:46.159141 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1416/2826] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:06:46 2022] DELETE /identity/v3/projects/9f01f9a77dc74d4b89d0a4c456553914 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:06:46.164241 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1baa806-17eb-4d4c-9c39-4a828e392725 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:46.164714 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1baa806-17eb-4d4c-9c39-4a828e392725 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:46.164812 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1baa806-17eb-4d4c-9c39-4a828e392725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:46.183013 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-a1baa806-17eb-4d4c-9c39-4a828e392725 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:06:46.184228 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-a1baa806-17eb-4d4c-9c39-4a828e392725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:46.246115 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1411/2827] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:06:46.255354 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbee103-7b84-4091-bbe7-448fa2a05f5b None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:46.255641 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbee103-7b84-4091-bbe7-448fa2a05f5b None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:46.255913 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbee103-7b84-4091-bbe7-448fa2a05f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:46.276461 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-1cbee103-7b84-4091-bbe7-448fa2a05f5b None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:06:46.277645 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1cbee103-7b84-4091-bbe7-448fa2a05f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:46.289042 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1417/2828] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:06:46.346992 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1baa806-17eb-4d4c-9c39-4a828e392725 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:46.358095 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1baa806-17eb-4d4c-9c39-4a828e392725 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:46.363828 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae4c8e-b7b6-4580-85ae-0a1316cbae30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:46.364487 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae4c8e-b7b6-4580-85ae-0a1316cbae30 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:46.364741 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae4c8e-b7b6-4580-85ae-0a1316cbae30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:46.365046 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae4c8e-b7b6-4580-85ae-0a1316cbae30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:46.365782 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae4c8e-b7b6-4580-85ae-0a1316cbae30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 06:06:46.366081 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae4c8e-b7b6-4580-85ae-0a1316cbae30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:46.367750 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae4c8e-b7b6-4580-85ae-0a1316cbae30 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:46.380387 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1412/2829] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 06:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 06:06:46.385565 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbee103-7b84-4091-bbe7-448fa2a05f5b None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:46.400489 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbee103-7b84-4091-bbe7-448fa2a05f5b None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:46.406002 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11ac65-95f4-490a-b47f-69de34f802ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:46.406661 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11ac65-95f4-490a-b47f-69de34f802ad admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:46.406941 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11ac65-95f4-490a-b47f-69de34f802ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:46.407228 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11ac65-95f4-490a-b47f-69de34f802ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:46.407995 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb11ac65-95f4-490a-b47f-69de34f802ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:46.410065 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb11ac65-95f4-490a-b47f-69de34f802ad admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:46.442521 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1418/2830] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:06:46 2022] POST /identity/v3/projects => generated 409 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:06:46.446842 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae4c8e-b7b6-4580-85ae-0a1316cbae30 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:46.461620 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae4c8e-b7b6-4580-85ae-0a1316cbae30 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:46.525320 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382cf36f-1337-4a6d-9e93-728125010cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:46.526005 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cf36f-1337-4a6d-9e93-728125010cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:46.526274 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cf36f-1337-4a6d-9e93-728125010cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:46.526562 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cf36f-1337-4a6d-9e93-728125010cf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:46.527277 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382cf36f-1337-4a6d-9e93-728125010cf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:46.529243 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382cf36f-1337-4a6d-9e93-728125010cf4 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:46.552170 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1413/2831] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:06:46 2022] POST /identity/v3/users => generated 305 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:06:46.556550 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11ac65-95f4-490a-b47f-69de34f802ad admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:46.567146 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11ac65-95f4-490a-b47f-69de34f802ad admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:46.573102 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae801a-95b5-43a8-a642-c30c6e9c8e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:46.573776 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae801a-95b5-43a8-a642-c30c6e9c8e51 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:46.574058 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae801a-95b5-43a8-a642-c30c6e9c8e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:46.574328 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae801a-95b5-43a8-a642-c30c6e9c8e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:46.575046 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae801a-95b5-43a8-a642-c30c6e9c8e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:46.576687 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae801a-95b5-43a8-a642-c30c6e9c8e51 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:46.587025 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1419/2832] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:06:46.590875 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382cf36f-1337-4a6d-9e93-728125010cf4 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:46.601477 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382cf36f-1337-4a6d-9e93-728125010cf4 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:46.606278 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc27cd-a4d2-448a-8219-8a3b11082147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:46.606955 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc27cd-a4d2-448a-8219-8a3b11082147 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:46.607238 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc27cd-a4d2-448a-8219-8a3b11082147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:46.607544 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc27cd-a4d2-448a-8219-8a3b11082147 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:46.608277 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc27cd-a4d2-448a-8219-8a3b11082147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:46.609888 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc27cd-a4d2-448a-8219-8a3b11082147 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:46.620433 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1414/2833] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:06:46.624759 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae801a-95b5-43a8-a642-c30c6e9c8e51 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:46.635406 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae801a-95b5-43a8-a642-c30c6e9c8e51 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:46.641042 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbec95e-61aa-4337-9c44-d1b2fb8402bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:46.641921 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbec95e-61aa-4337-9c44-d1b2fb8402bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:46.642208 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbec95e-61aa-4337-9c44-d1b2fb8402bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:46.642477 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbec95e-61aa-4337-9c44-d1b2fb8402bb admin admin] PATH_INFO: `/v3/projects/4cd3aad8803e4e298e5c2cac518e1d0b/users/d8597d3082d4497c977a448d266e4a3d/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:46.657811 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbec95e-61aa-4337-9c44-d1b2fb8402bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cd3aad8803e4e298e5c2cac518e1d0b, user_id=d8597d3082d4497c977a448d266e4a3d, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:46.660624 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbec95e-61aa-4337-9c44-d1b2fb8402bb admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:46.680600 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1420/2834] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:06:46 2022] PUT /identity/v3/projects/4cd3aad8803e4e298e5c2cac518e1d0b/users/d8597d3082d4497c977a448d266e4a3d/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:06:46.696754 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236f885-63ae-4b30-b6f1-88b95767ecd5 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:46.697169 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236f885-63ae-4b30-b6f1-88b95767ecd5 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:46.697475 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236f885-63ae-4b30-b6f1-88b95767ecd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:46.730021 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-8236f885-63ae-4b30-b6f1-88b95767ecd5 None None] MFA Rules not processed for user `d8597d3082d4497c977a448d266e4a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:06:46.731922 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-8236f885-63ae-4b30-b6f1-88b95767ecd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:46.750086 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:46.817290 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1415/2835] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:06:46 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:06:46.822247 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbec95e-61aa-4337-9c44-d1b2fb8402bb admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:46.887929 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbec95e-61aa-4337-9c44-d1b2fb8402bb admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:46.892921 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab92858-c2fd-4392-92e3-5597d935e4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:46.893588 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab92858-c2fd-4392-92e3-5597d935e4b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:46.893866 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab92858-c2fd-4392-92e3-5597d935e4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:46.894137 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab92858-c2fd-4392-92e3-5597d935e4b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:46.894849 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab92858-c2fd-4392-92e3-5597d935e4b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:46.896884 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab92858-c2fd-4392-92e3-5597d935e4b4 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:46.927998 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1421/2836] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:06:46 2022] POST /identity/v3/projects => generated 409 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:06:46.932340 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236f885-63ae-4b30-b6f1-88b95767ecd5 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:46.946176 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236f885-63ae-4b30-b6f1-88b95767ecd5 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:47.004512 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e6f1f-4ee0-4d6c-9ecd-5322d0e4739a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:47.005186 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e6f1f-4ee0-4d6c-9ecd-5322d0e4739a admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:47.005474 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e6f1f-4ee0-4d6c-9ecd-5322d0e4739a admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:47.005742 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e6f1f-4ee0-4d6c-9ecd-5322d0e4739a admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:47.006442 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e6f1f-4ee0-4d6c-9ecd-5322d0e4739a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:47.008448 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e6f1f-4ee0-4d6c-9ecd-5322d0e4739a admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:47.029982 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1416/2837] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:06:46 2022] POST /identity/v3/users => generated 311 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 06:06:47.034218 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab92858-c2fd-4392-92e3-5597d935e4b4 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:47.039779 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:47.046436 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab92858-c2fd-4392-92e3-5597d935e4b4 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:47.052813 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0ea28-8212-4287-8b81-efa673a230f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:47.053475 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0ea28-8212-4287-8b81-efa673a230f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:47.053756 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0ea28-8212-4287-8b81-efa673a230f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:47.054032 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0ea28-8212-4287-8b81-efa673a230f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:47.054789 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef0ea28-8212-4287-8b81-efa673a230f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:47.056579 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef0ea28-8212-4287-8b81-efa673a230f9 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:47.067287 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1422/2838] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:06:47.071449 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e6f1f-4ee0-4d6c-9ecd-5322d0e4739a admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:47.082030 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e6f1f-4ee0-4d6c-9ecd-5322d0e4739a admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:47.087871 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71e4b9-35f4-45f2-8282-aff9f36fb512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:47.088802 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71e4b9-35f4-45f2-8282-aff9f36fb512 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:47.089079 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71e4b9-35f4-45f2-8282-aff9f36fb512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:47.089354 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71e4b9-35f4-45f2-8282-aff9f36fb512 admin admin] PATH_INFO: `/v3/projects/6588eec5c56a4bc6ae5d92b1107a728e/users/1786c45520b44e79b943820bc978284e/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:47.104935 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71e4b9-35f4-45f2-8282-aff9f36fb512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6588eec5c56a4bc6ae5d92b1107a728e, user_id=1786c45520b44e79b943820bc978284e, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:47.107648 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71e4b9-35f4-45f2-8282-aff9f36fb512 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:47.122228 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1417/2839] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:06:47 2022] PUT /identity/v3/projects/6588eec5c56a4bc6ae5d92b1107a728e/users/1786c45520b44e79b943820bc978284e/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 06:06:47.126314 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0ea28-8212-4287-8b81-efa673a230f9 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:47.136976 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0ea28-8212-4287-8b81-efa673a230f9 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:47.195062 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc07af-3e37-486c-900e-663c06bbe73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:47.195684 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc07af-3e37-486c-900e-663c06bbe73e admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:47.195971 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc07af-3e37-486c-900e-663c06bbe73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:47.196244 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc07af-3e37-486c-900e-663c06bbe73e admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:47.196957 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc07af-3e37-486c-900e-663c06bbe73e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:47.198597 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc07af-3e37-486c-900e-663c06bbe73e admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:47.208636 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1423/2840] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:06:47.213401 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71e4b9-35f4-45f2-8282-aff9f36fb512 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:47.224247 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71e4b9-35f4-45f2-8282-aff9f36fb512 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:47.229004 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de809f-86c0-4708-a879-9016dfadad15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:47.229893 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de809f-86c0-4708-a879-9016dfadad15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:47.230174 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de809f-86c0-4708-a879-9016dfadad15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:47.230445 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de809f-86c0-4708-a879-9016dfadad15 admin admin] PATH_INFO: `/v3/projects/6588eec5c56a4bc6ae5d92b1107a728e/users/1786c45520b44e79b943820bc978284e/roles/6c5b161dbf33447fa1d383915d3c9382` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:47.232403 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de809f-86c0-4708-a879-9016dfadad15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6588eec5c56a4bc6ae5d92b1107a728e, user_id=1786c45520b44e79b943820bc978284e, role_id=6c5b161dbf33447fa1d383915d3c9382)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:47.235042 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de809f-86c0-4708-a879-9016dfadad15 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:47.245683 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1418/2841] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:06:47 2022] PUT /identity/v3/projects/6588eec5c56a4bc6ae5d92b1107a728e/users/1786c45520b44e79b943820bc978284e/roles/6c5b161dbf33447fa1d383915d3c9382 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:06:47.261961 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0c0d7-bae5-49f8-bc08-fd06996c14c9 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:47.262411 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0c0d7-bae5-49f8-bc08-fd06996c14c9 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:47.262841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0c0d7-bae5-49f8-bc08-fd06996c14c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:47.292994 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-e5b0c0d7-bae5-49f8-bc08-fd06996c14c9 None None] MFA Rules not processed for user `1786c45520b44e79b943820bc978284e`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:06:47.294205 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e5b0c0d7-bae5-49f8-bc08-fd06996c14c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:47.366837 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1424/2842] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:06:47 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:06:47.377782 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de809f-86c0-4708-a879-9016dfadad15 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:47.379647 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b0de809f-86c0-4708-a879-9016dfadad15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:47.439731 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de809f-86c0-4708-a879-9016dfadad15 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:47.443817 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5828d32-8b75-40bc-ac4b-83509518d630 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:47.444457 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5828d32-8b75-40bc-ac4b-83509518d630 service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:47.444734 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5828d32-8b75-40bc-ac4b-83509518d630 service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:47.445002 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5828d32-8b75-40bc-ac4b-83509518d630 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:47.454742 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5828d32-8b75-40bc-ac4b-83509518d630 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:47.456175 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5828d32-8b75-40bc-ac4b-83509518d630 service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:47.465598 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1419/2843] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:06:47 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:06:47.619549 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0c0d7-bae5-49f8-bc08-fd06996c14c9 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:47.629597 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0c0d7-bae5-49f8-bc08-fd06996c14c9 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:47.633320 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957453dd-892e-4fb2-b526-a05764d7d838 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:47.633957 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957453dd-892e-4fb2-b526-a05764d7d838 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:47.634243 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957453dd-892e-4fb2-b526-a05764d7d838 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:47.634600 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957453dd-892e-4fb2-b526-a05764d7d838 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:47.690221 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957453dd-892e-4fb2-b526-a05764d7d838 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:47.691708 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957453dd-892e-4fb2-b526-a05764d7d838 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:47.700850 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1425/2844] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:06:47 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:06:53.025412 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5828d32-8b75-40bc-ac4b-83509518d630 service cinder] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:53.039385 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:53.092174 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5828d32-8b75-40bc-ac4b-83509518d630 service cinder] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:53.096623 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f62fdf-6af7-4d34-969e-c23be8e5ca53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:53.097854 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f62fdf-6af7-4d34-969e-c23be8e5ca53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:53.098136 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f62fdf-6af7-4d34-969e-c23be8e5ca53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:53.098410 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f62fdf-6af7-4d34-969e-c23be8e5ca53 admin admin] PATH_INFO: `/v3/users/d8597d3082d4497c977a448d266e4a3d` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:53.099616 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f62fdf-6af7-4d34-969e-c23be8e5ca53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8597d3082d4497c977a448d266e4a3d)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:53.101595 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f62fdf-6af7-4d34-969e-c23be8e5ca53 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:53.158220 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-00f62fdf-6af7-4d34-969e-c23be8e5ca53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8597d3082d4497c977a448d266e4a3d'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:53.159042 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-00f62fdf-6af7-4d34-969e-c23be8e5ca53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8597d3082d4497c977a448d266e4a3d'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:53.168688 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-00f62fdf-6af7-4d34-969e-c23be8e5ca53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8597d3082d4497c977a448d266e4a3d'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:53.169364 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-00f62fdf-6af7-4d34-969e-c23be8e5ca53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8597d3082d4497c977a448d266e4a3d'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:53.182116 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-00f62fdf-6af7-4d34-969e-c23be8e5ca53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8597d3082d4497c977a448d266e4a3d'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:53.194962 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1420/2845] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:06:53 2022] DELETE /identity/v3/users/d8597d3082d4497c977a448d266e4a3d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:06:53.199950 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b2fdc-e1af-4bca-9267-be099de7102e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:53.200512 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b2fdc-e1af-4bca-9267-be099de7102e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:53.200512 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b2fdc-e1af-4bca-9267-be099de7102e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:53.221855 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-674b2fdc-e1af-4bca-9267-be099de7102e None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:06:53.225503 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-674b2fdc-e1af-4bca-9267-be099de7102e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:53.237297 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=100 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:53.306955 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1426/2846] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:06:53.320014 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f62fdf-6af7-4d34-969e-c23be8e5ca53 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:53.321684 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-00f62fdf-6af7-4d34-969e-c23be8e5ca53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:53.382330 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f62fdf-6af7-4d34-969e-c23be8e5ca53 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:53.386329 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c2f83-3445-4426-aa1c-03351e1ae6f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:53.387005 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c2f83-3445-4426-aa1c-03351e1ae6f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:53.387312 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c2f83-3445-4426-aa1c-03351e1ae6f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:53.387579 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c2f83-3445-4426-aa1c-03351e1ae6f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:53.397040 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c2f83-3445-4426-aa1c-03351e1ae6f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:53.398492 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c2f83-3445-4426-aa1c-03351e1ae6f6 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:53.408034 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1421/2847] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:06:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:06:53.723303 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b2fdc-e1af-4bca-9267-be099de7102e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:53.725505 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-674b2fdc-e1af-4bca-9267-be099de7102e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:53.743805 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b2fdc-e1af-4bca-9267-be099de7102e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:53.751110 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af513721-781e-47b8-9a1d-c67337c4dd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:53.752693 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af513721-781e-47b8-9a1d-c67337c4dd1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:53.753236 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af513721-781e-47b8-9a1d-c67337c4dd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:53.753743 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af513721-781e-47b8-9a1d-c67337c4dd1a admin admin] PATH_INFO: `/v3/projects/4cd3aad8803e4e298e5c2cac518e1d0b` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:53.756677 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af513721-781e-47b8-9a1d-c67337c4dd1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cd3aad8803e4e298e5c2cac518e1d0b)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:53.759147 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af513721-781e-47b8-9a1d-c67337c4dd1a admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:53.811457 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-af513721-781e-47b8-9a1d-c67337c4dd1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cd3aad8803e4e298e5c2cac518e1d0b', 'request_id': 'req-af513721-781e-47b8-9a1d-c67337c4dd1a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:53.818380 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-af513721-781e-47b8-9a1d-c67337c4dd1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cd3aad8803e4e298e5c2cac518e1d0b', 'request_id': 'req-af513721-781e-47b8-9a1d-c67337c4dd1a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:53.827858 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-af513721-781e-47b8-9a1d-c67337c4dd1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cd3aad8803e4e298e5c2cac518e1d0b', 'request_id': 'req-af513721-781e-47b8-9a1d-c67337c4dd1a'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:53.841974 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-af513721-781e-47b8-9a1d-c67337c4dd1a admin admin] The token cache is being invalidate because project 4cd3aad8803e4e298e5c2cac518e1d0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:06:53.842256 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-af513721-781e-47b8-9a1d-c67337c4dd1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:53.842952 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-af513721-781e-47b8-9a1d-c67337c4dd1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:53.844620 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1427/2848] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:06:53 2022] DELETE /identity/v3/projects/4cd3aad8803e4e298e5c2cac518e1d0b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:06:53.849089 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c2f83-3445-4426-aa1c-03351e1ae6f6 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:53.859395 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c2f83-3445-4426-aa1c-03351e1ae6f6 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:53.890892 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:53.918803 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296ae73-e11f-4cd6-9b19-163c4848f3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:53.919663 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296ae73-e11f-4cd6-9b19-163c4848f3ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:53.919945 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296ae73-e11f-4cd6-9b19-163c4848f3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:53.920280 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296ae73-e11f-4cd6-9b19-163c4848f3ba admin admin] PATH_INFO: `/v3/users/1786c45520b44e79b943820bc978284e` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:53.921602 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296ae73-e11f-4cd6-9b19-163c4848f3ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=1786c45520b44e79b943820bc978284e)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:53.923626 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296ae73-e11f-4cd6-9b19-163c4848f3ba admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:53.969861 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0296ae73-e11f-4cd6-9b19-163c4848f3ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1786c45520b44e79b943820bc978284e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:53.970501 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0296ae73-e11f-4cd6-9b19-163c4848f3ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1786c45520b44e79b943820bc978284e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:53.978668 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0296ae73-e11f-4cd6-9b19-163c4848f3ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1786c45520b44e79b943820bc978284e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:53.979460 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0296ae73-e11f-4cd6-9b19-163c4848f3ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1786c45520b44e79b943820bc978284e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:53.991428 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-0296ae73-e11f-4cd6-9b19-163c4848f3ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1786c45520b44e79b943820bc978284e'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:54.003342 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1422/2849] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:06:53 2022] DELETE /identity/v3/users/1786c45520b44e79b943820bc978284e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:06:54.294003 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af513721-781e-47b8-9a1d-c67337c4dd1a admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:54.295565 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-af513721-781e-47b8-9a1d-c67337c4dd1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:54.310034 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af513721-781e-47b8-9a1d-c67337c4dd1a admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:54.367672 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3243bb6-cfb5-4d51-94e6-47297ed46ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:54.368533 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3243bb6-cfb5-4d51-94e6-47297ed46ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:54.368806 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3243bb6-cfb5-4d51-94e6-47297ed46ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:54.369074 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3243bb6-cfb5-4d51-94e6-47297ed46ca2 admin admin] PATH_INFO: `/v3/projects/6588eec5c56a4bc6ae5d92b1107a728e` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:54.370429 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3243bb6-cfb5-4d51-94e6-47297ed46ca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6588eec5c56a4bc6ae5d92b1107a728e)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:54.372376 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3243bb6-cfb5-4d51-94e6-47297ed46ca2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:54.412318 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:54.421975 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c3243bb6-cfb5-4d51-94e6-47297ed46ca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6588eec5c56a4bc6ae5d92b1107a728e', 'request_id': 'req-c3243bb6-cfb5-4d51-94e6-47297ed46ca2'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:54.428126 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c3243bb6-cfb5-4d51-94e6-47297ed46ca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6588eec5c56a4bc6ae5d92b1107a728e', 'request_id': 'req-c3243bb6-cfb5-4d51-94e6-47297ed46ca2'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:54.435544 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c3243bb6-cfb5-4d51-94e6-47297ed46ca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6588eec5c56a4bc6ae5d92b1107a728e', 'request_id': 'req-c3243bb6-cfb5-4d51-94e6-47297ed46ca2'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:54.445373 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c3243bb6-cfb5-4d51-94e6-47297ed46ca2 admin admin] The token cache is being invalidate because project 6588eec5c56a4bc6ae5d92b1107a728e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:06:54.445650 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c3243bb6-cfb5-4d51-94e6-47297ed46ca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:54.446247 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-c3243bb6-cfb5-4d51-94e6-47297ed46ca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:54.447787 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1428/2850] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:06:54 2022] DELETE /identity/v3/projects/6588eec5c56a4bc6ae5d92b1107a728e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:06:54.452918 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a3a60-0804-4380-9383-c7d880ab700b None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:54.453400 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a3a60-0804-4380-9383-c7d880ab700b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:54.453509 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a3a60-0804-4380-9383-c7d880ab700b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:54.472161 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-c26a3a60-0804-4380-9383-c7d880ab700b None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:06:54.473627 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c26a3a60-0804-4380-9383-c7d880ab700b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:54.535091 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1423/2851] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:06:54.544138 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748873f0-f325-4ed3-b85c-b17825383111 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:54.544423 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748873f0-f325-4ed3-b85c-b17825383111 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:54.544696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748873f0-f325-4ed3-b85c-b17825383111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:54.563940 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-748873f0-f325-4ed3-b85c-b17825383111 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:06:54.565155 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-748873f0-f325-4ed3-b85c-b17825383111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:54.573364 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1429/2852] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:06:54.577574 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a3a60-0804-4380-9383-c7d880ab700b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:54.587223 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a3a60-0804-4380-9383-c7d880ab700b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:54.592283 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3886d1-413e-4d16-85e6-6a117b2a8732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:54.592700 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3886d1-413e-4d16-85e6-6a117b2a8732 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:54.592990 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3886d1-413e-4d16-85e6-6a117b2a8732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:54.593249 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3886d1-413e-4d16-85e6-6a117b2a8732 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:54.593967 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3886d1-413e-4d16-85e6-6a117b2a8732 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 06:06:54.594265 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3886d1-413e-4d16-85e6-6a117b2a8732 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:54.595901 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3886d1-413e-4d16-85e6-6a117b2a8732 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:54.608848 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1424/2853] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 06:06:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 06:06:54.613322 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748873f0-f325-4ed3-b85c-b17825383111 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:54.622785 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748873f0-f325-4ed3-b85c-b17825383111 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:54.627632 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef0c6b-bc36-426d-a4f9-ebb5854db113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:54.628310 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef0c6b-bc36-426d-a4f9-ebb5854db113 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:54.628584 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef0c6b-bc36-426d-a4f9-ebb5854db113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:54.628854 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef0c6b-bc36-426d-a4f9-ebb5854db113 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:54.629548 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef0c6b-bc36-426d-a4f9-ebb5854db113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:54.631480 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef0c6b-bc36-426d-a4f9-ebb5854db113 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:54.657593 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1430/2854] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:06:54 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:06:54.662005 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3886d1-413e-4d16-85e6-6a117b2a8732 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:54.672531 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3886d1-413e-4d16-85e6-6a117b2a8732 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:54.710953 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:54.732319 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5f551-7067-4601-b3b6-d86499f5b5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:54.732938 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5f551-7067-4601-b3b6-d86499f5b5eb admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:54.733216 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5f551-7067-4601-b3b6-d86499f5b5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:54.733490 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5f551-7067-4601-b3b6-d86499f5b5eb admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:54.734181 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5f551-7067-4601-b3b6-d86499f5b5eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:54.736156 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5f551-7067-4601-b3b6-d86499f5b5eb admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:54.758473 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1425/2855] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:06:54 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 06:06:54.762907 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef0c6b-bc36-426d-a4f9-ebb5854db113 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:54.773734 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef0c6b-bc36-426d-a4f9-ebb5854db113 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:54.779460 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcee59d-3bf7-418a-91eb-7bcd56b68a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:54.780112 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcee59d-3bf7-418a-91eb-7bcd56b68a15 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:54.780390 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcee59d-3bf7-418a-91eb-7bcd56b68a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:54.780665 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcee59d-3bf7-418a-91eb-7bcd56b68a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:54.781388 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcee59d-3bf7-418a-91eb-7bcd56b68a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:54.783003 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcee59d-3bf7-418a-91eb-7bcd56b68a15 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:54.793426 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1431/2856] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:06:54.799083 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5f551-7067-4601-b3b6-d86499f5b5eb admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:54.810334 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5f551-7067-4601-b3b6-d86499f5b5eb admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:54.815940 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705af267-9394-4d1a-a212-45318333d515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:54.816627 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705af267-9394-4d1a-a212-45318333d515 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:54.816923 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705af267-9394-4d1a-a212-45318333d515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:54.817202 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705af267-9394-4d1a-a212-45318333d515 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:54.817937 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705af267-9394-4d1a-a212-45318333d515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:54.819633 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705af267-9394-4d1a-a212-45318333d515 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:54.830510 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1426/2857] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:06:54.835009 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcee59d-3bf7-418a-91eb-7bcd56b68a15 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:54.846480 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcee59d-3bf7-418a-91eb-7bcd56b68a15 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:54.851887 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f3469-6694-4657-86c8-22d23d3e386d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:54.853118 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f3469-6694-4657-86c8-22d23d3e386d admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:54.853452 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f3469-6694-4657-86c8-22d23d3e386d admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:54.853731 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f3469-6694-4657-86c8-22d23d3e386d admin admin] PATH_INFO: `/v3/projects/fc3dde5e5e8a4972b52c2bf8de7e7394/users/a9c0b1b8f52f4c73a462303608cc44c7/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:54.868581 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f3469-6694-4657-86c8-22d23d3e386d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc3dde5e5e8a4972b52c2bf8de7e7394, user_id=a9c0b1b8f52f4c73a462303608cc44c7, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:54.871356 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f3469-6694-4657-86c8-22d23d3e386d admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:54.884934 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1432/2858] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:06:54 2022] PUT /identity/v3/projects/fc3dde5e5e8a4972b52c2bf8de7e7394/users/a9c0b1b8f52f4c73a462303608cc44c7/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:06:54.895410 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ab931-bb4f-48d5-a2f2-a33edfd0da7d None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:54.895702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ab931-bb4f-48d5-a2f2-a33edfd0da7d None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:54.895987 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ab931-bb4f-48d5-a2f2-a33edfd0da7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:54.923533 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-b97ab931-bb4f-48d5-a2f2-a33edfd0da7d None None] MFA Rules not processed for user `a9c0b1b8f52f4c73a462303608cc44c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:06:54.924802 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-b97ab931-bb4f-48d5-a2f2-a33edfd0da7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:54.994613 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1427/2859] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:06:54 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:06:55.006069 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f3469-6694-4657-86c8-22d23d3e386d admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:55.008087 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-f92f3469-6694-4657-86c8-22d23d3e386d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:55.076842 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f3469-6694-4657-86c8-22d23d3e386d admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:55.081630 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31b518-388a-4dd5-acdd-60190ea8d5a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:55.082294 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31b518-388a-4dd5-acdd-60190ea8d5a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:55.082577 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31b518-388a-4dd5-acdd-60190ea8d5a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:55.082854 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31b518-388a-4dd5-acdd-60190ea8d5a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:55.092136 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31b518-388a-4dd5-acdd-60190ea8d5a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:55.093630 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31b518-388a-4dd5-acdd-60190ea8d5a4 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:55.103176 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1433/2860] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:06:55 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:06:55.123342 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ab931-bb4f-48d5-a2f2-a33edfd0da7d None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:55.189499 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ab931-bb4f-48d5-a2f2-a33edfd0da7d None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:55.195542 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a21a6-3e5c-4229-b6f5-0e792030e9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:55.196455 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a21a6-3e5c-4229-b6f5-0e792030e9a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:55.196736 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a21a6-3e5c-4229-b6f5-0e792030e9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:55.197015 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a21a6-3e5c-4229-b6f5-0e792030e9a2 admin admin] PATH_INFO: `/v3/users/a9c0b1b8f52f4c73a462303608cc44c7` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:55.198300 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a21a6-3e5c-4229-b6f5-0e792030e9a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9c0b1b8f52f4c73a462303608cc44c7)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:55.200315 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a21a6-3e5c-4229-b6f5-0e792030e9a2 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:55.252803 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-1c2a21a6-3e5c-4229-b6f5-0e792030e9a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9c0b1b8f52f4c73a462303608cc44c7'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:55.253429 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-1c2a21a6-3e5c-4229-b6f5-0e792030e9a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9c0b1b8f52f4c73a462303608cc44c7'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:55.256048 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:55.261650 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-1c2a21a6-3e5c-4229-b6f5-0e792030e9a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9c0b1b8f52f4c73a462303608cc44c7'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:55.262470 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-1c2a21a6-3e5c-4229-b6f5-0e792030e9a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9c0b1b8f52f4c73a462303608cc44c7'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:55.275015 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-1c2a21a6-3e5c-4229-b6f5-0e792030e9a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9c0b1b8f52f4c73a462303608cc44c7'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:55.288037 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1428/2861] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:06:55 2022] DELETE /identity/v3/users/a9c0b1b8f52f4c73a462303608cc44c7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:06:55.292782 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4421b9f-b4ef-4659-be10-774b3b614f59 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:55.293062 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4421b9f-b4ef-4659-be10-774b3b614f59 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:55.293340 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4421b9f-b4ef-4659-be10-774b3b614f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:55.311913 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-d4421b9f-b4ef-4659-be10-774b3b614f59 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:06:55.313126 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d4421b9f-b4ef-4659-be10-774b3b614f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:55.375199 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1434/2862] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:06:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:06:55.385323 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a21a6-3e5c-4229-b6f5-0e792030e9a2 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:55.387316 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-1c2a21a6-3e5c-4229-b6f5-0e792030e9a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:55.450684 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a21a6-3e5c-4229-b6f5-0e792030e9a2 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:55.454729 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d64e4-0aad-47c0-98b3-ec7be9a3a1f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:55.455470 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d64e4-0aad-47c0-98b3-ec7be9a3a1f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:55.455755 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d64e4-0aad-47c0-98b3-ec7be9a3a1f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:55.456028 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d64e4-0aad-47c0-98b3-ec7be9a3a1f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:55.466217 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d64e4-0aad-47c0-98b3-ec7be9a3a1f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:55.467720 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d64e4-0aad-47c0-98b3-ec7be9a3a1f9 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:55.477983 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1429/2863] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:06:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:06:55.758291 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4421b9f-b4ef-4659-be10-774b3b614f59 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:55.760068 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-d4421b9f-b4ef-4659-be10-774b3b614f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:55.768866 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:55.777646 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4421b9f-b4ef-4659-be10-774b3b614f59 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:55.783363 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6d303-8d1c-4828-8b1a-c2154f0333ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:55.784305 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6d303-8d1c-4828-8b1a-c2154f0333ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:55.784505 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6d303-8d1c-4828-8b1a-c2154f0333ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:55.784786 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6d303-8d1c-4828-8b1a-c2154f0333ee admin admin] PATH_INFO: `/v3/projects/fc3dde5e5e8a4972b52c2bf8de7e7394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:55.786185 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6d303-8d1c-4828-8b1a-c2154f0333ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc3dde5e5e8a4972b52c2bf8de7e7394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:55.788207 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6d303-8d1c-4828-8b1a-c2154f0333ee admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:55.836036 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6ed6d303-8d1c-4828-8b1a-c2154f0333ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc3dde5e5e8a4972b52c2bf8de7e7394', 'request_id': 'req-6ed6d303-8d1c-4828-8b1a-c2154f0333ee'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:55.842160 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6ed6d303-8d1c-4828-8b1a-c2154f0333ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc3dde5e5e8a4972b52c2bf8de7e7394', 'request_id': 'req-6ed6d303-8d1c-4828-8b1a-c2154f0333ee'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:55.851158 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6ed6d303-8d1c-4828-8b1a-c2154f0333ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc3dde5e5e8a4972b52c2bf8de7e7394', 'request_id': 'req-6ed6d303-8d1c-4828-8b1a-c2154f0333ee'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:55.861641 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6ed6d303-8d1c-4828-8b1a-c2154f0333ee admin admin] The token cache is being invalidate because project fc3dde5e5e8a4972b52c2bf8de7e7394 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80213) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:06:55.861929 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6ed6d303-8d1c-4828-8b1a-c2154f0333ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:55.862565 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-6ed6d303-8d1c-4828-8b1a-c2154f0333ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:06:55.864165 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1435/2864] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:06:55 2022] DELETE /identity/v3/projects/fc3dde5e5e8a4972b52c2bf8de7e7394 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:06:55.868997 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4bb91-d40e-472d-b6bc-29866c9f1b7e None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:55.869284 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4bb91-d40e-472d-b6bc-29866c9f1b7e None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:55.869562 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4bb91-d40e-472d-b6bc-29866c9f1b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:56.011889 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-87e4bb91-d40e-472d-b6bc-29866c9f1b7e None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:06:56.013160 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-87e4bb91-d40e-472d-b6bc-29866c9f1b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:56.076760 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1430/2865] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:06:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:06:56.085059 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748b96d-9d8f-4871-bc51-a950060274b6 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:56.085349 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748b96d-9d8f-4871-bc51-a950060274b6 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:56.085615 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748b96d-9d8f-4871-bc51-a950060274b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:56.105609 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-b748b96d-9d8f-4871-bc51-a950060274b6 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:06:56.106747 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-b748b96d-9d8f-4871-bc51-a950060274b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:56.115033 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1436/2866] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:06:56.119347 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4bb91-d40e-472d-b6bc-29866c9f1b7e None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:56.129414 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4bb91-d40e-472d-b6bc-29866c9f1b7e None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:56.134113 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3978986-ca79-41e1-8a77-56a564a6ce24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:56.134762 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3978986-ca79-41e1-8a77-56a564a6ce24 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:56.135036 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3978986-ca79-41e1-8a77-56a564a6ce24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:56.135330 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3978986-ca79-41e1-8a77-56a564a6ce24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:56.136057 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3978986-ca79-41e1-8a77-56a564a6ce24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80212) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 06:06:56.136361 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3978986-ca79-41e1-8a77-56a564a6ce24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:56.137944 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3978986-ca79-41e1-8a77-56a564a6ce24 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:56.154772 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1431/2867] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 06:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 06:06:56.159337 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748b96d-9d8f-4871-bc51-a950060274b6 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:56.168818 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748b96d-9d8f-4871-bc51-a950060274b6 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:56.174417 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5cd72-7a3d-4010-8c28-ca3c0bf7bb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:56.175131 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5cd72-7a3d-4010-8c28-ca3c0bf7bb89 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:56.175474 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5cd72-7a3d-4010-8c28-ca3c0bf7bb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:56.175841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5cd72-7a3d-4010-8c28-ca3c0bf7bb89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:56.176561 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5cd72-7a3d-4010-8c28-ca3c0bf7bb89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:56.178533 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5cd72-7a3d-4010-8c28-ca3c0bf7bb89 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:56.206852 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1437/2868] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:06:56 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:06:56.211019 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3978986-ca79-41e1-8a77-56a564a6ce24 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:56.221212 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3978986-ca79-41e1-8a77-56a564a6ce24 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:56.272455 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:56.281249 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb10eb6-a286-460b-bcf5-3db9ef7b797c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:56.281926 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb10eb6-a286-460b-bcf5-3db9ef7b797c admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:56.282215 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb10eb6-a286-460b-bcf5-3db9ef7b797c admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:56.282496 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb10eb6-a286-460b-bcf5-3db9ef7b797c admin admin] PATH_INFO: `/v3/users` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:56.283214 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb10eb6-a286-460b-bcf5-3db9ef7b797c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:56.285608 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb10eb6-a286-460b-bcf5-3db9ef7b797c admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:56.306165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1432/2869] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:06:56 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:06:56.310290 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5cd72-7a3d-4010-8c28-ca3c0bf7bb89 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:56.320750 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5cd72-7a3d-4010-8c28-ca3c0bf7bb89 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:56.325843 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62af68-4b2a-446a-b1a0-071b59af4960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:56.326790 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62af68-4b2a-446a-b1a0-071b59af4960 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:56.327064 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62af68-4b2a-446a-b1a0-071b59af4960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:56.327384 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62af68-4b2a-446a-b1a0-071b59af4960 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:56.328100 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62af68-4b2a-446a-b1a0-071b59af4960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:56.329717 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62af68-4b2a-446a-b1a0-071b59af4960 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:56.340428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1438/2870] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:06:56.344424 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb10eb6-a286-460b-bcf5-3db9ef7b797c admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:56.354688 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb10eb6-a286-460b-bcf5-3db9ef7b797c admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:56.359886 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b3c11-7794-4b66-96ff-14d1cf2dc78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:56.360471 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b3c11-7794-4b66-96ff-14d1cf2dc78b admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:56.360751 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b3c11-7794-4b66-96ff-14d1cf2dc78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:56.361026 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b3c11-7794-4b66-96ff-14d1cf2dc78b admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:56.361783 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740b3c11-7794-4b66-96ff-14d1cf2dc78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:56.363685 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740b3c11-7794-4b66-96ff-14d1cf2dc78b admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:56.373764 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1433/2871] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 06:06:56.377682 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62af68-4b2a-446a-b1a0-071b59af4960 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:56.387793 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62af68-4b2a-446a-b1a0-071b59af4960 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:56.394186 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74622cd2-d4b4-4222-84fb-6c6eceb9eb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:56.395576 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74622cd2-d4b4-4222-84fb-6c6eceb9eb84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:56.395964 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74622cd2-d4b4-4222-84fb-6c6eceb9eb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:56.396329 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74622cd2-d4b4-4222-84fb-6c6eceb9eb84 admin admin] PATH_INFO: `/v3/projects/c855e07be3564a2fb0277f58c0d0e8e9/users/ac96ba08e8b4413fadbf5538391c1f41/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:56.418264 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74622cd2-d4b4-4222-84fb-6c6eceb9eb84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c855e07be3564a2fb0277f58c0d0e8e9, user_id=ac96ba08e8b4413fadbf5538391c1f41, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:56.421157 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74622cd2-d4b4-4222-84fb-6c6eceb9eb84 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:56.435172 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1439/2872] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:06:56 2022] PUT /identity/v3/projects/c855e07be3564a2fb0277f58c0d0e8e9/users/ac96ba08e8b4413fadbf5538391c1f41/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:06:56.440437 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0eb189-1582-4d95-8566-97189d42f520 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:56.440724 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0eb189-1582-4d95-8566-97189d42f520 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:56.440997 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0eb189-1582-4d95-8566-97189d42f520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:56.459603 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-bf0eb189-1582-4d95-8566-97189d42f520 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:06:56.460796 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-bf0eb189-1582-4d95-8566-97189d42f520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:56.523005 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1434/2873] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:06:56.532838 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74622cd2-d4b4-4222-84fb-6c6eceb9eb84 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:56.534771 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-74622cd2-d4b4-4222-84fb-6c6eceb9eb84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:56.592800 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74622cd2-d4b4-4222-84fb-6c6eceb9eb84 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:56.597249 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34715e5c-619d-497b-a7f4-0dcfb3484e8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:56.598219 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34715e5c-619d-497b-a7f4-0dcfb3484e8a service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:56.598503 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34715e5c-619d-497b-a7f4-0dcfb3484e8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:56.598807 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34715e5c-619d-497b-a7f4-0dcfb3484e8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:56.608463 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34715e5c-619d-497b-a7f4-0dcfb3484e8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:56.610009 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34715e5c-619d-497b-a7f4-0dcfb3484e8a service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:56.619583 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1440/2874] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:06:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:06:57.264880 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e124ce-7e34-4427-b56f-b8a630cbb1ca None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:57.265165 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e124ce-7e34-4427-b56f-b8a630cbb1ca None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:57.265437 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e124ce-7e34-4427-b56f-b8a630cbb1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:57.292341 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-c1e124ce-7e34-4427-b56f-b8a630cbb1ca None None] MFA Rules not processed for user `ac96ba08e8b4413fadbf5538391c1f41`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:06:57.293604 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-c1e124ce-7e34-4427-b56f-b8a630cbb1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:57.370498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1435/2875] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:06:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:06:57.381749 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34715e5c-619d-497b-a7f4-0dcfb3484e8a service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:57.383126 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-34715e5c-619d-497b-a7f4-0dcfb3484e8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:57.413790 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:06:57.445551 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34715e5c-619d-497b-a7f4-0dcfb3484e8a service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:57.449496 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5063a-5c66-4083-808f-b803c6413c43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:57.450164 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5063a-5c66-4083-808f-b803c6413c43 service cinder] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:57.450440 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5063a-5c66-4083-808f-b803c6413c43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:57.450733 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5063a-5c66-4083-808f-b803c6413c43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:57.459406 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad5063a-5c66-4083-808f-b803c6413c43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:57.460844 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad5063a-5c66-4083-808f-b803c6413c43 service cinder] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:57.469579 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1441/2876] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:06:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:06:58.837792 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c53dd3-e707-4bc2-83c2-8e7dae7c0fb8 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:58.838596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c53dd3-e707-4bc2-83c2-8e7dae7c0fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:58.838596 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c53dd3-e707-4bc2-83c2-8e7dae7c0fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:58.859910 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-59c53dd3-e707-4bc2-83c2-8e7dae7c0fb8 None None] MFA Rules not processed for user `ac96ba08e8b4413fadbf5538391c1f41`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:06:58.861103 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-59c53dd3-e707-4bc2-83c2-8e7dae7c0fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:58.868129 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1436/2877] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:06:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:06:59.440978 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5063a-5c66-4083-808f-b803c6413c43 service cinder] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:06:59.442477 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-cad5063a-5c66-4083-808f-b803c6413c43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:59.515673 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5063a-5c66-4083-808f-b803c6413c43 service cinder] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:06:59.520724 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95645f-2337-4bd4-8e2c-9b159fc164e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260f58535f4e46a197d00276d37fd515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:06:59.521404 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95645f-2337-4bd4-8e2c-9b159fc164e8 service placement] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:06:59.521687 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95645f-2337-4bd4-8e2c-9b159fc164e8 service placement] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:06:59.521963 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95645f-2337-4bd4-8e2c-9b159fc164e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:06:59.523827 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0b95645f-2337-4bd4-8e2c-9b159fc164e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:06:59.535741 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b95645f-2337-4bd4-8e2c-9b159fc164e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:06:59.537359 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b95645f-2337-4bd4-8e2c-9b159fc164e8 service placement] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:06:59.547544 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1442/2878] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:06:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:07:01.138483 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c53dd3-e707-4bc2-83c2-8e7dae7c0fb8 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:07:01.140253 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-59c53dd3-e707-4bc2-83c2-8e7dae7c0fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:07:01.152579 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c53dd3-e707-4bc2-83c2-8e7dae7c0fb8 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:07:01.156208 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf0993-8933-4b20-b309-cb976f4d1055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:07:01.156841 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf0993-8933-4b20-b309-cb976f4d1055 service neutron] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:07:01.157120 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf0993-8933-4b20-b309-cb976f4d1055 service neutron] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:07:01.157389 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf0993-8933-4b20-b309-cb976f4d1055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:07:01.159135 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-79bf0993-8933-4b20-b309-cb976f4d1055 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:07:01.168370 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf0993-8933-4b20-b309-cb976f4d1055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:07:01.169801 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf0993-8933-4b20-b309-cb976f4d1055 service neutron] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:07:01.177909 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1437/2879] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:07:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:07:01.880539 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95645f-2337-4bd4-8e2c-9b159fc164e8 service placement] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:07:01.882709 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-0b95645f-2337-4bd4-8e2c-9b159fc164e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:07:01.986492 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95645f-2337-4bd4-8e2c-9b159fc164e8 service placement] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:07:01.994059 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b444840-bcf3-4915-81ce-ffdb26546d1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:07:01.994720 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b444840-bcf3-4915-81ce-ffdb26546d1f service nova] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:07:01.994996 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b444840-bcf3-4915-81ce-ffdb26546d1f service nova] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:07:01.995298 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b444840-bcf3-4915-81ce-ffdb26546d1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:07:01.997256 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-6b444840-bcf3-4915-81ce-ffdb26546d1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:07:02.011208 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b444840-bcf3-4915-81ce-ffdb26546d1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:07:02.012842 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b444840-bcf3-4915-81ce-ffdb26546d1f service nova] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:07:02.025052 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1443/2880] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:07:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:07:06.837702 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf0993-8933-4b20-b309-cb976f4d1055 service neutron] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:07:06.839405 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-79bf0993-8933-4b20-b309-cb976f4d1055 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:07:06.858847 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf0993-8933-4b20-b309-cb976f4d1055 service neutron] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:07:06.864516 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe14789-0b76-4ee1-9322-8caa3c8756d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f638cc70c994a529a48cb2c92b70384', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:07:06.865169 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe14789-0b76-4ee1-9322-8caa3c8756d7 service nova] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:07:06.865451 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe14789-0b76-4ee1-9322-8caa3c8756d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:07:06.865727 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe14789-0b76-4ee1-9322-8caa3c8756d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:07:06.867571 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-6fe14789-0b76-4ee1-9322-8caa3c8756d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:07:06.879912 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe14789-0b76-4ee1-9322-8caa3c8756d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:07:06.881523 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe14789-0b76-4ee1-9322-8caa3c8756d7 service nova] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:07:06.892419 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1438/2881] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:07:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 06:07:12.019772 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=80 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:07:12.925636 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c31835-1413-459e-8882-a1d788ef234e None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:07:12.925902 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c31835-1413-459e-8882-a1d788ef234e None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:07:12.926173 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c31835-1413-459e-8882-a1d788ef234e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:07:12.945580 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-a9c31835-1413-459e-8882-a1d788ef234e None None] MFA Rules not processed for user `ac96ba08e8b4413fadbf5538391c1f41`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:07:12.946805 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a9c31835-1413-459e-8882-a1d788ef234e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:07:12.954896 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1444/2882] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:07:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:07:16.887775 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=82,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:07:22.939736 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=3 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:07:27.413503 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e62e2b-ef59-4947-b521-fb38ac6bff5a None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:07:27.414041 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e62e2b-ef59-4947-b521-fb38ac6bff5a None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:07:27.414041 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e62e2b-ef59-4947-b521-fb38ac6bff5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:07:27.435498 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-56e62e2b-ef59-4947-b521-fb38ac6bff5a None None] MFA Rules not processed for user `3ed779ae7e0f4c90aaed6d1f9e86a4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:07:27.437389 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-56e62e2b-ef59-4947-b521-fb38ac6bff5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:07:27.504212 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1439/2883] 10.222.0.16 () {58 vars in 1009 bytes} [Mon Jul 4 06:07:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:07:27.555718 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c31835-1413-459e-8882-a1d788ef234e None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:07:27.557270 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-a9c31835-1413-459e-8882-a1d788ef234e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:07:27.630158 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c31835-1413-459e-8882-a1d788ef234e None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:07:27.636300 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf5b05-3055-4dc4-8333-401e948e4ef3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55a1c343c60428db2d9e5e6ed865e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:07:27.636941 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf5b05-3055-4dc4-8333-401e948e4ef3 service swift] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:07:27.637217 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf5b05-3055-4dc4-8333-401e948e4ef3 service swift] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:07:27.637489 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf5b05-3055-4dc4-8333-401e948e4ef3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:07:27.646841 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf5b05-3055-4dc4-8333-401e948e4ef3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:07:27.648493 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf5b05-3055-4dc4-8333-401e948e4ef3 service swift] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:07:27.656773 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1445/2884] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 4 06:07:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 06:07:37.493397 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=25 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:07:37.654252 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=32 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:07:42.198345 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f5124-b94e-41c8-87d5-2a7458004f2b None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:07:42.198798 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f5124-b94e-41c8-87d5-2a7458004f2b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:07:42.198892 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f5124-b94e-41c8-87d5-2a7458004f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:07:42.218194 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-7c7f5124-b94e-41c8-87d5-2a7458004f2b None None] MFA Rules not processed for user `3ed779ae7e0f4c90aaed6d1f9e86a4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:07:42.219434 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-7c7f5124-b94e-41c8-87d5-2a7458004f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:07:42.228491 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1440/2885] 10.222.0.16 () {58 vars in 967 bytes} [Mon Jul 4 06:07:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:07:42.242715 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf5b05-3055-4dc4-8333-401e948e4ef3 service swift] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:07:42.253603 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf5b05-3055-4dc4-8333-401e948e4ef3 service swift] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:07:42.259915 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03703b6e-43ed-465f-816c-02dac248a35a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55a1c343c60428db2d9e5e6ed865e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:07:42.260546 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03703b6e-43ed-465f-816c-02dac248a35a service swift] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:07:42.260790 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03703b6e-43ed-465f-816c-02dac248a35a service swift] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:07:42.261077 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03703b6e-43ed-465f-816c-02dac248a35a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:07:42.269551 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03703b6e-43ed-465f-816c-02dac248a35a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:07:42.271217 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03703b6e-43ed-465f-816c-02dac248a35a service swift] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:07:42.279356 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1446/2886] 10.222.0.16 () {60 vars in 1384 bytes} [Mon Jul 4 06:07:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 06:07:44.175487 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f5124-b94e-41c8-87d5-2a7458004f2b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:07:44.177025 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-7c7f5124-b94e-41c8-87d5-2a7458004f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:07:44.192779 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f5124-b94e-41c8-87d5-2a7458004f2b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:07:44.198093 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e6073-4596-49d0-9437-f5871cbd7e38 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260f58535f4e46a197d00276d37fd515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:07:44.198747 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e6073-4596-49d0-9437-f5871cbd7e38 service placement] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:07:44.199029 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e6073-4596-49d0-9437-f5871cbd7e38 service placement] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:07:44.199330 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e6073-4596-49d0-9437-f5871cbd7e38 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:07:44.201071 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-d29e6073-4596-49d0-9437-f5871cbd7e38 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:07:44.213156 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e6073-4596-49d0-9437-f5871cbd7e38 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:07:44.214891 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e6073-4596-49d0-9437-f5871cbd7e38 service placement] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:07:44.228953 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1441/2887] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:07:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:07:44.236306 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03703b6e-43ed-465f-816c-02dac248a35a service swift] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:07:44.247696 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03703b6e-43ed-465f-816c-02dac248a35a service swift] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:07:44.252694 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d34b91-d6ac-445b-8cd5-c883345223ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:07:44.253549 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d34b91-d6ac-445b-8cd5-c883345223ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:07:44.253829 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d34b91-d6ac-445b-8cd5-c883345223ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:07:44.254107 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d34b91-d6ac-445b-8cd5-c883345223ec admin admin] PATH_INFO: `/v3/users/ac96ba08e8b4413fadbf5538391c1f41` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:07:44.255512 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d34b91-d6ac-445b-8cd5-c883345223ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac96ba08e8b4413fadbf5538391c1f41)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:07:44.257565 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d34b91-d6ac-445b-8cd5-c883345223ec admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:07:44.308690 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d4d34b91-d6ac-445b-8cd5-c883345223ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac96ba08e8b4413fadbf5538391c1f41'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:07:44.315400 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d4d34b91-d6ac-445b-8cd5-c883345223ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac96ba08e8b4413fadbf5538391c1f41'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:07:44.324201 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d4d34b91-d6ac-445b-8cd5-c883345223ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac96ba08e8b4413fadbf5538391c1f41'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:07:44.324812 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d4d34b91-d6ac-445b-8cd5-c883345223ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac96ba08e8b4413fadbf5538391c1f41'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:07:44.337059 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-d4d34b91-d6ac-445b-8cd5-c883345223ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac96ba08e8b4413fadbf5538391c1f41'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:07:44.342844 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1447/2888] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:07:44 2022] DELETE /identity/v3/users/ac96ba08e8b4413fadbf5538391c1f41 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:07:44.519423 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e6073-4596-49d0-9437-f5871cbd7e38 service placement] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:07:44.533216 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e6073-4596-49d0-9437-f5871cbd7e38 service placement] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:07:44.593590 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dbac78-c9ae-45f0-b838-0bb09835ad11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:07:44.594468 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbac78-c9ae-45f0-b838-0bb09835ad11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:07:44.594746 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbac78-c9ae-45f0-b838-0bb09835ad11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:07:44.595018 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbac78-c9ae-45f0-b838-0bb09835ad11 admin admin] PATH_INFO: `/v3/projects/c855e07be3564a2fb0277f58c0d0e8e9` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:07:44.596257 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dbac78-c9ae-45f0-b838-0bb09835ad11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c855e07be3564a2fb0277f58c0d0e8e9)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:07:44.598309 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dbac78-c9ae-45f0-b838-0bb09835ad11 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:07:44.648606 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-32dbac78-c9ae-45f0-b838-0bb09835ad11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c855e07be3564a2fb0277f58c0d0e8e9', 'request_id': 'req-32dbac78-c9ae-45f0-b838-0bb09835ad11'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:07:44.657463 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-32dbac78-c9ae-45f0-b838-0bb09835ad11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c855e07be3564a2fb0277f58c0d0e8e9', 'request_id': 'req-32dbac78-c9ae-45f0-b838-0bb09835ad11'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:07:44.663991 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-32dbac78-c9ae-45f0-b838-0bb09835ad11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c855e07be3564a2fb0277f58c0d0e8e9', 'request_id': 'req-32dbac78-c9ae-45f0-b838-0bb09835ad11'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:07:44.675143 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-32dbac78-c9ae-45f0-b838-0bb09835ad11 admin admin] The token cache is being invalidate because project c855e07be3564a2fb0277f58c0d0e8e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:07:44.675487 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-32dbac78-c9ae-45f0-b838-0bb09835ad11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:07:44.676134 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-32dbac78-c9ae-45f0-b838-0bb09835ad11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:07:44.677812 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1442/2889] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:07:44 2022] DELETE /identity/v3/projects/c855e07be3564a2fb0277f58c0d0e8e9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:07:44.682876 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f338a-3915-4f10-8ab8-e2769103f4b2 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:07:44.683161 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f338a-3915-4f10-8ab8-e2769103f4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:07:44.683523 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f338a-3915-4f10-8ab8-e2769103f4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:07:44.702126 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-470f338a-3915-4f10-8ab8-e2769103f4b2 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:07:44.703368 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-470f338a-3915-4f10-8ab8-e2769103f4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:07:44.775226 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1448/2890] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:07:44.783887 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86965939-31db-45e1-8d11-6472a02b37d5 None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:07:44.784241 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86965939-31db-45e1-8d11-6472a02b37d5 None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:07:44.784590 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86965939-31db-45e1-8d11-6472a02b37d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:07:44.804076 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-86965939-31db-45e1-8d11-6472a02b37d5 None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:07:44.805282 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-86965939-31db-45e1-8d11-6472a02b37d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:07:44.813866 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1443/2891] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:07:44.818244 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f338a-3915-4f10-8ab8-e2769103f4b2 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:07:44.828640 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f338a-3915-4f10-8ab8-e2769103f4b2 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:07:44.834570 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e585c-eb10-45ce-9cba-e480071b36b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:07:44.835267 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e585c-eb10-45ce-9cba-e480071b36b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:07:44.835553 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e585c-eb10-45ce-9cba-e480071b36b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:07:44.835825 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e585c-eb10-45ce-9cba-e480071b36b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:07:44.836550 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e585c-eb10-45ce-9cba-e480071b36b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80213) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 06:07:44.836857 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e585c-eb10-45ce-9cba-e480071b36b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:07:44.838491 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e585c-eb10-45ce-9cba-e480071b36b2 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:07:44.851426 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1449/2892] 10.222.0.16 () {58 vars in 1152 bytes} [Mon Jul 4 06:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 06:07:44.855509 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86965939-31db-45e1-8d11-6472a02b37d5 None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:07:44.865249 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86965939-31db-45e1-8d11-6472a02b37d5 None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:07:44.870326 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817bd35-c2f2-48f0-8027-74233aef538e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:07:44.871013 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817bd35-c2f2-48f0-8027-74233aef538e admin admin] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:07:44.871324 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817bd35-c2f2-48f0-8027-74233aef538e admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:07:44.871594 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817bd35-c2f2-48f0-8027-74233aef538e admin admin] PATH_INFO: `/v3/projects` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:07:44.872287 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817bd35-c2f2-48f0-8027-74233aef538e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:07:44.874189 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817bd35-c2f2-48f0-8027-74233aef538e admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:07:44.900972 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1444/2893] 10.222.0.16 () {60 vars in 1152 bytes} [Mon Jul 4 06:07:44 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:07:44.905166 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e585c-eb10-45ce-9cba-e480071b36b2 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:07:44.915759 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e585c-eb10-45ce-9cba-e480071b36b2 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:07:44.960480 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:07:44.975632 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3005d-6923-4311-8fb6-0b67c9cea7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:07:44.976298 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3005d-6923-4311-8fb6-0b67c9cea7b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:07:44.976595 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3005d-6923-4311-8fb6-0b67c9cea7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:07:44.976867 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3005d-6923-4311-8fb6-0b67c9cea7b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:07:44.977554 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3005d-6923-4311-8fb6-0b67c9cea7b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:07:44.979603 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3005d-6923-4311-8fb6-0b67c9cea7b1 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:07:45.000540 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1450/2894] 10.222.0.16 () {60 vars in 1143 bytes} [Mon Jul 4 06:07:44 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 06:07:45.004856 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817bd35-c2f2-48f0-8027-74233aef538e admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:07:45.015535 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817bd35-c2f2-48f0-8027-74233aef538e admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:07:45.020679 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df150f-b699-416f-80ad-f015e3e612c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:07:45.021346 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df150f-b699-416f-80ad-f015e3e612c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:07:45.021631 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df150f-b699-416f-80ad-f015e3e612c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:07:45.021906 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df150f-b699-416f-80ad-f015e3e612c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:07:45.022619 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df150f-b699-416f-80ad-f015e3e612c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:07:45.024262 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df150f-b699-416f-80ad-f015e3e612c1 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:07:45.035137 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1445/2895] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 06:07:45.040899 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3005d-6923-4311-8fb6-0b67c9cea7b1 admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:07:45.051782 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3005d-6923-4311-8fb6-0b67c9cea7b1 admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:07:45.057307 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124e3b3-3194-4c5b-a941-100f4bcfb306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:07:45.057959 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124e3b3-3194-4c5b-a941-100f4bcfb306 admin admin] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:07:45.058238 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124e3b3-3194-4c5b-a941-100f4bcfb306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:07:45.058507 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124e3b3-3194-4c5b-a941-100f4bcfb306 admin admin] PATH_INFO: `/v3/roles` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:07:45.059213 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124e3b3-3194-4c5b-a941-100f4bcfb306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:07:45.060842 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124e3b3-3194-4c5b-a941-100f4bcfb306 admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:07:45.071599 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1451/2896] 10.222.0.16 () {58 vars in 1121 bytes} [Mon Jul 4 06:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 06:07:45.076085 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df150f-b699-416f-80ad-f015e3e612c1 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:07:45.090851 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df150f-b699-416f-80ad-f015e3e612c1 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:07:45.099795 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2481fa-bb23-463a-8681-92aa209381b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:07:45.100677 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2481fa-bb23-463a-8681-92aa209381b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:07:45.100954 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2481fa-bb23-463a-8681-92aa209381b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:07:45.101226 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2481fa-bb23-463a-8681-92aa209381b1 admin admin] PATH_INFO: `/v3/projects/3db328efe64941ca98d0be314126c9b9/users/fd9431c8140d4403b9e4f19519dc187d/roles/9fdc0a5e493c44c9add5859af9d4f394` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:07:45.120711 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2481fa-bb23-463a-8681-92aa209381b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3db328efe64941ca98d0be314126c9b9, user_id=fd9431c8140d4403b9e4f19519dc187d, role_id=9fdc0a5e493c44c9add5859af9d4f394)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:07:45.123369 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2481fa-bb23-463a-8681-92aa209381b1 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:07:45.138673 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1446/2897] 10.222.0.16 () {60 vars in 1482 bytes} [Mon Jul 4 06:07:45 2022] PUT /identity/v3/projects/3db328efe64941ca98d0be314126c9b9/users/fd9431c8140d4403b9e4f19519dc187d/roles/9fdc0a5e493c44c9add5859af9d4f394 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:07:45.149673 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b632d-f0f2-4121-b71a-db9015e4de25 None None] REQUEST_METHOD: `POST` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:07:45.150083 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b632d-f0f2-4121-b71a-db9015e4de25 None None] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:07:45.150437 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b632d-f0f2-4121-b71a-db9015e4de25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:07:45.182307 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.auth.core [None req-110b632d-f0f2-4121-b71a-db9015e4de25 None None] MFA Rules not processed for user `fd9431c8140d4403b9e4f19519dc187d`. Rule list: `[]` (Enabled: `True`). {{(pid=80213) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:07:45.183556 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-110b632d-f0f2-4121-b71a-db9015e4de25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:07:45.252569 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1452/2898] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:07:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:07:45.264164 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2481fa-bb23-463a-8681-92aa209381b1 admin admin] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:07:45.266341 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-6a2481fa-bb23-463a-8681-92aa209381b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:07:45.277374 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:07:45.327684 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2481fa-bb23-463a-8681-92aa209381b1 admin admin] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:07:45.331525 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd1f61-f943-49cc-ac98-a820e7ce5a1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8103fdfbdcf449a49e770750876bbee3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:07:45.332176 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd1f61-f943-49cc-ac98-a820e7ce5a1e service cinder] REQUEST_METHOD: `GET` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:07:45.332451 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd1f61-f943-49cc-ac98-a820e7ce5a1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:07:45.332723 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd1f61-f943-49cc-ac98-a820e7ce5a1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:07:45.342726 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd1f61-f943-49cc-ac98-a820e7ce5a1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:07:45.345247 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd1f61-f943-49cc-ac98-a820e7ce5a1e service cinder] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:07:45.357332 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1447/2899] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:07:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:07:45.386272 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b632d-f0f2-4121-b71a-db9015e4de25 None None] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:07:45.452792 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b632d-f0f2-4121-b71a-db9015e4de25 None None] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:07:45.457806 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f741ade-f4b5-4d66-a7ff-6ee618834fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:07:45.458731 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f741ade-f4b5-4d66-a7ff-6ee618834fda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:07:45.459008 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f741ade-f4b5-4d66-a7ff-6ee618834fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:07:45.459288 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f741ade-f4b5-4d66-a7ff-6ee618834fda admin admin] PATH_INFO: `/v3/users/fd9431c8140d4403b9e4f19519dc187d` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:07:45.460559 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f741ade-f4b5-4d66-a7ff-6ee618834fda admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd9431c8140d4403b9e4f19519dc187d)` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:07:45.462530 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f741ade-f4b5-4d66-a7ff-6ee618834fda admin admin] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:07:45.511200 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1f741ade-f4b5-4d66-a7ff-6ee618834fda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd9431c8140d4403b9e4f19519dc187d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:07:45.518818 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1f741ade-f4b5-4d66-a7ff-6ee618834fda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd9431c8140d4403b9e4f19519dc187d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:07:45.520473 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:07:45.527453 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1f741ade-f4b5-4d66-a7ff-6ee618834fda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd9431c8140d4403b9e4f19519dc187d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:07:45.528214 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1f741ade-f4b5-4d66-a7ff-6ee618834fda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd9431c8140d4403b9e4f19519dc187d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:07:45.541479 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.notifications [None req-1f741ade-f4b5-4d66-a7ff-6ee618834fda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd9431c8140d4403b9e4f19519dc187d'} {{(pid=80213) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:07:45.547609 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1453/2900] 10.222.0.16 () {58 vars in 1223 bytes} [Mon Jul 4 06:07:45 2022] DELETE /identity/v3/users/fd9431c8140d4403b9e4f19519dc187d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:07:45.552273 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751d14e-b402-4d6c-86e2-57690b52604b None None] REQUEST_METHOD: `POST` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:07:45.552566 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751d14e-b402-4d6c-86e2-57690b52604b None None] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:07:45.552847 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751d14e-b402-4d6c-86e2-57690b52604b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:07:45.571117 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.auth.core [None req-a751d14e-b402-4d6c-86e2-57690b52604b None None] MFA Rules not processed for user `d0887b5131454893aad43e5ea46999bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80212) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 06:07:45.572494 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-a751d14e-b402-4d6c-86e2-57690b52604b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:07:45.635301 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1448/2901] 10.222.0.16 () {58 vars in 957 bytes} [Mon Jul 4 06:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 06:07:45.645651 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f741ade-f4b5-4d66-a7ff-6ee618834fda admin admin] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:07:45.647709 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-1f741ade-f4b5-4d66-a7ff-6ee618834fda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:07:45.710232 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f741ade-f4b5-4d66-a7ff-6ee618834fda admin admin] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:07:45.714428 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0fb63-b788-4b70-bfb9-6ef72782cadc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e5be3de52e945d3af1b2cad1c84c755', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:07:45.715069 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0fb63-b788-4b70-bfb9-6ef72782cadc service neutron] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:07:45.715381 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0fb63-b788-4b70-bfb9-6ef72782cadc service neutron] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:07:45.715655 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0fb63-b788-4b70-bfb9-6ef72782cadc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:07:45.725937 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0fb63-b788-4b70-bfb9-6ef72782cadc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:07:45.727405 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0fb63-b788-4b70-bfb9-6ef72782cadc service neutron] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:07:45.736741 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1454/2902] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:07:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:07:46.017161 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751d14e-b402-4d6c-86e2-57690b52604b None None] Authenticating user token {{(pid=80212) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:07:46.018696 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.fernet_utils [None req-a751d14e-b402-4d6c-86e2-57690b52604b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80212) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:07:46.032490 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751d14e-b402-4d6c-86e2-57690b52604b None None] Validating token access rules against request {{(pid=80212) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:07:46.038040 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef0574-5cd8-438c-b302-70d6f7419e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0887b5131454893aad43e5ea46999bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b420ef42d5dc484fb1563cbae9f104d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80212) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:07:46.039087 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef0574-5cd8-438c-b302-70d6f7419e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:07:46.039509 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef0574-5cd8-438c-b302-70d6f7419e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:07:46.039687 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef0574-5cd8-438c-b302-70d6f7419e78 admin admin] PATH_INFO: `/v3/projects/3db328efe64941ca98d0be314126c9b9` {{(pid=80212) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:07:46.040942 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef0574-5cd8-438c-b302-70d6f7419e78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3db328efe64941ca98d0be314126c9b9)` {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:07:46.042786 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef0574-5cd8-438c-b302-70d6f7419e78 admin admin] RBAC: Authorization granted {{(pid=80212) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:07:46.090418 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4cef0574-5cd8-438c-b302-70d6f7419e78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3db328efe64941ca98d0be314126c9b9', 'request_id': 'req-4cef0574-5cd8-438c-b302-70d6f7419e78'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:07:46.099564 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4cef0574-5cd8-438c-b302-70d6f7419e78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3db328efe64941ca98d0be314126c9b9', 'request_id': 'req-4cef0574-5cd8-438c-b302-70d6f7419e78'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:07:46.106272 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4cef0574-5cd8-438c-b302-70d6f7419e78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3db328efe64941ca98d0be314126c9b9', 'request_id': 'req-4cef0574-5cd8-438c-b302-70d6f7419e78'} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:07:46.118120 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4cef0574-5cd8-438c-b302-70d6f7419e78 admin admin] The token cache is being invalidate because project 3db328efe64941ca98d0be314126c9b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80212) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 06:07:46.118412 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4cef0574-5cd8-438c-b302-70d6f7419e78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:07:46.119169 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG keystone.notifications [None req-4cef0574-5cd8-438c-b302-70d6f7419e78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80212) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 06:07:46.120859 dv-cinder-797333-5-smb devstack@keystone.service[80212]: [pid: 80212|app: 0|req: 1449/2903] 10.222.0.16 () {58 vars in 1232 bytes} [Mon Jul 4 06:07:46 2022] DELETE /identity/v3/projects/3db328efe64941ca98d0be314126c9b9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 06:07:55.733064 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=34 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:07:56.114689 dv-cinder-797333-5-smb devstack@keystone.service[80212]: DEBUG dbcounter [-] [80212] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80212) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 06:09:13.657567 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0fb63-b788-4b70-bfb9-6ef72782cadc service neutron] Authenticating user token {{(pid=80213) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 06:09:13.659271 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-59e0fb63-b788-4b70-bfb9-6ef72782cadc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:09:13.805619 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0fb63-b788-4b70-bfb9-6ef72782cadc service neutron] Validating token access rules against request {{(pid=80213) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 06:09:13.864941 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557a16d-71f8-41b5-8f6d-df2e09bec96c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260f58535f4e46a197d00276d37fd515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bc610fb6724419dac99f2483089c783', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80213) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 06:09:13.865590 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557a16d-71f8-41b5-8f6d-df2e09bec96c service placement] REQUEST_METHOD: `GET` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 06:09:13.865873 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557a16d-71f8-41b5-8f6d-df2e09bec96c service placement] SCRIPT_NAME: `/identity` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 06:09:13.866153 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557a16d-71f8-41b5-8f6d-df2e09bec96c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80213) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 06:09:13.868418 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.fernet_utils [None req-e557a16d-71f8-41b5-8f6d-df2e09bec96c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80213) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 06:09:13.880825 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e557a16d-71f8-41b5-8f6d-df2e09bec96c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 06:09:13.882437 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e557a16d-71f8-41b5-8f6d-df2e09bec96c service placement] RBAC: Authorization granted {{(pid=80213) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 06:09:13.892798 dv-cinder-797333-5-smb devstack@keystone.service[80213]: [pid: 80213|app: 0|req: 1455/2904] 10.222.0.16 () {60 vars in 1365 bytes} [Mon Jul 4 06:09:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 06:09:23.888477 dv-cinder-797333-5-smb devstack@keystone.service[80213]: DEBUG dbcounter [-] [80213] Writing DB stats keystone:SELECT=89 {{(pid=80213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}